Long-range Dependency Shopping
Dependency 		Website Links For
Dependency 		 

Information About

Long-range Dependency
  CATEGORIES ABOUT LONG-RANGE DEPENDENCY
   
teletraffic
   
time series analysis
   
APPAREL
BABY
BEAUTY
BOOKS
CAR TOYS
CELL PHONES
DVD'S
ELECTRONICS
GOURMET FOOD
GROCERIES
HEALTH & PERSONAL
HOME & GARDEN
JEWELRY
MUSIC
MUSIC INSTRUMENTS
OFFICE PRODUCTS
SOFTWARE
SPORTING GOODS
TOOLS & HARDWARE
TOYS
VIDEO GAMES
SHOPPING HOME
MORE SHOPPING...



A Self-similar phenomenon behaves the same when viewed at different degrees of magnification, or different scales on a dimension (space or time). Self-similar processes can be defined using heavy-tailed distributions, also known as '''long-tailed distributions'''. Heavy-tailed distributions can be used to characterise Probability Density that describe traffic processes such as packet inter-arrival times and burst lengths. Self-similar processes are said to exhibit '''long-range dependency'''. {Link without Title}


OVERVIEW


The design of robust and reliable networks and network services has become an increasingly challenging task in today's Internet world. To achieve this goal,
understanding the characteristics of Internet traffic plays a more and more critical
role. Empirical studies of measured traffic traces have led to the wide recognition of
self-similarity in network traffic. {Link without Title}

Self-similar Ethernet traffic exhibits dependencies over a long range of time scales. This is to be contrasted with telephone traffic which is Poisson in its arrival and departure process. {Link without Title} Presented on the right is a graph showing the self-similarity of Ethernet traffic across numerous time scales.

In traditional Poisson traffic, the short-term fluctuations would average out, and a graph covering a large amount of time would approach a constant value.

Heavy-tailed distributions have been observed in many natural phenomena including both physical and sociological phenomena. Mandelbrot established the use of heavy-tailed distributions to model real-world Fractal phenomena, e.g. Stock markets, earthquakes, and the weather. {Link without Title}
Ethernet, WWW , SS7 , TCP , FTP , TELNET and VBR video (digitised video of the type that is transmitted over ATM networks) traffic is self-similar. {Link without Title}

Self-similarity in packetised data networks can be caused by the distribution of file sizes, human interactions and/ or Ethernet dynamics. Self-similar and long-range dependent characteristics in computer networks present a fundamentally different set of problems to people doing analysis and/or design of networks, and many of the previous assumptions upon which systems have been built are no longer valid in the presence of self-similarity. {Link without Title}


SHORT-RANGE DEPENDENCE VS. LONG-RANGE DEPENDENCE


Long-range and short-range dependent processes are characterised by their Autocovariance functions. These autocovariance functions are depicted to the right.

In short-range dependent processes, the coupling between values at different times decreases rapidly as the time difference increases.

In long-range processes there is much stronger coupling.


THE POISSON DISTRIBUTION


Before the heavy-tailed distribution is introduced mathematically, the Poisson Process with a Memoryless waiting-time distribution, used to model traditional telephony networks, is briefly reviewed below.

Assuming pure-chance arrivals and pure-chance terminations leads to the following:
  • The number of call arrivals in a given time has a Poisson distribution, i.e.:


::
P(a)= \left ( rac{\mu^a}{a!} ight )e^{-\mu},


where ''a'' is the number of call arrivals in time ''T'' and \mu is the mean number of call arrivals in time ''T''. For this reason, pure-chance traffic is also known as Poisson traffic.
  • The number of call departures in a given time, also has a Poisson distribution, i.e.:


::
P(d)=\left( rac{\lambda^d}{d!} ight)e^{-\lambda},


where ''d'' is the number of call departures in time ''T'' and \lambda is the mean number of call departures in time ''T''.
  • The intervals, ''T'', between call arrivals and departures are intervals between independent, identically distributed random events. It can be shown that these intervals have a negative exponential distribution, i.e.:


::
P \ge \ t =e^{-t/h},\,


where ''h'' is the mean holding time (MHT).
{Link without Title}

Information on the fundamentals of statistics and probability theory can be found in the External .


THE HEAVY-TAIL DISTRIBUTION


Heavy-tailed distributions have properties that are qualitatively different to commonly used (memoryless) distributions such as the Poisson distribution.

The Hurst parameter H is a measure of the level of self-similarity of a time series that exhibits long-range dependence. H takes on values from 0.5 to 1. A value of 0.5 indicates the absence of self-similarity. The closer H is to 1, the greater the degree of persistence or long-range dependence. {Link without Title}

Typical values of the Hurst parameter, ''H'':
  • Many real-world processes give H about 0.73

  • Exactly self-similarity processes have H = 1

  • Any pure random process has H = 0.5

  • Network traffic can have a range of H values, but is generally between 0.5 and 1

  • All simple stochastic processes with finite local state will tend towards H = 0.5 as the scale becomes arbitrarily large

  • Phenomena with H > 0.5 typically have a complex process structure. {Link without Title}



A distribution is said to have a heavy-tail if:


P {Link without Title} \sim x^{- \alpha},\ as \ x o \infty, 0< \alpha <2


This means that regardless of the distribution for small values of the random variable, if the asymptotic shape of the distribution is hyperbolic, it is heavy-tailed. The simplest heavy-tailed distribution is the Pareto Distribution which is hyperbolic over its entire range. Complementary distribution functions for the exponential and Pareto distributions are shown below. Shown on the left is a graph of the distributions shown on linear axes, over a wide range of x values ( {Link without Title} ). To its right is a graph of the complementary distribution functions over a smaller domain, and with a logarithmic range.

A characteristic of long-tailed distributions is that the log-log plot of the tail of a long-tailed distribution is approximately linear over many orders of magnitude {Link without Title} . If the logarithm of the range of an exponential distribution is found, the resulting plot is linear. In contrast, that of the heavy-tail distribution is still curvilinear. These characteristics can be clearly seen on the graph above to the right. In the graph above left, the condition for the existence of a heavy-tail distribution, as previously presented, is not met by the curve labelled "Gamma-Exponential Tail".

The Probability Mass Function of a heavy-tailed distribution is given by:


p(x)= \alpha k^{\alpha} x^{- \alpha -1},\ \alpha ,k>0,\ x \ge k


and its Cumulative Distribution Function is given by:


F(x)=P \le \ x =1- ( rac{k}{x})^{\alpha}


where ''k'' represents the smallest value the Random Variable can take.

Readers interested in a more rigorous mathematical treatment of the subject are referred to the External Links Section .


MODELLING SELF-SIMILAR TRAFFIC


Since (unlike traditional telephony traffic) packetised traffic exhibits self-similar or fractal characteristics, conventional traffic models do not apply to networks which carry self-similar traffic. {Link without Title}

With the convergence of voice and data, the future multi-service network will be based on packetised traffic, and models which accurately reflect the nature of self-similar traffic will be required to develop, design and dimension future multi-service networks. {Link without Title}

Previous analytic work done in Internet studies adopted assumptions such as exponentially-distributed packet inter-arrivals, and conclusions reached under such assumptions may be misleading or incorrect in the presence of heavy-tailed distributions. {Link without Title}

Deriving mathematical models which accurately represent long-range dependent traffic is a fertile area of research.


NETWORK PERFORMANCE

Network performance degrades gradually with increasing self-similarity. The more self-similar the traffic, the longer the queue size. The queue length distribution of self-similar traffic decays more slowly than with Poisson sources.
However, long-range dependence implies nothing about its short-term correlations which affect performance in small buffers. Additionally, aggregating streams of self-similar traffic typically intensifies the self-similarity ("burstiness") rather than smoothing it, compounding the problem. {Link without Title}

Self-similar traffic exhibits the persistence of Clustering which has a negative impact on network performance.
  • With Poisson traffic (found in conventional Telephony networks), clustering occurs in the short term but smoothes out over the long term.

  • With self-similar traffic, the bursty behaviour may itself be bursty, which exacerbates the clustering phenomena, and degrades network performance. {Link without Title}


Many aspects of network quality of service depend on coping with traffic peaks that might cause network failures, such as
  • Cell/packet loss and queue overflow

  • Violation of delay bounds e.g. in video

  • Worst cases in statistical Multiplexing


Poisson processes are well-behaved because they are Stateless , and peak loading is not sustained, so queues do not fill. With long-range order, peaks last longer and have greater impact: the equilibrium shifts for a while. {Link without Title}

The following graph, taken from {Link without Title} presents a queuing performance comparison between processes of varying degrees of self-similarity. Note how the queue size increases with increasing self-similarity of the data, for any given channel utilisation, thus degrading network performance.

Reference to additional information on the effect of long-range dependency on network performance can be found in the External links section.


EXTERNAL LINKS




  • Glossarist.com , a dictionary defining technical statistical words and concepts.