World Library  
Flag as Inappropriate
Email this Article

Heavy-tailed distribution

Article Id: WHEBN0008092200
Reproduction Date:

Title: Heavy-tailed distribution  
Author: World Heritage Encyclopedia
Language: English
Subject: Fat-tailed distribution, Kurtosis, Probability distribution, Optical IP Switching, Self-similar process
Collection: Actuarial Science, Risk, Tails of Probability Distributions, Types of Probability Distributions
Publisher: World Heritage Encyclopedia

Heavy-tailed distribution

In probability theory, heavy-tailed distributions are probability distributions whose tails are not exponentially bounded:[1] that is, they have heavier tails than the exponential distribution. In many applications it is the right tail of the distribution that is of interest, but a distribution may have a heavy left tail, or both tails may be heavy.

There are three important subclasses of heavy-tailed distributions, the fat-tailed distributions, the long-tailed distributions and the subexponential distributions. In practice, all commonly used heavy-tailed distributions belong to the subexponential class.

There is still some discrepancy over the use of the term heavy-tailed. There are two other definitions in use. Some authors use the term to refer to those distributions which do not have all their power moments finite; and some others to those distributions that do not have a finite variance. The definition given in this article is the most general in use, and includes all distributions encompassed by the alternative definitions, as well as those distributions such as log-normal that possess all their power moments, yet which are generally acknowledged to be heavy-tailed. (Occasionally, heavy-tailed is used for any distribution that has heavier tails than the normal distribution.)


  • Definitions 1
    • Definition of heavy-tailed distribution 1.1
    • Definition of long-tailed distribution 1.2
    • Subexponential distributions 1.3
  • Common heavy-tailed distributions 2
  • Relationship to fat-tailed distributions 3
  • Estimating the tail-index 4
    • Pickands tail-index 4.1
    • Hill tail-index 4.2
    • Software 4.3
  • See also 5
  • References 6


Definition of heavy-tailed distribution

The distribution of a random variable X with distribution function F is said to have a heavy right tail if[1]

\lim_{x \to \infty} e^{\lambda x}\Pr[X>x] = \infty \quad \mbox{for all } \lambda>0.\,

This is also written in terms of the tail distribution function

\overline{F}(x) \equiv \Pr[X>x] \,


\lim_{x \to \infty} e^{\lambda x}\overline{F}(x) = \infty \quad \mbox{for all } \lambda>0.\,

This is equivalent to the statement that the moment generating function of F, MF(t), is infinite for all t > 0.[2]

The definitions of heavy-tailed for left-tailed or two tailed distributions are similar.

Definition of long-tailed distribution

The distribution of a random variable X with distribution function F is said to have a long right tail[1] if for all t > 0,

\lim_{x \to \infty} \Pr[X>x+t|X>x] =1, \,

or equivalently

\overline{F}(x+t) \sim \overline{F}(x) \quad \mbox{as } x \to \infty. \,

This has the intuitive interpretation for a right-tailed long-tailed distributed quantity that if the long-tailed quantity exceeds some high level, the probability approaches 1 that it will exceed any other higher level: if you know the situation is good, it is probably better than you think.

All long-tailed distributions are heavy-tailed, but the converse is false, and it is possible to construct heavy-tailed distributions that are not long-tailed.

Subexponential distributions

Subexponentiality is defined in terms of convolutions of probability distributions. For two independent, identically distributed random variables X_1,X_2 with common distribution function F the convolution of F with itself, F^{*2} is defined, using Lebesgue–Stieltjes integration, by:

\Pr[X_1+X_2 \leq x] = F^{*2}(x) = \int_{- \infty}^\infty F(x-y)\,dF(y).

The n-fold convolution F^{*n} is defined in the same way. The tail distribution function \overline{F} is defined as \overline{F}(x) = 1-F(x).

A distribution F on the positive half-line is subexponential [1][3][4] if

\overline{F^{*2}}(x) \sim 2\overline{F}(x) \quad \mbox{as } x \to \infty.

This implies[5] that, for any n \geq 1,

\overline{F^{*n}}(x) \sim n\overline{F}(x) \quad \mbox{as } x \to \infty.

The probabilistic interpretation[5] of this is that, for a sum of n independent random variables X_1,\ldots,X_n with common distribution F,

\Pr[X_1+ \cdots +X_n>x] \sim \Pr[\max(X_1, \ldots,X_n)>x] \quad \text{as } x \to \infty.

This is often known as the principle of the single big jump[6] or catastrophe principle.[7]

A distribution F on the whole real line is subexponential if the distribution F I([0,\infty)) is.[8] Here I([0,\infty)) is the indicator function of the positive half-line. Alternatively, a random variable X supported on the real line is subexponential if and only if X^+ = \max(0,X) is subexponential.

All subexponential distributions are long-tailed, but examples can be constructed of long-tailed distributions that are not subexponential.

Common heavy-tailed distributions

All commonly used heavy-tailed distributions are subexponential.[5]

Those that are one-tailed include:

Those that are two-tailed include:

Relationship to fat-tailed distributions

A fat-tailed distribution is a distribution for which the probability density function, for large x, goes to zero as a power x^{-a}. Since such a power is always bounded below by the probability density function of an exponential distribution, fat-tailed distributions are always heavy-tailed. Some distributions however have a tail which goes to zero slower than an exponential function (meaning they are heavy-tailed), but faster than a power (meaning they are not fat-tailed). An example is the log-normal distribution. Many other heavy-tailed distributions such as the log-logistic and Pareto distribution are however also fat-tailed.

Estimating the tail-index

To estimate the tail-index, some authors use the GEV distribution or Pareto distribution parameters on data using the maximum-likelihood estimation (MLE).

Pickands tail-index

With (X_n , n \geq 1) a random sequence of independent and same density function F \in D(H(\xi)), the Maximum Attraction Domain[13] of the generalized extreme value density H , where \xi \in \mathbb{R}. If \lim_{n\to\infty} k(n) = \infty and \lim_{n\to\infty} \frac{k(n)}{n}= 0, then the Pickands tail-index estimation is :[5][13]

\xi^{Pickands}_{(k(n),n)} =\frac{1}{\ln 2} \ln \left( \frac{X_{(n-k(n)+1,n)} - X_{(n-2k(n)+1,n)}}{X_{(n-2k(n)+1,n)} - X_{(n-4k(n)+1,n)}}\right)

where X_{(n-k(n)+1,n)}=\max \left(X_{n-k(n)+1},\ldots ,X_{n}\right). This estimator converge in probability to \xi.

Hill tail-index

With (X_n , n \geq 1) a random sequence of independent and same density function F \in D(H(\xi)), the Maximum Attraction Domain of the generalized extreme value density H , where \xi \in \mathbb{R}. If \lim_{n\to\infty} k(n) = \infty and \lim_{n\to\infty} \frac{k(n)}{n}= 0, then the Hill tail-index estimation is :[5]

\xi^{Hill}_{(k(n),n)} = \frac{1}{k(n)} \sum_{i=n-k(n)+1}^{n} \ln(X_{(i,n)}) - \ln (X_{(n-k(n)+1,n)})

where X_{(n-k(n)+1,n)}=\min \left(X_{n-k(n)+1},\ldots ,X_{n}\right). This estimator converge in probability to \xi.


  • aest, C tool for estimating the heavy tail index[14]

See also


  1. ^ a b c d Asmussen, S. R. (2003). "Applied Probability and Queues". Stochastic Modelling and Applied Probability 51. pp. 266–301.  
  2. ^ Rolski, Schmidli, Scmidt, Teugels, Stochastic Processes for Insurance and Finance, 1999
  3. ^ V. P. Chistyakov, A Theorem on Sums of Independent Positive Random Variables and Its Applications to Branching Random Processes, Theory of Probability and Its Applications 1964
  4. ^ J.L. Teugels, The Class of Subexponential Distributions, Annals of Probability 1975
  5. ^ a b c d e Embrechts, P.; Klüppelberg, C.; Mikosch, T. (1997). "Modelling Extremal Events". Stochastic Modelling and Applied Probability 33.  
  6. ^ Foss, S.; Konstantopoulos, T.; Zachary, S. (2007). "Discrete and Continuous Time Modulated Random Walks with Heavy-Tailed Increments". Journal of Theoretical Probability 20 (3): 581.  
  7. ^  
  8. ^ Willekens, E. (1986). "Subexponentiality on the real line". Technical Report (K.U. Leuven). 
  9. ^ Falk, M., Hüsler, J. & Reiss, R. (2010). Laws of Small Numbers: Extremes and Rare Events. Springer. p. 80.  
  10. ^ Alves, M.I.F., de Haan, L. & Neves, C. (March 10, 2006). "Statistical inference for heavy and super-heavy tailed distributions". 
  11. ^ John P. Nolan (2009). "Stable Distributions: Models for Heavy Tailed Data" (PDF). Retrieved 2009-02-21. 
  12. ^ Stephen Lihn (2009). "Skew Lognormal Cascade Distribution". 
  13. ^ a b Pickands III, James (Jan 1975). "Statistical Inference Using Extreme Order Statistics". The Annals of Statistics 3 (1): 119–131.  
  14. ^ Crovella, M. E.; Taqqu, M. S. (1999). "Estimating the Heavy Tail Index from Scaling Properties". Methodology and Computing in Applied Probability 1: 55.  
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.

Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.