Abstract
In statistics of extremes, inference is often based on the excesses over a high random threshold. Those excesses are approximately distributed as the set of order statistics associated to a sample from a generalized Pareto model. We then get the so-called “maximum likelihood” estimators of the tail index γ. In this paper, we are interested in the derivation of the asymptotic distributional properties of a similar “maximum likelihood” estimator of a positive tail index γ, based also on the excesses over a high random threshold, but with a trial of accommodation of bias in the Pareto model underlying those excesses. We next proceed to an asymptotic comparison of the two estimators at their optimal levels. An illustration of the finite sample behaviour of the estimators is provided through a small-scale Monte Carlo simulation study.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Araújo Santos, P., Fraga Alves, M.I., Gomes, M.I.: Peaks over random threshold methodology for tail index and quantile estimation. Rev. Stat. 4(3), 227–247 (2006)
Bingham, N.H., Goldie, C.M., Teugels, J.L.: Regular Variation. Cambridge Univ. Press, Cambridge (1987)
Caeiro, F., Gomes, M.I.: A new class of estimators of the “scale” second order parameter. Extremes 9, 193–211, 2007 (2006)
Caeiro, F., Gomes, M.I., Pestana, D.: Direct reduction of bias of the classical Hill estimator. Rev. Stat. 3(2), 111–136 (2005)
Davison, A.: Modeling excesses over high threshold with an application. In: Tiago de Oliveira, J. (ed.) Statistical Extremes and Applications, pp. 461–482. D. Reidel, Dordrecht (1984)
Dekkers, A., de Haan, L.: Optimal sample fraction in extreme value estimation. J. Multivar. Anal. 47(2), 173–195 (1993)
de Haan, L.: On Regular Variation and its Application to the Weak Convergence of Sample Extremes. Mathematical Centre Tract 32, Amsterdam (1970)
de Haan, L., Peng, L.: Comparison of tail index estimators. Stat. Neerl. 52, 60–70 (1998)
Drees, H., Ferreira, A., de Haan, L.: On maximum likelihood estimation of the extreme value index. Ann. Appl. Probab. 14, 1179–1201 (2004)
Fishman G.S.: Concepts and Methods in Discrete Event Digital Simulation. Wiley, New York (1972)
Fraga Alves, M.I., Gomes, M.I., de Haan, L.: A new class of semi-parametric estimators of the second order parameter. Port. Math. 60(2), 193–213 (2003)
Geluk, J., de Haan L.: Regular Variation, Extensions and Tauberian Theorems. CWI Tract 40, Center for Mathematics and Computer Science, Amsterdam (1987)
Gnedenko, B.V.: Sur la distribution limite du terme maximum d’une série aléatoire. Ann. Math. 44, 423–453 (1943)
Gomes, M.I., Martins, M.J.: Alternatives to Hill’s estimator—asymptotic versus finite sample behaviour. J. Stat. Plan. Inference 93, 161–180 (2001)
Gomes, M.I., Martins, M.J.: “Asymptotically unbiased” estimators of the tail index based on external estimation of the second order parameter. Extremes 5(1), 5–31 (2002)
Gomes, M.I., Neves, C.: Asymptotic comparison of the mixed moment and classical extreme value index estimators. Stat. Probab. Lett. (2007). doi:10.1016/j,spl.2007.07.026
Gomes, M.I., Oliveira, O.: The bootstrap methodology in statistical extremes—the choice of the optimal sample fraction. Extremes 4(4), 331–358 (2001)
Gomes, M.I., Pestana, D.: A simple second order reduced-bias’ tail index estimator. J. Stat. Comput. Simul. 77(6), 487–504 (2007a)
Gomes, M.I., Pestana, D.: A sturdy second order reduced bias’ value at risk estimator. J. Am. Stat. Assoc. 102(477), 280–292 (2007b)
Gomes, M.I., de Haan, L., Peng, L.: Semi-parametric estimation of the second order parameter—asymptotic and finite sample behaviour. Extremes 5(4), 387–414 (2002)
Gomes, M.I., Miranda, C., Pereira, H.: Revisiting the role of the Jackknife methodology in the estimation of a positive extreme value index. Commun. Stat. Theory Methods 34, 1–20 (2005)
Gomes, M.I., Martins, M.J., Neves, M.: Improving second order reduced bias extreme value index estimation. Revstat 5(2), 177–207 (2007a)
Gomes, M.I., Miranda, C., Viseu, C.: Reduced bias extreme value index estimation and the Jackknife methodology. Stat. Neerl. 61(2), 243–270 (2007b)
Gomes, M.I., de Haan, L., Henriques Rodrigues, L.: Tail index estimation for heavy-tailed models: accommodation of bias in weighted log-excesses. J. R. Stat. Soc. B 70(1), 31–52 (2008a). doi:10.1007/s10687-007-0048-9, 2007
Gomes, M.I., Henriques Rodrigues, L., Vandewalle, B., Viseu, C.: A heuristic adaptive choise of the threshold for bias-corrected hill estimators. J. Stat. Comput. Simul. (2008b). doi:10.1080/10629360600954000
Grimshaw, S.D.: Computing maximum likelihood estimates for the generalized pareto distribution. Technometrics 35(2), 185–191 (1993)
Hall, P., Welsh, A.H.: Adaptive estimates of parameters of regular variation. Ann. Stat. 13, 331–341 (1985)
Hill, B.M.: A simple general approach to inference about the tail of a distribution. Ann. Stat. 3, 1163–1174 (1975)
Rényi, A.: On the theory of order statistics. Acta Math. Sci. Hungar. Tomus IV, 191–227 (1953)
Smith, R.L.: Estimating tails of probability distributions. Ann. Stat. 15(3), 1174–1207 (1987)
Author information
Authors and Affiliations
Corresponding author
Additional information
Research partially supported by FCT/POCTI and POCI/FEDER.
Rights and permissions
About this article
Cite this article
Gomes, M.I., Rodrigues, L.H. Tail index estimation for heavy tails: accommodation of bias in the excesses over a high threshold. Extremes 11, 303–328 (2008). https://doi.org/10.1007/s10687-008-0059-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10687-008-0059-1
Keywords
- Statistics of extremes
- Semi-parametric estimation
- Generalized Pareto models
- Maximum likelihood estimation