, Volume 10, Issue 1–2, pp 1–19 | Cite as

Vector generalized linear and additive extreme value models



Over recent years parametric and nonparametric regression has slowly been adopted into extreme value data analysis. Its introduction has been characterized by piecemeal additions and embellishments, which has had a negative effect on software development and usage. The purpose of this article is to convey the classes of vector generalized linear and additive models (VGLMs and VGAMs) as offering significant advantages for extreme value data analysis, providing flexible smoothing within a unifying framework. In particular, VGLMs and VGAMs allow all parameters of extreme value distributions to be modelled as linear or smooth functions of covariates. We implement new auxiliary methodology by incorporating a quasi-Newton update for the working weight matrices within an iteratively reweighted least squares (IRLS) algorithm. A software implementation by the first author, called the vgam package for Open image in new window, is used to illustrate the potential of VGLMs and VGAMs.


Fisher scoring Iteratively reweighted least squares Maximum likelihood estimation Penalized likelihood Smoothing Extreme value modelling Vector splines 

AMS 2000 Subject Classification



Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Beirlant, J., Goegebeur, Y., Segers, J., Teugels, J.: Statistics of Extremes. Wiley, Chichester, England (2004)MATHGoogle Scholar
  2. Broyden, C.G.: The convergence of a class of double-rank minimization algorithms. J. Inst. Math. Appl. 6, 76–90 (1970)MATHCrossRefMathSciNetGoogle Scholar
  3. Buja, A., Hastie, T., Tibshirani, R.: Linear smoothers and additive models (with discussion). Ann. Stat. 17, 453–510 (1989)MATHMathSciNetGoogle Scholar
  4. Chambers, J.M.: Programming with Data: A Guide to the S Language. Springer, New York (1998)MATHGoogle Scholar
  5. Chambers, J.M., Hastie, T.J. (eds.) Statistical Models in S. Chapman & Hall, New York (1993)Google Scholar
  6. Chavez-Demoulin, V., Davison, A.C.: Generalized additive modelling of sample extremes. Appl. Stat. 54, 207–222 (2005)MATHMathSciNetGoogle Scholar
  7. Coles, S.: An Introduction to Statistical Modeling of Extreme Values. Springer-Verlag, London (2001)MATHGoogle Scholar
  8. de Boor, C.: A Practical Guide to Splines. Springer, Berlin (1978)MATHGoogle Scholar
  9. Efron, B., Hinkley, D.V.: Assessing the accuracy of the maximum likelihood estimator: observed versus expected Fisher information. Biometrika 65, 457–481 (1978)MATHCrossRefMathSciNetGoogle Scholar
  10. Ferro, C.A.T., Segers, J.: Inference for clusters of extreme values. J. R. Stat. Soc., B 65, 545–556 (2003)MATHCrossRefMathSciNetGoogle Scholar
  11. Fessler, J.A.: Nonparametric fixed-interval smoothing with vector splines. IEEE Trans. Acoust. Speech Signal Process. 39, 852–859 (1991)Google Scholar
  12. Green, P.J., Silverman, B.W.: Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach. Chapman & Hall, London (1994)MATHGoogle Scholar
  13. Hastie, T., Tibshirani, R.: Generalized additive models: some applications. J. Am. Stat. Assoc. 82, 371–386 (1987)MATHCrossRefMathSciNetGoogle Scholar
  14. Hastie, T.J., Tibshirani, R.J.: Generalized Additive Models. Chapman & Hall, London (1990)MATHGoogle Scholar
  15. Hosking, J.R.M., Wallis, J.R.: Parameter and quantile estimation for the generalized Pareto distribution. Technometrics 29, 339–349 (1987)MATHCrossRefMathSciNetGoogle Scholar
  16. Hosking, J.R.M., Wallis, J.R.: Regional Frequency Analysis. Cambridge University Press, Cambridge, UK (1997)Google Scholar
  17. Hosking, J.R.M., Wallis, J.R., Wood, E.F.: Estimation of the generalized extreme-value distribution by the method of probability-weighted moments. Technometrics 27, 251–261 (1985)CrossRefMathSciNetGoogle Scholar
  18. Ihaka, R., Gentleman, R.: R: A language for data analysis and graphics. J. Comput. Graph. Stat. 5, 299–314 (1996)CrossRefGoogle Scholar
  19. Leadbetter, M.R., Lindgren, G., Rootzén, H.: Extremes and Related Properties of Random Sequences and Series. Springer-Verlag, New York (1983)Google Scholar
  20. Ledford, A.W., Tawn, J.A.: Statistics for near independence in multivariate extreme values. Biometrika 83, 169–187 (1996)MATHCrossRefMathSciNetGoogle Scholar
  21. Nelder, J.A., Wedderburn, R.W.M.: Generalized linear models. J. R. Stat. Soc., A, 135, 370–384 (1972)CrossRefGoogle Scholar
  22. Oakes, D., Manatunga, A.K.: Fisher information for a bivariate extreme value distribution. Biometrika 79, 827–832 (1992)MATHCrossRefMathSciNetGoogle Scholar
  23. Pauli, F., Coles, S.: Penalized likelihood inference in extreme value analyses. J. Appl. Stat. 28, 547–560 (2001)MATHCrossRefMathSciNetGoogle Scholar
  24. Pickands, J.: Statistical inference using extreme order statistics. Ann. Stat. 3, 119–131 (1975)MATHMathSciNetGoogle Scholar
  25. Prescott, P., Walden, A.T.: Maximum likelihood estimation of the parameters of the generalized extreme-value distribution. Biometrika 67, 723–724 (1980)CrossRefMathSciNetGoogle Scholar
  26. Reinsch, C.: Smoothing by spline functions. Numer. Math. 10, 177–183 (1967)MATHCrossRefMathSciNetGoogle Scholar
  27. Rose, C., Smith, M.D.: Mathematical Statistics with Mathematica. Springer, New York (2002)MATHGoogle Scholar
  28. Rosen, O., Cohen, A.: Extreme percentile regression. In: Härdle, W., Schimek, M.G. (eds.) Statistical Theory and Computational Aspects of Smoothing: Proceedings of the COMPSTAT ’94 Satellite Meeting held in Semmering, Austria, August 1994, pp. 27–28. Physica-Verlag, Heidelberg (1996)Google Scholar
  29. Schimek, M.G. (ed.): Smoothing and Regression: Approaches, Computation, and Application. Wiley, New York (2000)MATHGoogle Scholar
  30. Shi, D.: Fisher information for a multivariate extreme value distribution. Biometrika 82, 644–649 (1995)MATHCrossRefMathSciNetGoogle Scholar
  31. Smith, E.L., Walshaw, D.: Modelling bivariate extremes in a region. In: Bernardo, J.M., Bayarri, M.J., Berger, J.O., Dawid, A.P., Heckerman, D., Smith, A.F.M., West, M. (eds.) Bayesian Statistics 7. Oxford University Press, Oxford, UK (2003)Google Scholar
  32. Smith, R.L.: Maximum likelihood estimation in a class of nonregular cases. Biometrika 72, 67–90 (1985)MATHCrossRefMathSciNetGoogle Scholar
  33. Smith, R.L.: Extreme value theory based on the r largest annual events. J. Hydrol. 86, 27–43 (1986)CrossRefGoogle Scholar
  34. Stephenson, A.G.: evd: Extreme value distributions. R News 2(2), 31–32 (2002)Google Scholar
  35. Stephenson, A.G., Gilleland, E.: Software for the analysis of extreme events: the current state and future directions. Extremes 8, 87–109 (2006)CrossRefMathSciNetGoogle Scholar
  36. Tawn, J.A.: Bivariate extreme value theory: models and estimation. Biometrika 75, 397–415 (1988)MATHCrossRefMathSciNetGoogle Scholar
  37. Weissman, I.: Estimation of parameters and large quantiles based on the k largest observations. J. Am. Stat. Assoc. 73, 812–815 (1978)MATHCrossRefMathSciNetGoogle Scholar
  38. Yee, T.W.: The Analysis of Binary Data in Quantitative Plant Ecology. Ph.D. thesis, University of Auckland, Department of Mathematics & Statistics, University of Auckland, New Zealand (1993)Google Scholar
  39. Yee, T.W.: Vector splines and other vector smoothers. In: Bethlehem, J.G., van der Heijden, P.G.M. (eds.) Proceedings in Computational Statistics COMPSTAT 2000. Physica-Verlag, Heidelberg (2000)Google Scholar
  40. Yee, T.W.: A User’s Guide to the vgam Package, http://www.stat.auckland.ac.nz/~yee/VGAM (2007)
  41. Yee, T.W., Hastie, T.J.: Reduced-rank vector generalized linear models. Stat. Modelling 3, 15–41 (2003)MATHCrossRefMathSciNetGoogle Scholar
  42. Yee, T.W., Wild, C.J.: Vector generalized additive models. J. R. Stat. Soc., B 58, 481–493 (1996)MATHMathSciNetGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Department of StatisticsUniversity of AucklandAucklandNew Zealand
  2. 2.Department of Statistics & Applied ProbabilityNational University of SingaporeSingaporeSingapore

Personalised recommendations