Abstract
The paper describes the link between penalized spline smoothing and Linear Mixed Models and how these two models form a practical and theoretically interesting partnership. As offspring of this partnership one can not only estimate the smoothing parameter in a Maximum Likelihood framework but also utilize the Mixed Model technology to derive numerically handy solutions to more general questions and problems. Two particular examples are discussed in this paper. The first contribution demonstrates penalized splines and Linear Mixed Models in a classification context. Secondly, an even broader framework is pursued, mirroring the Bayesian paradigm combined with simple approximate numerical solutions for model selection.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Breslow, N. E. & Clayton, D. G. (1993). Approximate inference in generalized linear mixed model. Journal of the American Statistical Association 88: 9–25.
Claeskens, G., Krivobokova, T. & Opsomer, J. (2009). Asymptotic properties of penalized spline estimators. Biometrika, to appear.
Crainiceanu, M. & Ruppert, D. (2004). Likelihood ratio tests in linear mixed models with one variance component. Journal of the Royal Statistical Society B 66: 165–185.
Crainiceanu, C., Ruppert, D., Claeskens, G. & Wand, M.P. (2005). Likelihood ratio tests of polynomial regression against a general nonparametric alternative. Biometrika 92: 91–103.
de Boor, C. (1972). On calculating with B-splines. Journal of Approximation Theory 6: 50–62.
Eilers, P.H.C. & Marx, B.D. (1996). Flexible smoothing with B-splines and penalties. Statistical Science 11: 89–121.
Hall, P. & Opsomer, J. (2005). Theory for penalised spline regression. Biometrika 92: 105–118.
Hastie, T. & Tibshirani, R. (1990). Generalized Additive Models. London: Chapman & Hall.
Hastie, T., Tibshirani, R. & Friedman, J. (2001). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York.
Kauermann, G., Krivobokova, T. & Fahrmeir, L. (2009). Some asymptotic results on generalized penalized spline smoothing. Journal of the Royal Statistical Society, Series B 71: 487–503.
Kauermann, G. & Opsomer, J. (2009). Data-driven selection of the spline dimension in penalized spline regression. Technical Report.
Kauermann, G., Ormerod, J. & Wand, M. (2009). Parsimonious classification via generalized linear mixed models. Journal of Classification, to appear.
Krivobokova, T. & Kauermann, G. (2007). A note on penalized spline smoothing with correlated errors. Journal of the American Statistical Association 102: 1328–1337.
Li, Y. & Ruppert, D. (2008). On the asymptotics of penalized splines. Biometrika, to appear.
Ngo, L. & Wand, M. P. (2004). Smoothing with mixed model software. Journal of Statistical Software 9: 1–54.
O’Sullivan, F. (1986). A statistical perspective on ill-posed inverse problems (c/r: P519-527). Statistical Science 1: 502–518.
Rue, H., Martino, S. & Chopin, N. (2009). Approximate Bayesian inference for latent gaussian models by using integrated nested Laplace approximations. Journal of the Royal Statistical Society: Series B 71: 319–392.
Ruppert, D. (2002). Selecting the number of knots for penalized splines. Journal of Computational and Graphical Statistics 11: 735–757.
Ruppert, R., Wand, M. & Carroll, R. (2003). Semiparametric Regression. Cambridge: Cambridge University Press.
Ruppert, D., Wand, M. & Carroll, R. (2009). Semiparametric regression during 2003–2007. Technical Report.
Searle, S., Casella, G. & McCulloch, C. (1992). Variance Components. Wiley, New York.
Tutz, G. & Binder, H. (2006). Generalized additive modelling with implicit variable selection by likelihood based boosting. Biometrics 62: 961–971.
Vaida, F. & Blanchard, S. (2005). Conditional akaike information for mixed effects models. Biometrika 92: 351–370.
Wager, C., Vaida, F. & Kauermann, G. (2007). Model selection for P-spline smoothing using Akaike information criteria. Australian and New Zealand Journal of Statistics 49: 173–190.
Wand, M. (2003). Smoothing and mixed models. Computational Statistics 18: 223–249.
Wand, M. & Ormerod, J. (2008). On semiparametric regression with O’Sullivan penalized splines. Australian and New Zealand Journal of Statistics 50: 179–198.
Wood, S. (2006). Generalized Additive Models. London: Chapman & Hall.
Zellner, A. (1986). On assessing prior distributions and Bayesian regression analysis with g-prior distributions. In Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti, (eds. P. K. Goel & A. Zellner), pp. 233–243. North-Holland/Elsevier.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Kauermann, G. (2010). Penalized Splines, Mixed Models and Bayesian Ideas. In: Kneib, T., Tutz, G. (eds) Statistical Modelling and Regression Structures. Physica-Verlag HD. https://doi.org/10.1007/978-3-7908-2413-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-7908-2413-1_3
Published:
Publisher Name: Physica-Verlag HD
Print ISBN: 978-3-7908-2412-4
Online ISBN: 978-3-7908-2413-1
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)