Skip to main content
SpringerLink
Log in

LASSO-type estimators for semiparametric nonlinear mixed-effects models estimation

  • Published:
Statistics and Computing Aims and scope Submit manuscript

Abstract

Parametric nonlinear mixed effects models (NLMEs) are now widely used in biometrical studies, especially in pharmacokinetics research and HIV dynamics models, due to, among other aspects, the computational advances achieved during the last years. However, this kind of models may not be flexible enough for complex longitudinal data analysis. Semiparametric NLMEs (SNMMs) have been proposed as an extension of NLMEs. These models are a good compromise and retain nice features of both parametric and nonparametric models resulting in more flexible models than standard parametric NLMEs. However, SNMMs are complex models for which estimation still remains a challenge. Previous estimation procedures are based on a combination of log-likelihood approximation methods for parametric estimation and smoothing splines techniques for nonparametric estimation. In this work, we propose new estimation strategies in SNMMs. On the one hand, we use the Stochastic Approximation version of EM algorithm (SAEM) to obtain exact ML and REML estimates of the fixed effects and variance components. On the other hand, we propose a LASSO-type method to estimate the unknown nonlinear function. We derive oracle inequalities for this nonparametric estimator. We combine the two approaches in a general estimation procedure that we illustrate with simulations and through the analysis of a real data set of price evolution in on-line auctions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Bertin, K., Le Pennec, E., Rivoirard, V.: Adaptive Dantzig density estimation. Ann. Inst. Henri Poincaré 47, 43–74 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  • Bickel, P.J., Ritov, Y., Tsybakov, A.B.: Simultaneous analysis of lasso and Dantzig selector. Ann. Stat. 37(4), 1705–1732 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  • Bühlmann, P., van de Geer, S.: Statistics for High-Dimensional Data. Springer Series in Statistics. Springer, Heidelberg (2011)

    Book  MATH  Google Scholar 

  • Bunea, F.: Consistent selection via the Lasso for high dimensional approximating regression models. In: Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh. Inst. Math. Stat. Collect., vol. 3, pp. 122–137. Inst. Math. Statist., Beachwood (2008)

    Chapter  Google Scholar 

  • Bunea, F., Tsybakov, A.B., Wegkamp, M.H.: Aggregation and sparsity via l 1 penalized least squares. In: Learning Theory. Lecture Notes in Comput. Sci., vol. 4005, pp. 379–391. Springer, Berlin (2006)

    Chapter  Google Scholar 

  • Bunea, F., Tsybakov, A., Wegkamp, M.: Sparsity oracle inequalities for the Lasso. Electron. J. Stat. 1, 169–194 (2007a)

    Article  MATH  MathSciNet  Google Scholar 

  • Bunea, F., Tsybakov, A.B., Wegkamp, M.H.: Aggregation for Gaussian regression. Ann. Stat. 35(4), 1674–1697 (2007b)

    Article  MATH  MathSciNet  Google Scholar 

  • Comte, F., Samson, A.: Nonparametric estimation of random effects densities in linear mixed-effects model. J. Nonparametr. Stat. 24, 951–975 (2012)

    Article  MATH  MathSciNet  Google Scholar 

  • Delyon, B., Lavielle, M., Moulines, E.: Convergence of a stochastic approximation version of the EM algorithm. Ann. Stat. 27, 94–128 (1999)

    Article  MATH  MathSciNet  Google Scholar 

  • Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum-likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. B 39, 1–38 (1977)

    MATH  MathSciNet  Google Scholar 

  • Ding, A.A., Wu, H.: Assessing antiviral potency of anti-HIV therapies in vivo by comparing viral decay rates in viral dynamic models. Biostatistics 2, 13–29 (2001)

    Article  MATH  Google Scholar 

  • Foulley, J.L., Quaas, R.: Heterogeneous variances in Gaussian linear mixed models. Genet. Sel. Evol. 27, 211–228 (1995)

    Article  Google Scholar 

  • Ge, Z., Bickel, P., Rice, J.: An approximate likelihood approach to nonlinear mixed effects models via spline approximation. Comput. Stat. Data Anal. 46, 747–776 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • van de Geer, S.: ℓ 1-regularization in high-dimensional statistical models. In: Proceedings of the International Congress of Mathematicians, vol. IV, pp. 2351–2369. Hindustan Book Agency, New Delhi (2010)

    Google Scholar 

  • Hartford, A., Davidian, M.: Consequences of misspecifying assumptions in nonlinear mixed effects models. Comput. Stat. Data Anal. 34, 139–164 (2000)

    Article  MATH  Google Scholar 

  • Harville, D.: Bayesian inference for variance components using only error contrasts. Biometrika 61, 383–385 (1974)

    Article  MATH  MathSciNet  Google Scholar 

  • Jank, W.: Implementing and diagnosing the stochastic approximation EM algorithm. J. Comput. Graph. Stat. 15(4), 803–829 (2006)

    Article  MathSciNet  Google Scholar 

  • Jank, W., Shmueli, G.: Functional data analysis in electronic commerce research. Stat. Sci. 21, 155–166 (2006)

    Article  MATH  MathSciNet  Google Scholar 

  • Ke, C., Wang, Y.: Semiparametric nonlinear mixed-effects models and their applications (with discussion). J. Am. Stat. Assoc. 96(456), 1272–1298 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  • Kuhn, E., Lavielle, M.: Coupling a stochastic approximation version of EM with an MCMC procedure. ESAIM Probab. Stat. 8, 115–131 (2004)

    Article  MATH  MathSciNet  Google Scholar 

  • Kuhn, E., Lavielle, M.: Maximum likelihood estimation in nonlinear mixed effects models. Comput. Stat. Data Anal. 49(4), 1020–1038 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  • Liu, B., Müller, H.G.: Functional data analysis for sparse auction data. In: Jank, W., Shmueli, G. (eds.) Statistical Methods in E-commerce Research, pp. 269–290. Wiley, New York (2008)

    Chapter  Google Scholar 

  • Liu, W., Wu, L.: Simultaneous inference for semiparametric nonlinear mixed-effects models with covariate measurement errors and missing responses. Biometrics 63, 342–350 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  • Liu, W., Wu, L.: A semiparametric nonlinear mixed-effects model with non-ignorable missing data and measurement errors for HIV viral data. Comput. Stat. Data Anal. 53, 112–122 (2008)

    Article  MATH  Google Scholar 

  • Liu, W., Wu, L.: Some asymptotic results for semiparametric nonlinear mixed-effects models with incomplete data. J. Stat. Plan. Inference (2009). doi:10.1016j.jspi.2009.06.006

    Google Scholar 

  • Luan, Y., Li, H.: Model-based methods for identifying periodically expressed genes based on time course microarray gene expression data. Bioinformatics 20(3), 332–339 (2004)

    Article  Google Scholar 

  • Meza, C., Jaffrézic, F., Foulley, J.L.: Estimation in the probit normal model for binary outcomes using the SAEM algorithm. Biom. J. 49(6), 876–888 (2007)

    Article  MathSciNet  Google Scholar 

  • Meza, C., Jaffrézic, F., Foulley, J.L.: Reml estimation of variance parameters in nonlinear mixed effects models using the SAEM algorithm. Comput. Stat. Data Anal. 53(4), 1350–1360 (2009)

    Article  MATH  Google Scholar 

  • Patterson, H.D., Thompson, R.: Recovery of inter-block information when block sizes are unequal. Biometrika 58, 545–554 (1971)

    Article  MATH  MathSciNet  Google Scholar 

  • Pinheiro, J., Bates, D.: Mixed-Effects Models in S and S-PLUS. Springer, New York (2000)

    Book  MATH  Google Scholar 

  • Ramos, R., Pantula, S.: Estimation of nonlinear random coefficient models. Stat. Probab. Lett. 24, 49–56 (1995)

    Article  MATH  MathSciNet  Google Scholar 

  • Reithinger, F., Jank, W., Tutz, G., Shmueli, G.: Modelling price paths in on-line auctions: smoothing sparse and unevenly sampled curves by using semiparametric mixed models. Appl. Stat. 57, 127–148 (2008)

    MATH  MathSciNet  Google Scholar 

  • Schelldorfer, J., Bühlmann, P., van de Geer, S.: Estimation for high-dimensional linear mixed-effects models using l1-penalization. Scand. J. Stat. 38, 197–214 (2011)

    Article  MATH  MathSciNet  Google Scholar 

  • Shmueli, G., Jank, W.: Visualizing online auctions. J. Comput. Graph. Stat. 14, 299–319 (2005)

    Article  MathSciNet  Google Scholar 

  • Shmueli, G., Russo, R.P., Jank, W.: The BARISTA: a model for bid arrivals in online auctions. Ann. Appl. Stat. 1, 412–441 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  • Sklar, J.C., Wu, J., Meiring, W., Wang, Y.: Non-parametric regression with basis selection from multiple libraries. Technometrics (2012, accepted)

  • Tibshirani, R.: Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. B 58, 267–288 (1996)

    MATH  MathSciNet  Google Scholar 

  • Vonesh, E.F.: A note on the use of Laplace’s approximation for nonlinear mixed-effects models. Biometrika 83, 447–452 (1996)

    Article  MATH  MathSciNet  Google Scholar 

  • Wang, Y., Brown, M.B.: A flexible model for human circadian rhythms. Biometrics 52, 588–596 (1996)

    Article  MATH  Google Scholar 

  • Wang, Y., Ke, C.: Assist: A suite of s functions implementing spline smoothing techniques (2004). http://wwwpstatucsbedu/faculty/yuedong/assistpdf

  • Wang, Y., Ke, C., Brown, M.B.: Shape-invariant modeling of circadian rhythms with random effects and smoothing spline ANOVA decompositions. Biometrics 59, 804–812 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  • Wang, Y., Eskridge, K., Zhang, S.: Semiparametric mixed-effects analysis of PKPD models using differential equations. J. Pharmacokinet. Pharmacodyn. 35, 443–463 (2008)

    Article  Google Scholar 

  • Wei, G.C., Tanner, M.A.: A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithm. J. Am. Stat. Assoc. 85, 699–704 (1990)

    Article  Google Scholar 

  • Wu, H., Zhang, J.: The study of longterm HIV dynamics using semi-parametric non-linear mixed-effects models. Stat. Med. 21, 3655–3675 (2002)

    Article  Google Scholar 

  • Yuan, M., Lin, Y.: Model selection and estimation in regression with grouped variables. J. R. Stat. Soc. B 68(1), 49–67 (2006)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the anonymous Associate Editor and two referees for valuable comments and suggestions.

The research of Ana Arribas-Gil is supported by projects MTM2010-17323 and ECO2011-25706, Spain.

The research of Karine Bertin is supported by projects FONDECYT 1090285 and ECOS/CONICYT C10E03 2010, Chile.

The research of Cristian Meza is supported by project FONDECYT 11090024, Chile.

The research of Vincent Rivoirard is partly supported by the french Agence Nationale de la Recherche (ANR 2011 BS01 010 01 projet Calibration).

Author information

Authors and Affiliations

  1. Departamento de Estadística, Universidad Carlos III de Madrid, Calle Madrid 126, 28903, Getafe, Spain

    Ana Arribas-Gil

  2. CIMFAV-Facultad de Ingeniería, Universidad de Valparaíso, Valparaíso, Chile

    Karine Bertin & Cristian Meza

Authors
  1. Ana Arribas-Gil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Karine Bertin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Cristian Meza
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vincent Rivoirard
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ana Arribas-Gil.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

(PDF 130 kB)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arribas-Gil, A., Bertin, K., Meza, C. et al. LASSO-type estimators for semiparametric nonlinear mixed-effects models estimation. Stat Comput 24, 443–460 (2014). https://doi.org/10.1007/s11222-013-9380-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11222-013-9380-x

Keywords

Search

Navigation