Journal of Statistical Theory and Practice

, Volume 1, Issue 3–4, pp 311–328 | Cite as

Design for Hyperparameter Estimation in Linear Models

  • Qing LiuEmail author
  • Angela M. Dean
  • Greg M. Allenby


Optimal design for the joint estimation of the mean and covariance matrix of the random effects in hierarchical linear models is discussed. A criterion is derived under a Bayesian formulation which requires the integration over the prior distribution of the covariance matrix of the random effects. A theoretical optimal design structure is obtained for the situation where the random effects have equal variances and zero covariances. For other situations, optimal designs are obtained through computer search. It is shown that orthogonal designs, if they exist, are optimal under a main effects model with independent random effects. When the random effects are believed to be correlated, it is shown by example that nonorthogonal designs tend to be more efficient than orthogonal designs. In addition, design robustness is studied under various prior mean specifications of the random effects covariance matrix.

AMS 2000 subject classification

62K05 and 62K15 


Bayesian Design Optimal Design Hierarchical Linear Model Hyperparameter Random Effects Model 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Allenby, G. M. and Lenk, P. J., 1994. Modeling household purchase behavior with logistic normal regression, Journal of American Statistical Association 89, 1218–1229.CrossRefGoogle Scholar
  2. Arora, N. and Huber, J., 2001. Improving parameter estimates and model prediction by aggregate customization in choice experiments, Journal of Consumer Research 28, 273–283.CrossRefGoogle Scholar
  3. Berger, J. O., 1985. Statistical Decision Theory and Bayesian Analysis, Springer Verlag, New York.CrossRefGoogle Scholar
  4. Bradlow, E. T. and Rao, V. R., 2000. A hierarchical Bayes model for assortment choice, Journal of Marketing Research 37, 259–268.CrossRefGoogle Scholar
  5. Chaloner, K. and Verdinelli, I., 1995. Bayesian experimental design, A review, Statistical Science 10, 273–304.MathSciNetCrossRefGoogle Scholar
  6. Draper, D., 1995. Inference and hierarchical modeling in the social sciences, Journal of Educational and Behavioral Statistics 20, 115–147.CrossRefGoogle Scholar
  7. Entholzner, M., Benda, N., Schmelter, T. and Schwabe, R., 2005. A note on designs for estimating population parameters, Biometrical Letters — Listy Biometryczne, 25–41.Google Scholar
  8. Fedorov, V. V. and Hackl, P., 1997. Model-oriented Design of Experiments, Springer Verlag, New York.CrossRefGoogle Scholar
  9. Giovagnoli, A. and Sebastiani, P., 1989. Experimental designs for mean and variance estimation in variance components models, Computational Statistics and Data Analysis 8, 21–28.MathSciNetCrossRefGoogle Scholar
  10. Goldstein, H., 2003. Multilevel Statistical Models, Third Edition, Hodder Arnold, London.zbMATHGoogle Scholar
  11. Graybill, F. A., 1983. Matrices with Applications in Statistics, Wadsworth, Belmont, CA.zbMATHGoogle Scholar
  12. Han, C. and Chaloner, K., 2004. Bayesian experimental design for nonlinear mixed-effects models with applications to HIV dynamics, Biometrics 60, 25–33.MathSciNetCrossRefGoogle Scholar
  13. Kessels, R., Goos, P. and Vandebroek, M., 2006. A comparison of criteria to design efficient choice experiments, Journal of Marketing Research 43, 409–419.CrossRefGoogle Scholar
  14. Lenk, P. J., Desarbo, W. S., Green, P. E. and Young, M. R., 1996. Hierarchical Bayes conjoint analysis, Recovery of partworth heterogeneity from reduced experimental designs, Marketing Science 15, 173–191.CrossRefGoogle Scholar
  15. Liu, Q., Dean, A. M. and Allenby, G. M., 2007. Optimal experimental designs for hyperparameter estimation in hierarchical linear models,, Submitted for publication.
  16. Magnus, J. R. and Neudecker, H., 1999. Matrix Differential Calculus with Applications in Statistics and Econometrics, John Wiley, New York.zbMATHGoogle Scholar
  17. Mentré, F., Mallet, A. and Baccar, D., 1997. Optimal design in random-effects regression models, Biometrika 84, 429–442.MathSciNetCrossRefGoogle Scholar
  18. Montgomery, A. L., Li, S., Srinivasan, K. and Liechty, J. C., 2004. Modeling online browsing and path analysis using clickstream data, Marketing Science 23, 579–595.CrossRefGoogle Scholar
  19. Morrison, D. F., 1990. Multivariate Statistical Methods, McGraw-Hill, Inc., New York.Google Scholar
  20. Pukelsheim, F., 1993. Optimal Design of Experiments, John Wiley, New York.zbMATHGoogle Scholar
  21. Raudenbush, S. W., 1993. A crossed random effects model for unbalanced data with applications in crosssectional and longitudinal research, Journal of Educational Statistics 18, 321–349.CrossRefGoogle Scholar
  22. Raudenbush, S. W. and Bryk, A. S., 2002. Hierarchical Linear Models,Applications and Data Analysis Methods, Sage Publications, Thousand Oaks, CA.Google Scholar
  23. Rossi, P. E., Allenby, G. M. and McCulloch, R., 2005. Bayesian Statistics and Marketing, John Wiley, Hoboken, NJ.CrossRefGoogle Scholar
  24. S—ndor, Z. and Wedel, M., 2001. Designing conjoint choice experiments using managers— prior beliefs, Journal of Marketing Research 38, 430–444.CrossRefGoogle Scholar
  25. S—ndor, Z. and Wedel, M., 2002. Profile construction in experimental choice designs for mixed logit models, Marketing Science 21, 455–475.CrossRefGoogle Scholar
  26. S—ndor, Z. and Wedel, M., 2005. Differentiated Bayesian conjoint choice designs, Journal of Marketing Research 55, 210–218.CrossRefGoogle Scholar
  27. Scheffé, H., 1959. The Analysis of Variance, John Wiley, New York.zbMATHGoogle Scholar
  28. Silvey, S. D., 1980. Optimal Design, Chapman and Hall, London.CrossRefGoogle Scholar
  29. Smith, A. and Verdinelli, I., 1980. A note on Bayesian designs for inference using a hierarchical linear model, Biometrika 67, 613–619.MathSciNetCrossRefGoogle Scholar
  30. Tod, M., Mentré, F., Merlé, Y. and Mallet, A., 1998. Robust optimal design for the estimation of hyperparameters in population pharmacokinetics, Journal of Pharmacokinetics and Biopharmaceutics 26, 689–716.CrossRefGoogle Scholar
  31. Yuh, L., Beal, S., Davidian, M., Harrison, F., Hester, A., Kowalski, K., Vonesh, E. and Wolfinger, R., 1994. Population pharmacokinetics/pharmacodynamics methodology and applications, A bibliography, Biometrics 50, 566–575.CrossRefGoogle Scholar

Copyright information

© Grace Scientific Publishing 2007

Authors and Affiliations

  1. 1.Department of MarketingUniversity of Wisconsin-MadisonMadisonUSA
  2. 2.Department of StatisticsThe Ohio State UniversityColumbusUSA
  3. 3.Department of MarketingThe Ohio State UniversityColumbusUSA

Personalised recommendations