Abstract
We study designs, optimal up to and including terms that are O(n −1), for weighted least squares regression, when the weights are intended to be inversely proportional to the variances but are estimated with random error. We take a finite, but arbitrarily large, design space from which the support points are to be chosen, and obtain the optimal proportions of observations to be assigned to each point. Specific examples of D- and I-optimal design for polynomial responses are studied. In some cases the same designs that are optimal under homoscedasticity remain so for a range of variance functions; in others there tend to be more support points than are required in the homoscedastic case. We also exhibit minimax designs, that minimize the maximum, over finite classes of variance functions, value of the loss. These also tend to have more support points, often resulting from the breaking down of replicates into clusters.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Carroll, R.J., Ruppert, D.: Robust estimation in heteroscedastic linear models. Ann. Stat. 10, 429–441 (1982)
Dette, H., Haines, L.M., Imhof, L.A.: Bayesian and maximin optimal designs for heteroscedastic regression models. Can. J. Stat. 33, 221–241 (2005)
Fang, Z., Wiens, D.P.: Integer-valued, minimax robust designs for estimation and extrapolation in heteroscedastic, approximately linear models. J. Am. Stat. Assoc. 95, 807–818 (2000)
Fuller, W.A., Rao, J.N.K.: Estimation for a linear model with unknown diagonal covariance matrix. Ann. Stat. 6, 1149–1158 (1978)
Gass, S.I.: Linear Programming: Methods and Applications. McGraw-Hill, New York (1975)
Hooper, P.M.: Iterative weighted least squares estimation in heteroscedastic linear models. J. Am. Stat. Assoc. 88, 179–184 (1993)
Pukelsheim, F.: Optimal Design of Experiments. Wiley, New York (1993)
Shao, J.: Empirical Bayes estimation of heteroscedastic variances. J. Am. Stat. Assoc. 88, 179–184 (1992)
Srivastava, M.S., Khatri, C.G.: An Introduction to Multivariate Statistics. North-Holland, New York (1979)
Wiens, D.P.: Minimax robust designs and weights for approximately specified regression models with heteroscedastic errors. Stat. Sin. 2, 495–518 (1998)
Wiens, D.P.: Robust weights and designs for biased regression models: least squares and generalized M-estimation. J. Stat. Plan. Inference 83, 395–412 (2000)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wiens, D.P. Designs for weighted least squares regression, with estimated weights. Stat Comput 23, 391–401 (2013). https://doi.org/10.1007/s11222-012-9317-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11222-012-9317-9