Abstract
In the nonlinear regression model we consider the optimal design problem with a second order design D-criterion. Our purpose is to present a general approach to this problem, which includes the asymptotic second order bias and variance criterion of the least squares estimator and criteria using the volume of confidence regions based on different statistics. Under assumptions of regularity for these statistics a second order approximation of the volume of these regions is derived which is proposed as a quadratic optimality criterion. These criteria include volumes of confidence regions based on the u n - representable statistics. An important difference between the criteria presented in this paper and the second order criteria commonly employed in the recent literature is that the former criteria are independent of the vector of residuals. Moreover, a refined version of the commonly applied criteria is obtained, which also includes effects of nonlinearity caused by third derivatives of the response function.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bardadym, T. A. and Ivanov, A. V. (1985). An asymptotic expansion related to an empirical regression function, Theory of Mathematical Statistics, 30, 7–13.
Bates, D. M. and Watts, D. G. (1980). Relative curvature measures of non-linearity, J. Roy. Statist. Soc. B, 42, 1–25.
Beale, E. M. L. (1960). Confidence regions in non-linearity estimation (with discussion), J. Roy. Statist. Soc. B, 22, 41–88.
Borovkov, A. A. (1998). Mathematical Statistics, Gordon and Breach, London.
Box, G. E. P. and Lucas, H. (1959). Design of experiments in nonlinear situations, Biometrika, 41, 77–90.
Box, M. J. (1971). Bias in nonlinear estimation (with discussion), J. Roy. Statist. Soc. B, 32, 171–201.
Chernoff, H. (1953). Locally optimal designs for estimating parameters, Ann. Math. Statist, 24, 586–602.
Clarke, G. P. Y. (1980). Moments of the least squares estimators in a nonlinear regression model, J. Roy. Statist. Soc. B, 42, 227–237.
Efron, B. (1975). Defining the curvature of a statistical problem with applications to second order efficiency (with discussion), Ann. Statist., 3, 1199–1242.
Fikhtengolts, G. M. (1966). A Course of Differential and Integral Calculus, Vol. 2, Nauka, Moscow (in Russian).
Ford, I., Torsney, B. and Wu, C. F. Y. (1992). The use of a canonical form in the construction of locally optimal designs for non-linear problems, J. Roy. Statist. Soc. B, 54, 569–583.
Grigoriev, Yu. D. (1993). The asymptotic second order criteria of optimality for designs of experiments, Electronic Technic, Ser. 7, 1(176), 22–25 (in Russian).
Grigoriev, Yu. D. (1994). Development and investigation of algorithms in the analysis of nonlinear regression models, Doctor of Science Thesis, State Technical University, Novosibirsk.
Grigoriev, Yu. D. and Ivanov, A. V. (1987a). Asymptotic expansions in nonlinear regression analysis, Zavodckaja Laboratoria, 53, 48–51. (in Russian)
Grigoriev, Yu. D. and Ivanov, A. V. (1987b). On measures of non-linearity of regression models, Zavodckaja Laboratoria, 53, 57–61 (in Russian).
Hamilton, D. C. and Watts, D. G. (1985). A quadratic design criterion for precise estimation in nonlinear regression models, Technometrics, 27, 241–250.
Ivanov, A. V. (1982). An asymptotic expansion of moments of least squares estimator for a vector parameter of nonlinear regression, Ukrainian Math. J., 34, 134–139.
Ivanov, A. V. (1997). Asymptotic Theory of Nonlinear Regression, Kluwer, Dordrecht.
O'Brien, T. E. (1992). A note on quadratic designs for nonlinear regression models, Biometrika, 79, 847–849.
O'Brien, T. E. (1996). Robust design strategies for nonlinear regression models, Versuchsplanung in der Industrie, (eds. H. Toutenberg, and R. Gössl), 41–52, Prentice Hall, München.
O'Brien, T. E. and Rawlings J. O. (1996). A nonsequential design procedure for parameter estimation and model discrimination in nonlinear regression models, J. Stat. Plann. Inference, 55, 77–93.
Pazman, A. (1989). On information matrices in nonlinear experimental design, J. Stat. Plann. Inference, 21, 253–263.
Pazman, A. (1990). Small-sample distribution of properties of nonlinear regression estimators (a geometric approach), Statistics, 21, 323–367.
Pazman, A. (1992). A classification of nonlinear regression models and parameter confidence regions, Kybernetika, 28(6), 444–453.
Pazman, A. (1993). Nonlinear Statistical Models, Kluwer, Dordrecht.
Pronzato, L. and Pazman, A. (1994). Second-order approximation of the entropy in nonlinear least-squares estimation, Kybernetika, 30(2), 187–198 (Erratum: ibid. (1996). 32, 104).
Rao, C. R. (1965). Linear Statistical Inference and Its Applications, Wiley, New York.
Rashevsky, P. C. (1967). Riemannian Geometry and Tensor Analysis, Nauka, Moscow (in Russian).
Seber, G. A. F. and Wild, C. J. (1989). Nonlinear Regression, Wiley, New York.
Author information
Authors and Affiliations
About this article
Cite this article
Dette, H., Grigoriev, Y. A Unified Approach to Second Order Optimality Criteria in Nonlinear Design of Experiments. Annals of the Institute of Statistical Mathematics 52, 574–597 (2000). https://doi.org/10.1023/A:1004137906908
Issue Date:
DOI: https://doi.org/10.1023/A:1004137906908