Abstract
The balanced complete multi-way layout with ordinal or nominal factors is a fundamental data-type that arises in medical imaging, agricultural field trials, DNA microassays, and other settings where analysis of variance (ANOVA) is an established tool. ASP algorithms weigh competing biased fits in order to reduce risk through variance-bias tradeoff. The acronym ASP stands for Adaptive Shrinkage of Penalty bases. Motivating ASP is a penalized least squares criterion that associates a separate quadratic penalty term with each main effect and each interaction in the general ANOVA decomposition of means. The penalty terms express plausible conjecture about the mean function, respecting the difference between ordinal and nominal factors. Multiparametric asymptotics under a probability model and experiments on data elucidate how ASP dominates least squares, sometimes very substantially. ASP estimators for nominal factors recover Stein's superior shrinkage estimators for one- and two-way layouts. ASP estimators for ordinal factors bring out the merits of smoothed fits to multi-way layouts, a topic broached algorithmically in work by Tukey.
Similar content being viewed by others
References
Andersen, A. H., Jensen, E. B. and Schou, G. (1981). Two-way analysis of variance with correlated errors,International Statistical Review,49, 153–167.
Andrews, D. F. and Herzberg, A. M. (1985).Data, Springer, New York.
Beran, R. (2002). Improving penalized least squares through adaptive selection of penalty and shrinkage,Annals of the Institute of Statistical Mathematics,54, 900–917.
Beran, R. and Dümbgen, L. (1998). Modulation of estimators and confidence sets.Annals of Statistics,26, 1826–1856.
Bril, G., Dykstra, R., Pillers, C. and Robertson, T. (1984). Isotonic regression in two variables,Journal of the Royal Statistical Society (C),33, 352–357.
Brown, M. B. (1975). Exploring interaction effects in the ANOVA,Applied Statistics,24, 288–298.
Buja, A., Hastie, T. and Tibshirani, R. (1989). Linear smoothers and additive models (with discussion),Annals of Statistics,17, 453–555.
Donoho, D. L. and Johnstone, I. M. (1995). Adapting to unknown wavelet shrinkage,Journal of the American Statistical Association,90, 1200–1224.
Green, P., Jennison, C. and Seheult, A. (1985). Analysis of field experiments by least squares smoothing,Journal of the Royal Statistical Society (B), 299–315.
James, W. and Stein, C. (1961). Estimation with quadratic loss,Proceedings Fourth Berkeley Symposium Mathematical Statistics and Probability,1, 361–380, University of California Press, Berkeley.
Kimeldorf, G. S. and Wahba, G. (1970). A correspondence between Bayesian estimation on stochastic processes and smoothing by splines,Annals of Mathematical Statistics,41, 495–502.
Kneip, A. (1994). Ordered linear smoothers,Annals of Statistics,22, 835–866.
Li, K.-C. and Hwang, J. T. (1984). The data-smoothing aspect of Stein estimates,Annals of Statistics,12, 887–897.
Mallows, C. L. (1973). Some comments onC p ,Technometrics,15, 661–676.
Pinsker, M. S. (1980). Optimal filtration of square-integrable signals in Gaussian noise,Problems of Information Transmission,16, 120–133.
Robertson, T., Wright, F. T. and Dykstra, R. L. (1988).Order Restricted Statistical Inference, Wiley, New York.
Seheult, A. H. and Tukey, J. W. (2001). Towards robust analysis of variance,Data Analysis from Statistical Foundations (eds. A. K. Mohammed and E. Saleh), 217–244, Nova Science Publishers, New York.
Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution,Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probabability (ed. J. Neyman),1, 197–206, University of California Press, Berkeley.
Stein, C. (1966). An approach to the recovery of inter-block information in balanced incomplete block designs,Festschrift for Jerzy Neyman (ed. F. N. David), 351–364, Wiley, New York.
Stein, C. (1981). Estimation of the mean of a multivariate normal distribution,Annals of Statistics,9, 1135–1151.
Tukey, J. W. (1977).Exploratory Data Analysis, Addison-Wesley, Reading, Massachusetts.
Wood, S. N. (2000). Modelling and smoothing parameter estimation with multiple quadratic penalties,Journal of the Royal Statistical Society (B),62, 413–428.
Xhonga, F. (1971). Direct gold alloys—Part II,Journal of the American Academy of Gold Foil Operators,14, 5–15.
Author information
Authors and Affiliations
Additional information
This research was supported in part by National Science Foundation Grants DMS 0300806 and 0404547.
About this article
Cite this article
Beran, R. ASP fits to multi-way layouts. Ann Inst Stat Math 57, 201–220 (2005). https://doi.org/10.1007/BF02507022
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02507022