Abstract
Regularization has been applied by implicitly assuming that the weight matrix of measurements is known. If measurements are assumed to be heteroscedastic with different unknown variance components, all regularization techniques may not be proper to apply, unless techniques of variance component estimation are directly implemented. Although variance component estimation techniques have been proposed to simultaneously estimate the variance components and provide a means of regularization, the regularization parameter is treated as if it were also an extra variance component. In this paper, we assume no prior information on the model parameters and do not treat the regularization parameter as an extra variance component. Instead, we first analyze the biases of estimated variance components due to the regularization parameter and then propose bias-corrected variance component estimators. The results have shown that they work very well. Finally, we propose and investigate through simulations an iterative scheme to simultaneously estimate the variance components and the regularization parameter, in order to eliminate the effect of regularization parameter on variance components and the effect of incorrect prior weights or initial variance components on the regularization parameter.
Similar content being viewed by others
References
Grafarend EW (1985) Variance-covariance component estimation: theoretical results and geodetic applications. Stat Decis 4: 407–441
Graybill FA, Wortha AW (1956) A note on uniformly best unbiased estimators for variance components. J Am Stat Assoc 51: 266–268
Graybill FA, Hultquist RA, (1961) Theorems concerning Eisenhart’s model II. Ann Math Stat 32: 261–269
Hartley HO, Rao JNK (1967) Maximum-likelihood estimation for the mixed analysis of variance model. Biometrika 54: 93–108
Helmert FR (1907) Die Ausgleichungsrechnung nach der Methode der kleinsten Quadrate. Zweite Auflage, Teubner, Leipzig
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12: 55–67
Horn SD, Horn RA, Duncan DB, (1975) Estimating heteroscedastic variances in linear models. J Am Stat. Ass 70: 380–385
Hwang C (2001) Gravity recovery using COSMIC GPS data: application of orbital perturbation theory. J Geod 75: 117–136
Koch K-R (1986) Maximum likelihood estimate of variance components. Bull Géod 60: 329–338
Koch K-R (1999). Parameter estimation and hypothesis testing in linear models, 2nd edn. Springer, Berlin Heidelberg New York
Koch K-R, Kusche J (2002) Regularization of geopotential determination from satellite data by variance components. J Geod 76: 259–268
Kubik K (1970) The estimation of the weights of measured quantities within the method of least squares. Bull Géod 44: 21–40
Kusche J (2002) Inverse Probleme bei der Gravitationsfeldbestimmung mittels SST- und SGG-Satellitenmissionen, Deutsche Geodätische Kommission, C548, Munich
LaMotte LR (1973) On non-negative quadratic unbiased estimation of variance components. J Am Stat. Assoc. 68: 728–730
Patterson HD, Thompson R (1971) Recovery of inter-block information when block sizes are unequal. Biometrika 58: 545–554
Patterson HD, Thompson R (1975) Maximum likelihood estimation of components of variance. In: Proceedings of the 8th Int biometric Conference, pp.197–207
Rao CR (1970) Estimation of heteroscedastic variances in linear models. J Am Stat Assoc 65: 161–171
Rao CR (1971a) Estimation of variance and covariance components—MINQUE theory. J Multivariate Anal 1: 257–275
Rao CR (1971b) Minimum variance quadratic unbiased estimation of variance components. J Multivariate Anal 1: 445–456
Rao CR, Kleffe J (1988) Estimation of variance components and applications. North-Holland, Amsterdam.
Schwintzer P (1990) Sensitivity analysis in least squares gravity modelling by means of redundancy decomposition of stochastic prior information. Internal Report, Deutsches Geodätisches Forschungsinstitut
Searle SR (1971) Linear models. Wiley, New York
Shen YZ, Liu DJ (2002) An unbiased estimate of the variance of unit weight after regularization (in Chinese with English abstract). Geomatics Inf Sci Wuhan Univ 27:604–606
Tikhonov AN, Arsenin VY (1977) Solutions of ill-posed problems. Wiley, New York
Xu PL (1992) Determination of surface gravity anomalies using gradiometric observables. Geophys J Int 110: 321–332
Xu PL (1998) Truncated SVD methods for linear discrete ill-posed problems. Geophys. J. Int 135: 505–514
Xu PL, Fukuda Y, Liu YM (2006) Multiple parameter regularization: numerical solutions and applications to the determination of geopotential from precise satellite orbits. J. Geod, DOI 10.1007/s00190-006-0025-0
Xu PL, Shimada S (2000) Least squares parameter estimation in multiplicative noise models. Commun Stat B29:83–96
Yu ZC (1996) A universal formula of maximum likelihood estimation of variance–covariance components. J Geod 70: 233–240
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Xu, P., Shen, Y., Fukuda, Y. et al. Variance Component Estimation in Linear Inverse Ill-posed Models. J Geodesy 80, 69–81 (2006). https://doi.org/10.1007/s00190-006-0032-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00190-006-0032-1