We consider the linear regression model with stochastic regressors and stochastic errors both in regressors and the dependent variable (“structural EIV model”), where the regressors and errors are assumed to satisfy some interesting and general conditions, different from traditional assumptions on EIV models (such as Deming regression). The most interesting fact is that we need neither independence of errors, nor identical distributions, nor zero means. The first main result is that the TLS estimator, where the traditional Frobenius norm is replaced by the Chebyshev norm, yields a consistent estimator of regression parameters under the assumptions summarized below. The second main result is that we design an algorithm for computation of the estimator, reducing the computation to a family of generalized linear-fractional programming problems (which are easily computable by interior point methods). The conditions under which our estimator works are (said roughly): it is known which regressors are affected by random errors and which are observed exactly; that the regressors satisfy a certain asymptotic regularity condition; all error distributions, both in regressors and in the endogenous variable, are bounded in absolute value by a common bound (but the bound is unknown and is estimated); there is a high probability that we observe a family of data points where the errors are close to the bound. We also generalize the method to the case that the bounds of errors in the dependent variable and regressors are not the same, but their ratios are known or estimable. The assumptions, under which our estimator works, cover many settings where the traditional TLS is inconsistent.
Errors-in-variables Measurement error models Total least squares Chebyshev matrix norm Bounded error distributions Generalized linear-fractional programming
Mathematics Subject Classification
62J05 65C60 90C32
The work was supported by the Czech Science Foundation under grants P402/13-10660S (M. Hladík), P402/12/G097 (M. Černý) and P403/15/09663S (J. Antoch). J. Antoch also acknowledges the support from the BELSPO IAP P7/06 StUDyS network. We are also obliged to Tomáš Cipra, a senior member of DYME Research Center, for fruitful discussions.
Almeida H, Campello M Jr, Galvao AF (2010) Measurement errors in investment equations. Rev Financial Stud 23:3279–3328CrossRefGoogle Scholar
Kukush A, Van Huffel S (2004) Consistency of elementwise-weighted total least squares estimator in a multivariate errors-in-variables model AX=B. Metrika 59:75–97MathSciNetCrossRefMATHGoogle Scholar
Kukush A, Markovsky I, Van Huffel S (2002) On consistent estimators in linear and bilinear multivariate errors-in-variables models. In: Van Huffel S, Lemmerling P (eds) Total least squares and errors-in-variables modeling: analysis, algorithms and applications. SIAM, Philadelphia, pp 155–164CrossRefGoogle Scholar
Lewbel A (1997) Constructing instruments for regressions with measurement error when no additional data are available, with an application to patents and R & D. Econometrica 65:1201–1213MathSciNetCrossRefMATHGoogle Scholar
Maddala GS, Nimalendran M (1996) Error-in-variables problems in financial models. In: Maddala GS, Rao CR (eds) Handbook of statistics. Elsevier Science, New YorkGoogle Scholar
Markovsky I, Rastellob ML, Premolic A, Kukush A, Van Huffel S (2005) The element-wise weighted total least-squares problem. Comput Stat Data Anal 50:181–209MathSciNetCrossRefGoogle Scholar
Nesterov YE, Nemirovski AS (1995) An interior-point method for generalized linear-fractional programming. Math Program 69(1B):177–204MathSciNetMATHGoogle Scholar
Oettli W, Prager W (1964) Compatibility of approximate solution of linear equations with given error bounds for coefficients and right-hand sides. Numerische Math 6:405–409MathSciNetCrossRefMATHGoogle Scholar
Rao CR (1980) Matrix approximations and reduction of dimensionality in multivariate statistical analysis. In: Krishnaiah PR (ed) Multivariate analysis, vol 5. North-Holland, Amsterdam, pp 3–22Google Scholar
Shalabh Garg G, Misra N (2010) Consistent estimation of regression coefficients in ultrastructural measurement error model using stochastic prior information. Stat Pap 51(3):717–748MathSciNetCrossRefMATHGoogle Scholar