Abstract
In this paper, we propose a class of varying coefficient seemingly unrelated regression models, in which the errors are correlated across the equations. By applying the series approximation and taking the contemporaneous correlations into account, we propose an efficient generalized least squares series estimation for the unknown coefficient functions. The consistency and asymptotic normality of the resulting estimators are established. In comparison with the ordinary least squares ones, the proposed estimators are more efficient with smaller asymptotical variances. Some simulation studies and a real application are presented to demonstrate the finite sample performance of the proposed methods. In addition, based on a B-spline approximation, we deduce the asymptotic bias and variance of the proposed estimators.
Similar content being viewed by others
References
Agarwal, G.G., Studden, W.J. Asymptotic integrated mean square error using least squares and bias minimizing splines. The Annals of Statistics, 8: 1307–1325 (1980)
Ahmad, I., Leelahanon, S., Li, Q. Efficient estimation of a semiparametric partially linear varying coefficient model. The Annals of Statistics, 33: 258–283 (2005)
Barrow, L., Smith, P.W. Asymptotic properties of best l 2[0, 1] approximation by splines with variable knots. Quaterly of Applied Mathematics, 36:293–304 (1978)
Cai, Zongwu, Fan, Jianqing, Li, Runze. Efficient estimation and inferences for varying-coefficient models. Journal of the American Statistical Association, 95(451): 888–902 (2000)
Carroll, R.J. Doug, M., Larry, F. and Victor, K. Seemingly unrelated measurement error models with application to nutritional epidemiology. Biometrics, 62: 75–84 (2006)
Chen, Xiaohong, Hong, Han, Tamer, Elie. Measurement error models with auxiliary data. The Review of Economic Studies, 72(2): 343–366 (2005)
Chiang, Chin-Tsang, Rice, John A., Wu, Colin O. Smoothing spline estimation for varying coefficient models with repeatedly measured dependent variables. Journal of the American Statistical Association, 96(454): 605–619 (2001)
Eubank, R.L., Huang, C., Buchanan, R.J. Smoothing spline estimation in varying coefficient models. Journal of the Royal Statistics, Series B, 66: 653–667 (2004)
Fan, J., Härdle, W., Mammen, E. Direct estimation of additive and linear components for high dimensional data. The Annals of Statistics, 26: 943–971 (1998)
Fan, Jianqing, Huang, Tao. Profile likelihood inferences on semiparametric varying-coefficient partially linear models. Bernoulli, 11(6): 1031–1057 (2005)
Fan, Jianqing, Zhang, WenYang. Statistical estimation in varying coefficient models. Annals of Statistics, 27(5): 1491–1518 (1999)
Fan, Y., Li, Q. A kernel-based method for estimating additive partially linear models. Statistica Sinica, 13: 739–762 (2003)
Hastie, Trevor, Tibshirani, Robert. Varying-coefficient models. Journal of the Royal Statistical Society. Series B (Methodological), 55(4): 757–796 (1993)
Huang, J.Z. Local asymptotics for polynomial spline regression. The Annals of Statistics, 31: 1600–1635 (2003)
Huang, J.Z., Shen, H. Functional coefficient regression models for nonlinear time series: a polynomial spline approach. Scandinavian Journal of Statistics, 31: 515–534 (2004)
Huang, J.Z., Wu, C.O, Zhou, L. Varying-coefficient models and basis function approximations for the analysis of repeated measurements. Biometrika, 89: 111–128 (2002)
Huang, J.Z., Wu, C.O, Zhou, L. Polynomial spline estimation and inference for varying coefficient models with longitudinal data. Statistica Sinica, 14: 763–788 (2004)
Huang, J.Z., Wu, C.O, Zhou, L. Varying-coefficient models and basis function approximations for the analysis of repeated measurements. Biometrika, 89(1): 111–128 (2002)
Kurata, H. On the efficiencies of several generalized least squares estimators in a seemingly unrelated regression model and a heteroscedastic model. Journal of Multivariate Analysis, 70: 86–94 (1999)
Liu, A. Efficient estimation of two seemingly unrelated regression equations. Journal of Multivariate Analysis, 82: 445–456 (2002)
Mandy, D.M., Martins Filho C. Seemingly unrelated regressions under additive heteroscedasticity: theory and share equation applications. Journal of Econometrics, 58: 315–346 (1993)
Newey, W.K. Convergence rates and asymptotic normality for series estimators. Journal of Econometrics, 79: 147–168 (1997)
Ng, V.M. Robust bayesian inference for seemingly unrelated regressions with elliptical errors. Journal of Multivariate Analysis, 83: 409–414 (2002)
Olamide, E.I., Adepoju, A.A. Estimating seemingly unrelated regressions with first order autoregressive disturbances. Studies in Mathematical Sciences, 6(2): 40–55 (2013)
Rocke, D.M. Bootstrap bartlett adjustment in seemingly unrelated regression. Journal of the American Statistical Association, 84: 598–601 (1989)
Schumaker, L.L. Spline Functions: Basic Theory. Wiley, New York, 1981
Welsh, A.H., Yee, T.W. Local regression for vector responses. Journal of Statistical Planning and Inference, 136(9): 3007–3031 (2006)
Yahya, W.B., Adebayo, S.B., Jolayemi, E.T., Oyejola, BA., Sanni, O.M. Effects of non-orthogonality on the efficiency of seemingly unrelated regression (sur) models. Inter. Stat. Journal, 1–29 (2008)
You, Jinhong, Zhou, Xian. Statistical inference on seemingly unrelated varying coefficient partially linear models. Statistica Neerlandica, 64(2): 227–253 (2010)
You, Jinhong, Xie, Shangyu, Zhou, Yong. Two-stage estimation for seemingly unrelated nonparametric regression models. Journal of Systems Science and Complexity, 20(4): 509–520 (2007)
Zellner, A. An efficient method of estimating seemingly unrelated regressions and tests for aggregation bias. Journal of the American Statistical Association, 57: 348–368 (1962)
Zellner, A. Estimators for seemingly unrelated equations: Some exact finite sample results. Journal of the American Statistical Association, 58: 977–992 (1962)
Zhou, Bin, Xu, Qinfeng, You, Jinhong Efficient estimation for error component seemingly unrelated nonparametric regression models. Metrika, 73(1): 121–138 (2011)
Zhou, S., Shen, X., Wolfe, D.A. Local asymptotics for regression splines and confidence regions. The Annals of Statistics, 26: 1760–1782 (1998)
Zhu, Z.Y., Fung, W. K., He, X. On the asymptotics of marginal regression splines with longitudinal data. Biometrika, 95: 907–917 (2008)
Author information
Authors and Affiliations
Corresponding author
Additional information
Xu’s research was supported by Key Academic Project from Bureau of Statistics of Zhejiang Province (201325) and Research Project of the National Statistics (2013LY119). Bai’s work was partially supported by National Natural Science Funds for Young Scholar (No.11001162) and Shanghai University of Finance and Economics through Project 211 Phase IV and Shanghai Leading Academic Discipline Project (No. B804).
Rights and permissions
About this article
Cite this article
Xu, Qf., Bai, Y. Efficient estimation of varying coefficient seemly unrelated regression model. Acta Math. Appl. Sin. Engl. Ser. 30, 119–144 (2014). https://doi.org/10.1007/s10255-014-0301-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10255-014-0301-3
Keywords
- series approximation
- varying coefficient
- seemingly unrelated regression
- contemporaneous correlation
- asymptotic normality