Journal of Statistical Theory and Practice

, Volume 6, Issue 2, pp 260–273 | Cite as

Improved Estimation in Regression With Varying Penalty

  • Zahirul HoqueEmail author
  • Shahadut Hossain


This article considers the estimation of the intercept parameter of a simple linear regression model under asymmetric linex loss. The least-squares estimator (LSE) and the preliminary test estimator (PTE) are defined. The risk functions of the estimators are derived. The moment-generating function (MGF) and the first two moments of the PTE are shown. The risk of the PTE is compared with that of the LSE. The analyses show that if the nonsample prior information about the value of the parameter is not too far from its true value, the PTE dominates the traditional LSE.

AMS Subject Classification

62J05 62G05 


Asymmetric loss Prior information Intercept parameter Preliminary test estimator 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bhoj, D. and M. Ahsanullah. 1993. Estimation of a conditional mean in a regression model. Biometrics J., 37, 791–799.MathSciNetCrossRefGoogle Scholar
  2. Bhoj, D. and M. Ahsanullah. 1994. Estimation of a conditional mean in a linear regression model after a preliminary test on regression coefficient. Biometrics. J., 36, 153–163.MathSciNetCrossRefGoogle Scholar
  3. Bancroft, T. A. 1944. On biases in estimation due to the use of the preliminary test of significance. Ann. Math. Stat., 15, 190–204.MathSciNetCrossRefGoogle Scholar
  4. Bhattacharaya, D., F. J. Samaniego, and E. M. Vestrup. 2002. On the comperative performance of bayesian and classical point estimators under asymmetric loss. Sankhya B, 64(3), 239–266.MathSciNetGoogle Scholar
  5. Hoque, Z. 2004. Improved estimation of linear models under different loss functions. Unpublished PhD thesis, University of Southern Queensland, Australia.Google Scholar
  6. Khan, S., Z. Hoque, and A. K. M. E. Saleh. 2002. Estimation of the slope parameter for linear regression model with uncertain prior information. J. Stat. Res., 36(1), 55–73.MathSciNetGoogle Scholar
  7. Khan, S., Z. Hoque, and A. K. M. E. Saleh. 2005. Estimation of the intercept parameter for linear regression mopdel with uncertain prior information. Stat. Papers., 46(3), 379–398.CrossRefGoogle Scholar
  8. Pandey, B. N., and O. Rai. 1992. Bayesian estimation of mean and square of mean of normal distribution using linex loss function. Commun. Stat. Theory Methods, 21(12), 3369–3391.MathSciNetCrossRefGoogle Scholar
  9. Parsian, A., and N. S. Farispour, 1993. On the admissibility and inadmissibility of estimators of scale parameters using an asymmetric loss function. Commun. Stat. Theory Methods, 22(10), 2877–2901.MathSciNetCrossRefGoogle Scholar
  10. Parsian, A., N. S. Farispour, and N. Nematollahi. 1993. On the minimaxity of pitman type estimator under a linex loss function. Commun. Stat. Theory Methods, 22(1), 97–113.MathSciNetCrossRefGoogle Scholar
  11. Rojo, J. 1987. On the admissibility of cX¯ + d with respect to the linex loss function. Commun. Stat.Theory Methods, 16(12), 3745–3748.CrossRefGoogle Scholar
  12. Saleh, A. K. M. E., 2006. Theory of preliminary test and stein-type estimation with applications. New York, NY, John Wiley.CrossRefGoogle Scholar
  13. Saleh, A. K. M. E. and C. P. Han 1990. Shrinkage estimation in regression analysis. Estadistica, 42, 40–63.MathSciNetGoogle Scholar
  14. Saleh, A. K. M. E. and P. K. Sen. 1985. Shrinkage least squares estimation in a general multivari-ate linear model. Proceedings of the Fifth Pannonian Symposium on Mathematical Statistics, Amsterdam, 275–297.Google Scholar
  15. Saleh, A. K. M. E. and P. K. Sen. 1986. On shrinkage R-estimation in a multiple regression model. Commun. Stat. Theory Methods, 15(7), 2229–2244.MathSciNetCrossRefGoogle Scholar
  16. Varian, H. R. 1975. A Bayesian approach to real estate assessment. In Studies in Bayesian econometrics and statistics in honor of L.J. Savage, ed. S. E. Feinberg and A. Zellner, Amsterdam, North Holland. 195–208.Google Scholar
  17. Zellner, A. 1986. Bayesian estimation and prediction using asymmetric loss functions. J. Am. Stat. Assoc., 81(394), 446–451.MathSciNetCrossRefGoogle Scholar

Copyright information

© Grace Scientific Publishing 2012

Authors and Affiliations

  1. 1.United Arab Emirates UniversityAl AinUnited Arab Emirates

Personalised recommendations