Abstract
The binary logistic regression (BLR) model is used as an alternative to the commonly used linear regression model when the response variable is binary. As in the linear regression model, there can be a relationship between the predictor variables in a BLR, especially when they are continuous, thus giving rise to the problem of multicollinearity. The efficiency of maximum likelihood estimator (MLE) is low in estimating the parameters of BLR when there is multicollinearity. Alternatively, the ridge estimator and the Liu estimator were developed to replace MLE. However, in this study, we developed a new estimator also to mitigate the effect of multicollinearity. We established the superiority of this new estimator over the existing ones in terms of their corresponding MSE. Finally, a numerical example and simulation study were conducted to illustrate the theoretical results. The result shows that the new estimator outperforms the existing estimators.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Amini M, Roozbeh M (2015) Optimal partial ridge estimation in restricted semiparametric regression models. J Multivar Anal 136:26–40
Asar Y, Genç A (2017) Two-parameter ridge estimator in the binary logistic regression. Commun Stat Simul Comput. https://doi.org/10.1080/03610918.2016.1224348
Asar Y, Arashi M, Wu J (2016) Restricted ridge estimator in the logistic regression model. Commun Stat Simul Comput. https://doi.org/10.1080/03610918.2016.1206932
Farebrother RW (1976) Further results on the mean square error of ridge regression. J R Stat Soc B38:248–250
Gibbons DG (1981) A simulation study of some ridge estimators. J Am Stat Assoc 76:131–139
Golub G, Heath M, Wahba G (1979) Generalized cross validation as a method for choosing a good ridge parameter. Technometrics 21:215–223
Hoerl AE, Kennard RW (1970) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12(1):55–67
Hoerl AE, Kennard RW, Baldwin KF (1975) Ridge regression: some simulation. Commun Stat Theory Methods 4:105–123
Inan D, Erdogan BE (2013) Liu-type logistic estimator. Commun Stat Simul Comput 42(7):1578–1586. https://doi.org/10.1080/03610918.2012.667480
Khalaf G, Shukur G (2005) Choosing ridge parameters for regression problems. Commun Stat Theory Methods 34:1177–1182
Kibria BMG (2003) Performance of some new ridge regression estimators. Commun Stat Theory Methods 32:419–435
Kibria BMG, Mansson K, Shukur G (2012) Performance of some logistic ridge regression estimators. Comput Econ 40(4):401–414
Lawless JF, Wang P (1976) A simulation study of ridge and other regression estimators. Commun Stat Theory Methods 5:307–323
Liu K (2003) Using Liu-Type estimator to combat collinearity. Commun Stat Theor Methods 32(5):1009–1020
Lukman AF, Arowolo OT (2018) Newly proposed biased ridge estimator: an application to the Nigerian economy. Pak J Stat 34(2):91–98
Lukman AF, Ayinde K (2017) Review and classifications of the ridge parameter estimation techniques. Hacet J Math Stat 46(5):953–967
Lukman AF, Ayinde K, Ajiboye SA (2017) Monte-Carlo study of some classification-based ridge parameter estimators. J Mod Appl Stat Methods 16(1):428–451
Lukman AF, Ayinde K, Binuomote S, Onate AC (2019a) Modified ridge-type estimator to combat multicollinearity: application to chemical data. J Chemom 33:e3125
Lukman AF, Ayinde K, Sek SK, Adewuyi E (2019b) A modified new two-parameter estimator in a linear regression model. Model Simul Eng. https://doi.org/10.1155/2019/6342702
Mansson K, Kibria B, Shukur G (2012) On Liu estimators for the logit regression model. Econ Model 29(4):1483–1488
McDonald G, Galarneau DI (1975) A Monte Carlo evaluation of some ridge-type estimators. J Am Stat Assoc 70(350):407–416
Muniz G, Kibria BMG (2009) On some ridge regression estimators: an empirical comparisons. Commun Stat Simul Comput 38:621–630
Nagarajah V, Wijekoon P (2015) Stochastic restricted maximum likelihood estimator in logistic regression model. Open J Stat 5:837–851
Newhouse JP, Oman SD (1971) An evaluation of ridge estimators. Rand Corporation, P-716-PR, 1–28
Ozkale MR (2016) Iterative algorithms of biased estimation methods in binary logistic regression. Stat Pap 57:991–1016
Ozkale MR, Kaciranlar S (2007) The restricted and unrestricted two-parameter estimators. Commun Stat Theory Methods 36:2707–2725
Pena WEL, Massaguer PR De, Zuniga ADG, Saraiva SH (2011) Modeling the growth limit of Alicyclobacillus acidoterrestris CRA7152 in apple juice: effect of pH, Brix, temperature and nisin concentration. J Food Process Preserv 35:509517
Roozbeh M (2018) Optimal QR-based estimation in partially linear regression models with correlated errors using GCV criterion. Comput Stat Data Anal 117(C):45–61
Schaeffer RL, Roi LD, Wolfe RA (1984) A ridge logistic estimator. Commun Stat Theory Methods 13:99–113
Speckman P (1988) Kernel smoothing in partially linear models. J R Stat Soc Ser B 50:413–436
Trenkler G, Toutenburg H (1990) Mean squared error matrix comparisons between biased estimators an overview of recent results. Stat Pap 31:165–179
Varathan N, Wijekoon P (2018) Optimal generalized logistic estimator. Commun Stat Theory Methods 47(2):463–474. https://doi.org/10.1080/03610926.2017.1307406
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lukman, A.F., Emmanuel, A., Clement, O.A. et al. A Modified Ridge-Type Logistic Estimator. Iran J Sci Technol Trans Sci 44, 437–443 (2020). https://doi.org/10.1007/s40995-020-00845-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40995-020-00845-z