Abstract
A rationale is proposed for approximating the normal distribution with a logistic distribution using a scaling constant based on minimizing the Kullback–Leibler (KL) information, that is, the expected amount of information available in a sample to distinguish between two competing distributions using a likelihood ratio (LR) test, assuming one of them is true. The new constant 1.749, computed assuming the normal distribution is true, yields an approximation that is an improvement in fit of the tails of the distribution as compared to the minimax constant of 1.702, widely used in item response theory (IRT). The minimax constant is by definition marginally better in its overall maximal error. It is argued that the KL constant is more statistically appropriate for use in IRT.
References
Amemiya, T. (1981). Qualitative response models: A survey. Journal of Economic Literature, 19, 1483–1536.
Baker, F.B. & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques. New York: Marcel Dekker.
Bartholomew, D.J. & Knott, M. (1999). Latent variable models and factor analysis. New York: Oxford University Press.
Camilli, G. (1994). Origin of the scaling constant d = 1.7 in item response theory. Journal of Educational and Behavioral Statistics, 19, 379–388.
Cox, D.R. (1970). The analysis of binary data. London: Methuen.
Ferguson, T.S. (1996). A course in large sample theory. Boca Raton, FL: Chapman & Hall.
Haley, D.C. (1952). Estimation of the dosage mortality relationship when the dose is subject to error. Technical Report 15 (Office of Naval Research Contract No. 25140, NR-342-022). Stanford University: Applied Mathematics and Statistics Laboratory.
Johnson, N.L., Kotz, S. & Balakrishnan, N. (1995). Continuous univariate distributions (Vol. 2). New York: Wiley.
Kullback, S. & Leibler, R.A. (1951). On information and sufficiency. Annals of Mathematical Statistics, 22, 79–86.
Lord, F.M. & Novick, M.R. (1974). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
McDonald, R.P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum. Footnotes
Author information
Authors and Affiliations
Corresponding author
Additional information
The author would like to thank Sebastian Schreiber for his generous assistance with this project.
Requests for reprints should be sent to Victoria Savalei, Department of Psychology, Universit of California, Los Angeles, CA 90095, USA
Rights and permissions
About this article
Cite this article
Savalei, V. Logistic Approximation to the Normal: The KL Rationale. Psychometrika (2006). https://doi.org/10.1007/s11336-04-1237-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11336-04-1237-y