Abstract
A Bayesian framework for making mastery/nonmastery decisions based on multivariate test data is described in this study. Overall, mastery is granted (or denied) if the posterior expected loss associated with such action is smaller than the one incurred by the denial (or grant) of mastery. An explicit form for the cutting contour which separates mastery and nonmastery states in the test score space is given for multivariate normal test scores and for a constant loss ratio. For multiple cutting scores in the true ability space, the test score cutting contour will resemble the boundary defined by multiple test cutting scores when the test reliabilities are reasonably close to unity. For tests with low reliabilities, decisions may very well be based simply on a suitably chosen composite score.
Similar content being viewed by others
References
Anderson, T. W.An introduction to multivariate statistical analysis. New York: McGraw-Hill, 1958.
Ferguson, T. S.Mathematical statistics: A decision-theoretic approach. New York: Academic Press, 1967.
Huynh, H. Statistical consideration of mastery scores.Psychometrika, 1976,41, 65–78.
Huynh, H. Two simple classes of mastery scores based on the beta-binomial model.Psychometrika, 1977,42, 601–608.
Huynh, H. A class of passing scores based on the bivariate normal model.Proceedings of the American Statistical Association (Social Statistics Section), 1979.
Huynh, H. A nonrandomized minimax solution for passing scores in the binomial error model.Psychometrika, 1980,45, 167–182.
IMSL Library 1. Houston: International Mathematical and Statistical Libraries, 1977.
van der Linden, W. J. & Mellenbergh, G. J. Optimal cutting scores using a linear loss function.Applied Psychological Measurement, 1977,1, 593–599.
Lord, F. M. Cutting scores and errors of measurement.Psychometrika, 1962,27, 19–30.
Milton, R. C. Computer evaluation of the multivariate normal integral.Technometrics, 1972,14, 881–889.
Swaminathan, H., Hambleton, R. K. & Algina, J. A Bayesian decision-theoretic procedure for use with criterion-referenced tests.Journal of Educational Measurement, 1975,12, 87–98.
Tihansky, D. P.Property of the bivariate normal cumulative distribution, Report P4400. Santa Monica, California: Rand Corporation, 1970.
Wald, A.Statistical decision functions. New York: John Wiley & Sons, 1950.
Wilcox, R. R. A note on the length and passing score of a mastery test.Journal of Educational Statistics, 1976,1, 359–364.
Author information
Authors and Affiliations
Additional information
This work was performed pursuant to Grant NIE-G-78-0087 with the National Institute of Education, Department of Health, Education, and Welfare, Huynh Huynh, Principal Investigator. Points of view or opinions stated do not necessarily reflect NIE positions or policy and no official endorsement should be inferred. The assistance of Joseph C. Saunders is gratefully acknowledged. The author is indebted to an anonymous referee who pointed out several computational errors in the earlier versions of the paper.
Rights and permissions
About this article
Cite this article
Huynh, H. A bayesian procedure for mastery decisions based on multivariate normal test data. Psychometrika 47, 309–319 (1982). https://doi.org/10.1007/BF02294162
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02294162