Skip to main content
SpringerLink
Log in

Multidimensional adaptive testing with constraints on test content

  • Articles
  • Published:
Psychometrika Aims and scope Submit manuscript

Abstract

The case of adaptive testing under a multidimensional response model with large numbers of constraints on the content of the test is addressed. The items in the test are selected using a shadow test approach. The 0–1 linear programming model that assembles the shadow tests maximizes posterior expected Kullback-Leibler information in the test. The procedure is illustrated for five different cases of multidimensionality. These cases differ in (a) the numbers of ability dimensions that are intentional or should be considered as “nuisance dimensions” and (b) whether the test should or should not display a simple structure with respect to the intentional ability dimensions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Andersen, E.B. (1980).Discrete statistical models with social science applications. Amsterdam, The Netherlands: North-Holland.

    Google Scholar 

  • Bloxom, B.M., & Vale, C.D. (1987, June).Multidimensional adaptive testing: A procedure for sequential estimation of the posterior centroid and dispersion of theta. Paper presented at annual meeting of the Psychometric Society, Montreal.

  • Chang, H-H., & Ying, Z. (1996). A global information approach to computerized adaptive testing.Applied Psychological Measurement, 20, 213–229.

    Google Scholar 

  • Fraser, C., & McDonald, R.P. (1988).NOHARM II: A FORTRAN program for fitting unidimensional and multidimensional normal ogive models of latent trait theory. Armidale, Australia: University of New England, Centre for Behavioral Studies.

    Google Scholar 

  • Glas, C.A.W. (1989).Contributions to estimating and testing Rasch models. Unpublished doctoral dissertation, University of Twente, The Netherlands.

    Google Scholar 

  • ILOG. (2000).CPLEX 6.5 [Computer program and manual]. Incline Village, NV: Author.

    Google Scholar 

  • Lehmann, E.L. (1999).Elements of large-sample theory. New York, NY: Springer-Verlag.

    Google Scholar 

  • Lehmann, E.L., & Casella, G. (1998).Theory of point estimation. New York, NY: Springer-Verlag.

    Google Scholar 

  • Lord, F.M. (1980).Application of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Lord, F.M., & Novick, M.R. (1968).Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Luecht, R.M. (1996). Multidimensional computerized adaptive testing in a certification or licensure context.Applied Psychological Measurement, 20, 389–404.

    Google Scholar 

  • Reckase, M.D. (1985). The difficulty of test items that measure more than one dimension.Applied Psychological Measurement, 9, 401–412.

    Google Scholar 

  • Reckase, M.D. (1997). A linear logistic multidimensional model for dichotomous item response data. In W.J. van der Linden & R.K. Hambleton (Eds.),Handbook of modern item response theory (pp. 271–286). New York, NY: Springer-Verlag.

    Google Scholar 

  • Segall, D.O. (1996). Multidimensional adaptive testing.Psychometrika, 61, 331–354.

    Google Scholar 

  • Segall, D.O. (2000). Principles of multidimensional adaptive testing. In W.J. van der Linden & C.A.W. Glas (Eds.),Computerized adaptive testing: Theory and practice (pp. 53–73). Boston, MA: Kluwer Academic Publishers.

    Google Scholar 

  • Swanson, L., & Stocking, M.L. (1993). A model and heuristic for solving very large item selection problems.Applied Psychological Measurement, 17, 151–166.

    Google Scholar 

  • van der Linden, W.J. (1996). Assembling tests for the measurement of multiple traits.Applied Psychological Measurement, 20, 373–388.

    Google Scholar 

  • van der Linden, W.J. (1999). Multidimensional adaptive testing with a minimum error-variance criterion.Journal of Educational and Behavioral Statistics, 24, 398–412.

    Google Scholar 

  • van der Linden, W.J. (2000). Constrained adaptive testing with shadow tests. In W.J. van der Linden & C. A. W. Glas (Eds.),Computerized adaptive testing: Theory and practice (pp. 27–52). Boston, MA: Kluwer Academic Publishers.

    Google Scholar 

  • van der Linden, W.J., & Pashley, P.J (2000). Item selection and ability estimation in adaptive testing with shadow tests. In W.J. van der Linden & C.A.W. Glas (Eds.),Computerized adaptive testing: Theory and practice (pp. 1–25). Boston, MA: Kluwer Academic Publishers.

    Google Scholar 

  • van der Linden, W.J., & Reese, L.M. (1998). A model for optimal constrained adaptive testing.Applied Psychological Measurement, 22, 259–270.

    Google Scholar 

  • Veldkamp, B.P. (2002).Modifications of the branch-and-bound algorithm for use in constrained adaptive testing. Manuscript submitted for publication.

Download references

Author information

Authors and Affiliations

  1. Department of Educational Measurement and Data Analysis, University of Twente, P.O. Box 217, 7500 AE, Enschede, The Netherlands

    Bernard P. Veldkamp & Wim J. van der Linden

Authors
  1. Bernard P. Veldkamp
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wim J. van der Linden
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Veldkamp, B.P., van der Linden, W.J. Multidimensional adaptive testing with constraints on test content. Psychometrika 67, 575–588 (2002). https://doi.org/10.1007/BF02295132

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02295132

Key words

Search

Navigation