Skip to main content

New Results in Test Theory Without an Answer Key

  • Chapter
Mathematical Psychology in Progress

Part of the book series: Recent Research in Psychology ((PSYCHOLOGY))

Abstract

This paper discusses some recent developments in a new methodology for the social sciences being developed jointly by the authors. The methodology is called cultural consensus analysis, and it is designed to aggregate informant responses to test items about their common culture. The object is to determine correct knowledge about the nature of that culture. Our methods estimate informant competency parameters and “correct” answers to each item from the informant response data. The methodology is designed for anthropological field studies and related research designs. This paper studies the consequences of relaxing the axioms of our model for dichotomous items, and it presents new models for other testing formats.

Work on this paper was supported by NSF Grant No. SES-8808358 to the authors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Batchelder, W.H. & Romney, A.K. (1986). The statistical analysis of a general Condorcet model for dichotomous choice situations. In B. Grofman & G. Owen (Eds.) Information Pooling and Group Decision Making. Greenwich, CN: JAI Press.

    Google Scholar 

  • Batchelder, W.H. amp Romney, A.K. (1988). Test theory without an answer key. Psychometrika, 53, 193–224.

    Google Scholar 

  • Clogg, C.C. (1981). New developments in latent structure analysis. In D.M. Jackson & E.F. Borgatta (Eds.) Factor Analysis and Measurement in Sociological Research. Beverly Hills, CA: Sage.

    Google Scholar 

  • Comrey, A.L. (1962). The minimum residual method of factor analysis. Psychological Reports, 11, 15–18.

    Google Scholar 

  • Einhorn, H.J., Hogarth, R.M., amp Klempner, E. (1977). Quality of group judgements. Psychological Bulletin, 84, 158–172.

    Google Scholar 

  • Gelfand, A. amp Solomon, H. (1973). A study of Poisson’s models for jury verdicts in Criminal and Civil trials. Journal of American Statistical Association, 68, 271–278.

    Google Scholar 

  • Grofman, B. & Owen, G. (Eds.). (1986). Information Pooling and Group Decision Making. Greenwich, CN: JAI Press.

    Google Scholar 

  • Hogarth, R.M. (1975). Cognitive processes and the assessment of subjective probability distributions. Journal of the American Statistical Association, 70, 271–294.

    Article  Google Scholar 

  • Kuhn, H.W. (1986). How to compute economic equilibria by pivotol methods. In S. Reiter (Ed.) Studies in Mathematical Economics. The Mathematical Association of America.

    Google Scholar 

  • Lazarsfeld, P.F. & Henry, N.W. (1968). Latent Structure Analysis. New York: Houghton Mifflin.

    Google Scholar 

  • Lord, F.M. (1974). Individualized testing and item characteristic curve theory. In D.H. Krantz, R.C. Atkinson, R.D. Luce, & P. Suppes (Eds.) Contemporary Developments in Mathematical Psychology (Vol.2). San Francisco: Freeman.

    Google Scholar 

  • Lord, F.M. & Novick, M.R.. (1968). Statistical Theories of Mental Test Scores. Reading, MA: Addison-Wesley.

    Google Scholar 

  • McKenna, F.P. (1985). Another look at the “new psychophysics.” British Journal of Psychology, 76, 97–109.

    Article  Google Scholar 

  • Maher, K.M. (1987). A multiple choice model for aggregating group knowledge and estimating individual competencies. Ph.D. Dissertation, Universtiy of California, Irvine. Nitzan, S. amp Paroush, J. (1982). Optimal decision rules in uncertain dichotomous choice situations. International Economics Review, 23, 289–297.

    Google Scholar 

  • Pradhan, P.L. & Hoffman, P.J. (1963). Effect of spacing the range of stimuli on magnitude estimation judgements. Journal of Experimental Psychology, 66, 533–541.

    Article  PubMed  Google Scholar 

  • Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Denmarks Paedagogiske Institute.

    Google Scholar 

  • Romney, A.K., Batchelder, W.H., & Weller, S.C. (1987). Recent applications of cultural consensus theory. American Behavioral Scientist, 31, 163–177.

    Article  Google Scholar 

  • Romney, A.K., Weller, S.C., & Batchelder, W.H. (1986). Culture as consensus: a theory of culture and informant accuracy. American Anthropologist, 88, 313–338.

    Google Scholar 

  • Winkler, R.L. & Cummings, L.L. (1972). On the choice of a consensus distribution in Bayesian analysis. Organization Behavior and Human Performance, 7, 63–76.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1989 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Batchelder, W.H., Romney, A.K. (1989). New Results in Test Theory Without an Answer Key. In: Roskam, E.E. (eds) Mathematical Psychology in Progress. Recent Research in Psychology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-83943-6_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-83943-6_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-51686-6

  • Online ISBN: 978-3-642-83943-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics