Advertisement

Systematic Measurement Error

  • Gideon J. MellenberghEmail author
Chapter

Abstract

Systematic errors bias measurements. Obviously, cheating is a biasing factor. Answer copying is a type of cheating, which can be detected by answer-copying indices. Satisficing is responding to items with less than optimal efforts. It is detectable by building instructional manipulation checks or bogus items into the test. A response style is a typical way of taking a test. Plodding is a style where test takers start slowly and take much time to answer items. It is counteracted by informing test takers on the amount of time and number of items that remain. Fumbling is a style where test takers start rather panicky. It cannot be prevented, but testing should be less panic arousing as possible. The extremity and midpoint styles are the tendencies to choose extreme and midpoint answer categories, respectively. Acquiescence and dissentience are tendencies of yea- and nay-saying, respectively, and are detectable if the test is balanced (i.e., has about equal numbers of indicative and contra-indicative items). Satisficing and fumbling yield aberrant response patterns and acquiescence and dissentience aberrant response patterns at balanced tests that are detectable by person-fit indices. Item nonresponse is the tendency to skip items. It is reduced by computerized test administration and re-approaching test takers who omitted items. These styles and tendencies are sometimes person characteristics that are of interest of their own. Deleting test takers who show styles or tendencies yields missing data that have to be handled in the analysis of the data (see Chap.  16).

Keywords

Acquiescence and dissentience Cheating Extremity and midpoint response styles Fumbling Impression management Item missingness Person fit Plodding Satisficing 

References

  1. Beach, D. A. (1989). Identifying the random responder. The Journal of Psychology, 123, 101–103.CrossRefGoogle Scholar
  2. Couch, A., & Keniston, K. (1960). Yeasayers and naysayers: Agreeing response set as a personality variable. Journal of Abnormal and Social Psychology, 60, 151–174.CrossRefGoogle Scholar
  3. de Vries, A. L. M. (2006). The merit of ipsative measurement. Unpublished doctoral dissertation. The Netherlands, Maastricht: University.Google Scholar
  4. DuBois, P. H. (1970). A history of psychological testing. Boston: Allyn and Bacon.Google Scholar
  5. Guttman, L. (1950). The basis for scalogram analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & J. A. Clausen (Eds.), Measurement and prediction (pp. 60–90). Princeton, NJ: Princeton University Press.Google Scholar
  6. Huisman, M., Krol, B., & van Sonderen, F. L. P. (1998). Handling missing data by re-approaching nonrespondents. Quality & Quantity, 32, 77–91.CrossRefGoogle Scholar
  7. Krosnick, J. A., & Presser, S. (2010). Questions and questionnaire design. In P. V. Marsden & J. D. Wright (Eds.), Handbook of survey research (2nd ed., pp. 263–313). Bingley, UK: Emerald.Google Scholar
  8. Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17, 437–455.CrossRefGoogle Scholar
  9. Meijer, R. R. (1994). The number of Guttman errors as a simple and powerful person-fit statistic. Applied Psychological Measurement, 18, 311–314.CrossRefGoogle Scholar
  10. Meijer, R. R., & Sijtsma, K. (2001). Methodology review: Evaluating person fit. Applied Psychological Measurement, 25, 107–135.CrossRefGoogle Scholar
  11. Mellenbergh, G. J. (2011). A conceptual introduction to psychometrics: Development, analysis, and application of psychological and educational tests. The Hague, The Netherlands: Eleven International Publishing.Google Scholar
  12. Miyazaki, I. (1963/1981). China’s examination hell (C. Schirokauer). New Haven, CT: Yale University Press.Google Scholar
  13. Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45, 867–872.CrossRefGoogle Scholar
  14. Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46, 598–609.CrossRefGoogle Scholar
  15. Rorer, L. G. (1965). The great response-style myth. Psychological Bulletin, 63, 129–156.CrossRefGoogle Scholar
  16. Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory. Thousand Oaks, CA: Sage.CrossRefGoogle Scholar
  17. Sotaridona, L. S., van der Linden, W. J., & Meijer, R. R. (2006). Detecting answer copying using statistic kappa. Applied Psychological Measurement, 30, 412–431.CrossRefGoogle Scholar
  18. Wollack, J. A. (2006). Simultaneous use of multiple answer copying indexes to improve detection rates. Applied Measurement in Education, 19, 265–288.CrossRefGoogle Scholar
  19. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: Mesa Press.Google Scholar
  20. Zopluogo, C. (2013). CopyDetect: An R package for computing statistical indices to detect answer copying on multiple-choice examinations. Applied Psychological Measurement, 37, 93–95.CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Emeritus Professor Psychological Methods, Department of PsychologyUniversity of AmsterdamAmsterdamThe Netherlands

Personalised recommendations