Abstract
Recent multidimensional IRT models for response style (e.g., Falk and Cai (2016) Psychol Methods 21:328–347) allow items to vary in their sensitivities to response style traits. In this study, we use anchoring vignette data in which the vignettes have different expected response levels to examine the variation of extreme response style (ERS) discrimination in relation to this vignette feature. We find that vignettes targeted to the middle of the rating scale demonstrate systematically reduced ERS discrimination. The results suggest that models that assume constant response style discrimination across respondents with respect to ERS may be inaccurate, as a respondent’s tendency to select categories away from the middle category may be affected by the respondent’s content trait level. The results also appear supportive of IRT tree models for response style that often assume ERS tendencies are only invoked following an examinee’s decision to opt away from the middle rating scale category.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.
Bock, R. D. (1997). The nominal categories model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 33–49). New York: Springer.
Bolt, D. M., & Johnson, T. R. (2009). Addressing score bias and DIF due to individual differences in response style. Applied Psychological Measurement, 33, 335–352.
Bolt, D. M., Lu, Y., & Kim, J. S. (2014). Measurement and control of response styles using anchoring vignettes: A model-based approach. Psychological Methods, 19(4), 528–541.
Böckenholt, U. (2017). Measuring response styles in Likert items. Psychological Methods, 22(1), 69–83.
Chalmers, R. P., Pritikin, J., Robitzsch, A., Zoltak, M., Kim, K., Falk, C. F. et al. (2018). Mirt: Multidimensional item response theory. R package version 1.27.1.
Falk, C. F., & Cai, L. (2016). A flexible full-information approach to the modeling of response styles. Psychological Methods, 21, 328–347.
Mõttus, R., Allik, J., Realo, A., Pullman, H., Rossier, J., Zecca, J., Tseung, C. N. (2012). Comparability of self-reported conscientiousness across 20 countries. European Journal of Personality, 26, 307–317.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Zou, T., Bolt, D.M. (2021). Item Level Measurement of Extreme Response Style. In: Wiberg, M., Molenaar, D., González, J., Böckenholt, U., Kim, JS. (eds) Quantitative Psychology. IMPS 2020. Springer Proceedings in Mathematics & Statistics, vol 353. Springer, Cham. https://doi.org/10.1007/978-3-030-74772-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-74772-5_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-74771-8
Online ISBN: 978-3-030-74772-5
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)