Abstract
In this study, a new item response theory model is developed to account for situations in which respondents overreport or underreport their actual opinions on a positive or negative issue. Such behavior is supposed to be a result of deception and transfer mechanisms. In the proposed model, this behavior is simulated by incorporating a deception term into a multidimensional rating scale model, followed by multiplication by a transfer term, with the two operations performed by an indicator function and a transition matrix separately. The proposed model is presented in a Bayesian framework approximated by Markov chain Monte Carlo algorithms. Through a series of simulations, the parameters of the proposed model are recovered accurately. The methodology is also implemented within an online experimental study to demonstrate the methodology’s application.
Similar content being viewed by others
References
Abelson, R. P., Loftus, E. F., & Greenwald, A. G. (1992). Attempts to improve the accuracy of selfreports of voting. In J. M. Tanur (Ed.), Questions about Questions (pp. 138–153). New York: Russell Sage Foundation.
Bäckström, M., & Björklund, F. (2013). Social desirability in personality inventories: Symptoms, diagnosis and prescribed cure. Scandinavian Journal of Psychology, 54(2), 152–159.
Belli, R. F., Traugott, M. W., Young, M., & McGonagle, K. A. (1999). Reducing vote overreporting in surveys: Social desirability, memory failure, and source monitoring. The Public Opinion Quarterly, 63(1), 90–108.
Böckenholt, U. (2014). Modeling motivated misreports to sensitive survey questions. Psychometrika, 79(3), 515–537.
Brooks, S. P., & Gelman, A. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7(4), 434–455.
Brown, J. D. (1986). Evaluations of self and others: Self-enhancement biases in social judgments. Social Cognition, 4(4), 353–376.
Buss, A. H., & Perry, M. (1992). The aggression questionnaire. Journal of Personality and Social Psychology, 63(3), 452–459.
Chan, J. C.-C., & Jeliazkov, I. (2009). MCMC estimation of restricted covariance matrices. Journal of Computational and Graphical Statistics, 18(2), 457–480.
Cronbach, L. J. (1950). Further evidence on response sets and test design. Educational and Psychological Measurement, 10(1), 3–31.
Dwyer, J., Krall, E., & Coleman, K. (1987). The problem of memory in nutritional epidemiology research. Journal of the American Dietetic Association, 87, 1509–1512.
Emmons, R. A. (1984). Factor analysis and construct validity of the narcissistic personality inventory. Journal of Personality Assessment, 48(3), 291–300.
Fenigstein, A., Scheier, M. F., & Buss, A. H. (1975). Public and private self-consciousness: Assessment and theory. Journal of Consulting and Clinical Psychology, 43(4), 522–527.
Fisher, R. J. (1993). Social desirability bias and the validity of indirect questioning. Journal of Consumer Research, 20(2), 303–315.
Friedenreich, C. M., Slimani, N., & Riboli, E. (1992). Measurement of past diet: Review of previous and proposed methods. Epidemiologic Reviews, 14(1), 177–196.
Ganster, D. C., Hennessey, H. W., & Luthans, F. (1983). Social desirability response effects: Three alternative models. Academy of Management Journal, 26(2), 321–331.
Goldberg, L. R. (1992). The development of markers for the big-five factor structure. Psychological Assessment, 4(1), 26–42.
Harris, J. A. (1997). A further evaluation of the aggression questionnaire: Issues of validity and reliability. Behaviour Research and Therapy, 35(11), 1047–1053.
Hebert, J. R., Ma, Y., Clemow, L., Ockene, I. S., Saperia, G., Stanek, E. J, I. I. I., et al. (1997). Gender differences in social desirability and social approval bias in dietary self-report. American Journal of Epidemiology, 146(12), 1046–1055.
Holtgraves, T. (2004). Social desirability and self-reports: Testing models of socially desirable responding. Personality and Social Psychology Bulletin, 30(2), 161–172.
Jobe, J. B., & Mingay, D. J. (1989). Cognitive research improves questionnaires. American Journal of Public Health, 79(8), 1053–1055.
Kang, T., & Chen, T. T. (2008). Performance of the generalized s-x2 item fit index for polytomous irt models. Journal of Educational Measurement, 454, 391–406.
Krueger, J. (1998). Enhancement bias in descriptions of self and others. Personality and Social Psychology Bulletin, 24(5), 505–516.
Lang, F. R., John, D., Lüdtke, O., Schupp, J., & Wagner, G. G. (2011). Short assessment of the big five: Robust across survey methods except telephone interviewing. Behavior Research Methods, 432, 548–567.
Leary, M., & Kowalski, R. (1990). Impression management: A literature review and two-component model. Psychological Bulletin, 107(1), 34–47.
Mesmer-Magnus, J., Viswesvaran, C., Deshpande, S., & Jacob, J. (2006). Social desirability: The role of over-claiming, self-esteem, and emotional intelligence. Psychological Test and Assessment Modeling, 48(3), 336–356.
Mick, D. G. (1996). Are studies of dark side variables confounded by socially desirable responding? The case of materialism. Journal of Consumer Research, 23(2), 106–119.
Milgram, S. (1963). Behavioral study of obedience. The Journal of Abnormal and Social Psychology, 67(4), 371–378.
Moorman, R. H., & Podsakoff, P. M. (1992). A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research. Journal of Occupational and Organizational Psychology, 65(2), 131–149.
Morand, C., Young, S. N., & Ervin, F. R. (1983). Clinical response of aggressive schizophrenics to oral tryptophan. Biological Psychiatry, 18(5), 575–578.
Nadler, A., Goldberg, M., & Jaffe, Y. (1982). Effect of self-differentiation and anonymity in group on deindividuation. Journal of Personality and Social Psychology, 42(6), 1127–1136.
Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598–609.
Paulhus, D. L. (1986). Self-deception and impression management in test responses. In A. Angleitner & J. S. Wiggins (Eds.), Personality assessment via questionnaires (pp. 143–165). New York: Springer.
Paulhus, D. L. (1993). Bypassing the will: The automatization of affirmations. In D. Wegner & J. Pennebaker (Eds.), Century psychology series. Handbook of mental control (pp. 573–587). Englewood Cliffs, NJ: Prentice-Hall Inc.
Paulhus, D. L. (2002). Social desirable responding: The evolution of a construct. In H. I. Braun, D. N. Jackson, & D. E. Wiley (Eds.), The role of constructs in psychological and educational measurement (pp. 44–69). New Jersey: Erlbaum.
Paulhus, D. L., & John, O. P. (1998). Egoistic and moralistic biases in self-perception: The interplay of self-deceptive styles with basic traits and motives. Journal of Personality, 66(6), 1025–1060.
Thompson, F. E., Metzner, H. L., Lamphiear, D. E., & Hawthorne, V. M. (1990). Characteristics of individuals and long term reproducibility of dietary reports: The tecumseh diet methodology study. Journal of Clinical Epidemiology, 43(11), 1169–1178.
Uziel, L. (2010). Rethinking social desirability scales: From impression management to interpersonally oriented self-control. Perspectives on Psychological Science, 5(3), 243–262.
Williams, K. M., Paulhus, D. L., & Nathanson, C. (2002). The nature of over-claiming: Personality and cognitive factors. In Poster Presented at the 110th Annual Meeting of the American Psychological Association. Chicago, IL.
Zimbardo, P. G. (1969). The human choice: Individuation, reason, and order versus deindividuation, impulse, and chaos. Nebraska Symposium on Motivation, 17, 237–307.
Acknowledgements
This research was funded by the Ministry of Science and Technology, Taiwan (MOST 104-2410-H-002-059-MY2, MOST 106-2410-H-002-081-SSS, and MOST 108-2410-H-002-100-) for Grace Yao. We would like to thank Dr. Hsiu-Ting Yu, Dr. Yu-Wei Chang, and all the reviewers for giving valuable comments on this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This research was funded by Ministry of Science and Technology, Taiwan (MOST 104-2410- H-002-059-MY2 and MOST 106-2410-H-002-081-SSS) for the third author.
We would like to thank Dr. Hsiu-Ting Yu and Dr. Yu-Wei Chang for giving valuable comments on this paper.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Leng, CH., Huang, HY. & Yao, G. A Social Desirability Item Response Theory Model: Retrieve–Deceive–Transfer. Psychometrika 85, 56–74 (2020). https://doi.org/10.1007/s11336-019-09689-y
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11336-019-09689-y