Advertisement

Quality & Quantity

, Volume 46, Issue 6, pp 1883–1896 | Cite as

An evaluation of the validity of the Crowne–Marlowe need for approval scale

  • Timothy P. Johnson
  • Michael Fendrich
  • Mary Ellen Mackesy-Amiti
Article

Abstract

Over the past four decades, research has consistently documented negative correlations between the Crowne–Marlowe (CM) social desirability trait scale and numerous measures of sensitive behaviors, conditions, and opinions. These findings have been interpreted as evidence that persons with self-presentation concerns tend to under-report negative information. In contrast to this classic social desirability interpretation, a second perspective, labeled the true-behavior hypothesis, maintains that these correlations in fact reflect accurate reporting of both sets of variables, suggesting that the CM scale is not a sensitive indicator of the social desirability trait. We test these alternative interpretations by examining data from a community survey that collected both self-reports of cocaine use and the biological specimens necessary to validate the self-reports. In bivariate analyses, the CM scale was found to be associated with the concordance of cocaine use reporting and biological assays in a manner consistent with the classic social desirability hypothesis. The CM scale was not found to be associated with actual cocaine use, as measured by drug test assays, a finding inconsistent with the true-behavior hypothesis. After adjusting for other known correlates of substance use in logistic regression models, the CM scale was not associated with cocaine use under-reporting, nor with actual cocaine use behavior. Until further evidence is available, we conclude that the CM may be a questionable indicator of socially desirable reporting behavior in social surveys.

Keywords

Social desirability Crowne–Marlowe scale Validation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. American Association for Public Opinion Research.: Standard Definitions: Final Dispositions of Case Codes and Outcomes for Surveys. Ann Arbor, Michigan: American Association for Public Opinion Research (2000)Google Scholar
  2. Barger S. D.: The Marlowe–Crowne affair: short forms, psychometric structure, and social desirability. J. Pers. Assess. 79, 286–305 (2002)CrossRefGoogle Scholar
  3. Beretvas S. N., Meyers J. L., Leite W. L.: A reliability generalization study of the Marlowe–Crowne social desirability scale. Educ. Psychol. Meas. 62, 570–589 (2002)CrossRefGoogle Scholar
  4. Bishop G. F., Tuchfarber A. J., Oldendick R. W.: Opinions on fictitious issues: the pressure to answer survey questions. Public Opin. Q. 50, 240–250 (1986)CrossRefGoogle Scholar
  5. Bonczar, T. P., Beck, A. J.: Lifetime Likelihood of Going to State or Federal Prison. Special Report, U.S. Department of Justice, Office of Justice Programs, Bureau of Justice Statistics, Washington, DC (1997). Retrieved October 6, 2003 from http://www.ojp.usdoj.gov/bjs/pub/pdf/llgsfp.pdf
  6. Bradburn N. M., Sudman Seymour and Associates: Reinterpreting the Marlowe-Crown scale. In: Bradburn, N. M. (ed.) Improving Interview Method and Questionnaire Design. Seymour Sudman and Associates, pp. 85–106. Jossey-Bass, San Francisco (1979)Google Scholar
  7. Bryant B. E.: Respondent selection in a time of changing household composition. J. Mark. Res. 12, 129–135 (1975)CrossRefGoogle Scholar
  8. Carr L. G., Krause N.: Social status, psychiatric symptomatology, and response bias. J. Health Soc. Behav. 19, 86–91 (1978)CrossRefGoogle Scholar
  9. Carstensen L. L., Cone J. D.: Social desirability and the measurement of psychological well-being in elderly persons. J. Pers. 38, 713–715 (1983)Google Scholar
  10. Ceci S. J.: How much does schooling influence general intelligence and its cognitive components? A reassessment of the evidence. Dev. Psychol. 27, 703–722 (1991)CrossRefGoogle Scholar
  11. Cicourel A. V.: Method and Measurement in Sociology. Free Press, New York (1964)Google Scholar
  12. Cone E. J.: New developments in biological measures of drug prevalence. In: Harrison, L., Hughes, A. (eds) The Validity of Self-Reported Drug Use: Improving the Accuracy of Survey Estimates, pp. 108–129. National Institute on Drug Abuse, Rockville (1997)Google Scholar
  13. Couper M. P., Singer E., Tourangeau R.: Understanding the effects of audio-CASI on self-reports of sensitive behavior. Public Opin. Q. 67, 396–406 (2003)CrossRefGoogle Scholar
  14. Crowne D. P., Marlowe D.: A new scale of social desirability independent of psychopathology. J. Consult. Psychol. 24, 349–354 (1960)CrossRefGoogle Scholar
  15. Crowne D. P., Marlowe D.: The Approval Motive. Wiley, New York (1964)Google Scholar
  16. DeMaio T. J.: Social Desirability and Survey Measurement: A Review. In: Turner, C., Martin, E. (eds) Surveying Subjective Phenomena, pp. 257–282. Russell Sage, New York (1984)Google Scholar
  17. Dijkstra W., Smit J. H., Comijs H. C.: Using social desirability scales in research among the elderly. Qual. Quan. 35, 107–115 (2001)CrossRefGoogle Scholar
  18. Edwards A. L.: The Social Desirability Variable in Personality Assessment and Research. Dryden Press, New York (1957)Google Scholar
  19. Fendrich M., Johnson T. P., Sudman S., Wislar J., Spiehler V.: Validity of drug use reporting in a high-risk community sample: a comparison of cocaine and heroin survey reports with hair tests. Am. J. Epidemiol. 149, 955–962 (1999)CrossRefGoogle Scholar
  20. Fleiss, J. L.: Statistical Methods for Rates and Proportions. 2nd edn. Wiley, New York (1981)Google Scholar
  21. Gick M., McLeod C., Hulihan D.: Absorption, social desirability, and symptoms in a behavioral medicine population. J. Nerv. Ment. Dis. 185, 454–458 (1997)CrossRefGoogle Scholar
  22. Gove W. R., McCorkel J., Fain T., Hughes M. D.: Response bias in community surveys of mental health: systematic bias or random noise?. Soc. Sci. Med. 10, 497–502 (1976)CrossRefGoogle Scholar
  23. Groves R. M., Couper M. P.: Nonresponse in Household Interview Surveys. Wiley, New York (1998)CrossRefGoogle Scholar
  24. Hser Y.-I.: Self-reported drug use: results of selected empirical investigations of validity. In: Harrison, L., Hughes, A. (eds) The Validity of Self-Reported Drug Use: Improving the Accuracy of Survey Estimates, pp. 320–343. National Institute on Drug Abuse, Rockville (1997)Google Scholar
  25. Johnson T. P., Bowman P. J.: Cross-cultural sources of measurement error in substance use surveys. Subst. Use Misuse 38, 1447–1490 (2003)CrossRefGoogle Scholar
  26. Klassen D., Hornstra R. K., Anderson P. B.: Influence of social desirability on symptom and mood reporting in a community survey. J. Consult. Clin. Psychol. 43, 448–452 (1975)CrossRefGoogle Scholar
  27. Kozma A., Stones M. J.: Social desirability in measures of subjective well-being: a systematic evaluation. J. Gerontol. 42, 56–59 (1987)Google Scholar
  28. Krosnick J. A.: The impact of cognitive sophistication and attitude importance on response-order and question-order effects. In: Schwarz, N., Sudman, S. (eds) Context Effects in Social and Psychological Research, pp. 203–218. Springer-Verlag, New York (1992)CrossRefGoogle Scholar
  29. Levy P. S., Lemeshow S.: Sampling of Populations. Methods and Applications. Wiley, New York (1991)Google Scholar
  30. Linehan M. M., Nielson S. L.: Social desirability: its relevance to the measurement of hopelessness and suicidal behavior. J. Consult. Clin. Psychol. 51, 141–143 (1983)CrossRefGoogle Scholar
  31. McCrae R. R.: Well-being scales do not measure social desirability. J. Gerontol. 41, 390–392 (1986)Google Scholar
  32. McCrae, R. R., Costa, P. T. Jr.: Social desirability scales: more substance than style. J. Consult. Clin. Psychol. 51, 882–888 (1983)CrossRefGoogle Scholar
  33. Magura S., Kang S.-Y.: The validity of self-reported drug use in high risk populations: a meta-analytic review. Subst. Use Misuse 31, 1131–1153 (1996)CrossRefGoogle Scholar
  34. Moorman R. H., Podsakoff P. M.: A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behaviour research. J. Occup. Organ. Psychol. 65, 131–149 (1992)CrossRefGoogle Scholar
  35. Narayan S., Krosnick J. A.: Education moderates some response effects in attitude measurement. Public Opin. Q. 60, 58–88 (1996)CrossRefGoogle Scholar
  36. Office of Applied Studies: Summary of Findings from the 1999 National Household Survey on Drug Abuse. DHHS Publication No. SMA 00-3466, NHSDA Series H-12. Rockville, MD: Substance Abuse and Mental Health Services Administration (2000)Google Scholar
  37. Office of Applied Studies: Development of Computer-Assisted Interviewing Procedures for the National Household Survey on Drug Abuse. DHHS Publication No. SMA 01-3514, Methodology Series: M-3. Rockville, MD: Substance Abuse and Mental Health Services Administration (2001)Google Scholar
  38. Paulhus D. L.: Measurement and control of response bias. In: Robinson, J. P., Shaver, P. R. (eds) Measures of Personality and Social Psychological Attitudes, pp. 17–59. Academic Press, San Diego (1991)Google Scholar
  39. Paulhus D. L.: Paulhus Deception Scales (PDS): The Balanced Inventory of Desirable Responding-7, User’s Manual. Multi-Health Systems, Inc., North Tonawanda, NY (1998)Google Scholar
  40. Phillips D. L., Clancy K. J.: Response biases in field studies of mental illness. Am. Sociol. Rev. 35, 503–515 (1970)CrossRefGoogle Scholar
  41. Phillips D. L., Clancy K. J.: Some effects of ‘Social desirability’ in survey studies. AJS 77, 921–940 (1972)Google Scholar
  42. Pleck J. H., Sonenstein F. L., Ku L.: Black-white differences in adolescent males’ substance use: are they explained by underreporting by Blacks?. J. Gend. Cult. Health 1, 247–265 (1996)Google Scholar
  43. Roscoe M., Morton R.: “Disproportionate Minority Confinement.” Fact Sheet #11. U.S. Department of Justice, Office of Justice Programs, Office of Juvenile Justice and Delinquency Prevention, Washington, DC (1994). Retrieved from October 6, 2003 from http://www.ncjrs.org/txtfiles/fs-9411.txt
  44. Ross C. E., Mirowsky J.: The worst place and the best face. Soc. Forces 62, 529–536 (1983)Google Scholar
  45. Ross C. E., Mirowsky J.: Socially-desirable response and acquiescence in a cross-cultural survey of mental health. J. Health Soc. Behav. 25, 189–197 (1984)CrossRefGoogle Scholar
  46. Stone C.: Race, crime, and the administration of justice. Nat. Inst. Justice J. 239, 26–32 (1999)Google Scholar
  47. Strahan R., Gerbasi K. C.: Short, homogeneous versions of the Marlowe–Crowne social desirability scale. J. Clin. Psychol. 28, 191–193 (1972)CrossRefGoogle Scholar
  48. Strosahl K. D., Chiles J. A., Linehan M. M.: Will the real social desirability please stand up? Hopelessness, depression, social desirability, and the prediction of suicidal behavior. J. Consult. Clin. Psychol. 52, 449–457 (1984)CrossRefGoogle Scholar
  49. Tourangeau R., Smith T. W.: Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin. Q. 60, 275–304 (1996)CrossRefGoogle Scholar
  50. Turner C. F., Ku L., Rogers S. M., Lindberg L. D., Pleck J. H., Sonenstein F. L.: Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280, 867–873 (1998)CrossRefGoogle Scholar
  51. Warnecke R. B., Johnson T. P., Chavez N., Sudman S., O’Rourke D. P., Lacey L., Horm J.: Improving question wording in surveys of culturally diverse populations. Ann. Epidemiol. 7, 334–342 (1997)CrossRefGoogle Scholar
  52. Watten R. G.: Coping styles in abstainers from alcohol. Psychopathology 29, 340–346 (1996)CrossRefGoogle Scholar
  53. Welte J. W., Russell M.: Influence of socially desirable responding in a study of stress and substance abuse. Alcohol. Clin. Exp. Res. 17, 758–761 (1993)CrossRefGoogle Scholar
  54. Wolff K., Farrell M., Marsden J., Montiero M. G., Ali R., Welch S., John S.: A review of biological indicators of illicit drug use, practical considerations and clinical usefulness. Addiction 94, 1279–1298 (1999)CrossRefGoogle Scholar
  55. Yoshino A., Kato M.: Influence of social desirability response set on self-report for assessing the outcome of treated alcoholics. Alcohol. Clin. Exp. Res. 19, 1517–1519 (1995)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Timothy P. Johnson
    • 1
  • Michael Fendrich
    • 2
  • Mary Ellen Mackesy-Amiti
    • 3
  1. 1.Survey Research Laboratory, Department of Public AdministrationUniversity of Illinois at ChicagoChicagoUSA
  2. 2.Center for Addiction and Behavioral Health Research, Helen Bader School of Social WelfareUniversity of Wisconsin-MilwaukeeMilwaukeeUSA
  3. 3.Division of Epidemiology and Biostatistics, School of Public HealthUniversity of Illinois at ChicagoChicagoUSA

Personalised recommendations