Skip to main content

Social Desirability Bias in Self-reports of Physical Activity: Is an Exercise Identity the Culprit?

Social Indicators Research volume 117, pages 489–504 (2014)Cite this article

Abstract

Like that of other normative behaviors, much of the research on physical exercise is based on self-reports that are prone to overreporting. While research has focused on identifying the presence and degree of overreporting, this paper fills an important gap by investigating its causes. The explanation based in impression management will be challenged, using an explanation based in identity theory as an arguably better fitting alternative. Respondents were randomly assigned to one of two conditions: (1) a web instrument using direct survey questions, or (2) a chronological reporting procedure using text messaging. Comparisons to validation data from a reverse record check indicate significantly greater rates of overreporting in the web condition than in the text condition. Results suggest that measurement bias is associated with the importance of the respondents’ exercise identity, prompted by the directness of the conventional survey question. Findings call into question the benefit of self-administration for bias reduction in measurement of normative behaviors.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Notes

  1. That said, there is potential in this design and future research should consider it further.

  2. All response rates are computed as AAPOR RR 5; there were no ineligible cases nor any cases of unknown eligibility.

  3. This question was preceded with the more general question, “In the past 7 days, how many days have you worked out or exercised?” The intent of this more general question was to achieve less biased measurement of campus recreational sports facility use by allowing the respondent to claim exercise behavior even if it did not occur at campus recreational sports facilities.

  4. Some amount of underreporting is inevitable as respondents forget to report activities. The rate of underreporting does not differ between conditions (10 and 4 % in the text and web modes, respectively; χ2(1) = 2.06; p = 0.15), suggesting that underreporting is not attributable to the characteristics of the mode. As is not a focus of this study, it will not be discussed further here.

  5. Comparisons will be made for both the full sample and for Condition 1. Results are not available for Condition 2 separately given the negligible number of overreporters in this condition.

  6. Although t test comparing these means comes to the same conclusion, they are not preferred as the dependent variables are not normally distributed. Comparisons using t-tests match the results of all subsequent Mann–Whitney–Wilcoxon tests.

  7. There is, of course, nothing natural about a week. Unlike the day, month, and year, the week is perhaps the most socially-constructed unit of time (Zerubavel 1989).

References

  • Adams, S. A., Matthews, C. E., Ebbeling, C. B., Moore, C. G., Cunningham, J. E., Fulton, J., et al. (2005). The effect of social desirability and social approval on self-reports of physical activity. American Journal of Epidemiology, 161(4), 389–398.

    Article  Google Scholar 

  • Ainsworth, B. E., Jacobs, D. R., & Leon, A. S. (1993). Validity and reliability of self-reported physical activity status: the Lipid Research Clinics questionnaire. Medicine and Science in Sports and Exercise, 25(1), 92–98.

    Article  Google Scholar 

  • Albanes, D., Conway, J. M., Taylor, P. R., Moe, P. W., & Judd, J. (1990). Validation and comparison of eight physical activity questionnaires. Epidemiology, 1(1), 65–71.

    Article  Google Scholar 

  • Aquilino, W. S., & LoSciuto, L. (1990). Effects of interview mode on self-reported drug use. Public Opinion Quarterly, 54(3), 362–395.

    Article  Google Scholar 

  • Baranowski, T. (1988). Validity and reliability of self report measures of physical activity: An information-processing perspective. Research Quarterly for Exercise and Sport, 59(4), 314–327.

    Article  Google Scholar 

  • Bassett, D. R. (2000). Validity and reliability issues in objective monitoring of physical activity. Research Quarterly for Exercise and Sport, 71(2 Supplement), S30–S36.

    Google Scholar 

  • Belli, R. F., Traugott, M. W., Young, M., & McGonagle, K. A. (1999). Reducing vote overreporting in surveys: Social desirability, memory failure, and source monitoring. Public Opinion Quarterly, 63(1), 90–108.

    Article  Google Scholar 

  • Bernstein, R., Chadha, A., & Montjoy, R. (2001). Overreporting voting: Why it happens and why it matters. Public Opinion Quarterly, 65(1), 22–44.

    Article  Google Scholar 

  • Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579–616.

    Article  Google Scholar 

  • Brenner, P. S. (2011). Identity importance and the overreporting of religious service attendance: Multiple imputation of religious attendance using the american time use study and the general social survey. Journal for the Scientific Study of Religion, 50(1), 103–115.

    Article  Google Scholar 

  • Brenner, P. S., & DeLamater, J. D. (2013). Paradata correlates of data quality in an SMS time use study: Evidence from a validation study. Center for Demography and Ecology Working Paper No. 2013-03. University of Wisconsin-Madison. http://www.ssc.wisc.edu/cde/cdewp/2013-02.pdf. Accessed 29 May 2013.

  • Burke, P. J. (1980). The self: Measurement implications from a symbolic interactionist perspective. Social Psychology Quarterly, 43(1), 18–29.

    Article  Google Scholar 

  • Cannell, C. F., Marquis, K. H., & Laurent, A. (1977). A summary of studies of interviewing methodology. Vital and Health Statistics, Series 2, 1–68.

    Google Scholar 

  • Cannell, C. F., Miller, P. V., & Oksenberg, L. (1981). Research on interviewing techniques. Sociological Methodology, 11, 389–437.

    Article  Google Scholar 

  • Chase, D. R., & Godbey, G. C. (1983). The accuracy of self-reported participation rates. Leisure Studies, 2(2), 231–235.

    Google Scholar 

  • Chaves, M., & Stephens, L. (2003). Church attendance in the United States. In M. Dillon (Ed.), Handbook of the Sociology of Religion (pp. 85–95). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease, 175(9), 526–536.

    Article  Google Scholar 

  • Durante, R., & Ainsworth, B. E. (1996). The recall of physical activity: Using a cognitive model of the question-answering process. Medicine and Science in Sports and Exercise, 28(10), 1282–1291.

    Article  Google Scholar 

  • Ervin, L. H., & Stryker, S. (2001). Theorizing the relationship between self-esteem and identity. In T. J. Owens, S. Stryker, & N. Goodman (Eds.), Extending self-esteem theory and research: sociological and psychological currents (pp. 29–55). New York: Cambridge University Press.

    Chapter  Google Scholar 

  • Groves, R. M. (1989/2004). Survey errors and survey costs. New York: Wiley.

  • Hadaway, C. K., Marler, P. L., & Chaves, M. (1998). Overreporting church attendance in America: Evidence that demands the same verdict. American Sociological Review, 63(1), 122–130.

    Article  Google Scholar 

  • Jacobs, D. R., Ainsworth, B. E., Hartman, T. J., & Leon, A. S. (1993). A simultaneous evaluation of 10 commonly used physical activity questionnaires. Medicine and Science in Sports and Exercise, 25(1), 81–91.

    Article  Google Scholar 

  • Klesges, R. C., Eck, L. H., Mellon, M. W., Fulliton, W., Somes, G. W., & Hanson, C. L. (1990). The accuracy of self-reports of physical activity. Medicine and Science in Sports and Exercise, 22(5), 690–697.

    Article  Google Scholar 

  • Kreuter, F., Presser, S., & Tourangeau, R. (2008). Social desirability bias in CATI, IVR, and web surveys: The effects of mode and question sensitivity. Public Opinion Quarterly, 72(5), 847–865.

    Article  Google Scholar 

  • Leenders, N. Y. J. M., Sherman, W. M., Nagaraja, H. N., & Kien, C. L. (2001). Evaluation of methods to access physical activity in free-living conditions. Medicine and Science in Sports and Exercise, 33(7), 1233–1240.

    Google Scholar 

  • Matthews, C. E., & Freedson, P. S. (1995). Field trial of a three-dimensional activity monitor: Comparison with self-report. Medicine and Science in Sports and Exercise, 27(7), 1071–1078.

    Article  Google Scholar 

  • Matthews, C. E., Freedson, P. S., Hebert, J. R., Stanek, E. J., I. I. I., Merriam, P. A., & Ockene, I. S. (2000). Comparing physical activity assessment methods in the Seasonal Variation of Blood Cholesterol Study. Medicine and Science in Sports and Exercise, 32(5), 976–984.

    Google Scholar 

  • Motl, R. W., McAuley, E., & DiStefano, C. (2005). Is social desirability associated with self-reported physical activity? Preventative Medicine, 40(6), 735–739.

    Article  Google Scholar 

  • Niemi, I. (1993). Systematic error in behavioral measurement: Comparing results from interview and time budget studies. Social Indicators Research, 30(2–3), 229–244.

    Article  Google Scholar 

  • Patterson, P. (2000). Reliability, validity, and methodological response to the assessment of physical activity via self-report. Research Quarterly for Exercise and Sport, 71(2 Supplement), 15–20.

    Google Scholar 

  • Robinson, J. P. (1985). The validity and reliability of diaries versus alternative time use measures. In F. T. Juster & F. P. Stafford (Eds.), Time, goods, and well-being (pp. 33–62). Ann Arbor, MI: Institute for Social Research.

    Google Scholar 

  • Robinson, J. P. (1999). The time-diary method: Structure and uses. In W. E. Pentland, A. S. Harvey, M. P. Lawton, & M. A. McColl (Eds.), Time use research in the social sciences (pp. 47–90). New York: Klewer/Plenum.

    Google Scholar 

  • Rzewnicki, R., Vanden Auweele, Y., & De Bourdeaudhuij, I. (2003). Addressing overreporting on the International Physical Activity Questionnaire (IPAQ) telephone survey with a population sample. Public Health Nutrition, 6(3), 299–305.

    Google Scholar 

  • Sallis, J. F., & Saelens, B. E. (2000). Assessment of physical activity by self-reports: Status, limitations, and future directions. Research Quarterly for Exercise and Sport, 71(2 Supplement), 1–14.

    Google Scholar 

  • Schuman, H. (1982). Artifacts are in the eye of the beholder. American Sociologist, 17(1), 21–28.

    Google Scholar 

  • Shephard, R. J. (2003). Limits to the measurement of habitual physical activity by questionnaires. British Journal of Sports Medicine, 37(3), 197–206.

    Google Scholar 

  • Stinson, L. L. (1999). Measuring how people spend their time: A time use survey design. Monthly Labor Review, 122(1), 12–19.

    Google Scholar 

  • Stocké, V. (2007). Response privacy and elapsed time since election day as determinants for vote overreporting. International Journal of Public Opinion Research, 19(2), 237–246.

    Article  Google Scholar 

  • Stryker, S. (1980/2003). Symbolic interactionism: A social structural version. Caldwell, NJ: The Blackburn Press.

  • Stryker, S., & Burke, P. J. (2000). The past, present, and future of an identity theory. Social Psychology Quarterly, 63(4), 284–297.

    Article  Google Scholar 

  • Stryker, S., & Serpe, R. T. (1982). Commitment, identity salience, and role behavior: Theory and research example. In W. Ickes & E. S. Knowles (Eds.), Personality, roles, and social behavior (pp. 199–218). New York: Springer.

    Chapter  Google Scholar 

  • Stryker, S., & Serpe, R. T. (1994). Identity salience and psychological centrality: Equivalent, overlapping, or complimentary concepts? Social Psychology Quarterly, 57(1), 16–35.

    Article  Google Scholar 

  • Taylor, C. B., Coffey, T., Berra, K., Iaffaldano, R., & Casey, K. (1984). Seven-day activity and self-report compared to a direct measure of physical activity. American Journal of Epidemiology, 120(6), 818–820.

    Google Scholar 

  • Tourangeau, R. (1984). Cognitive science and survey methods. In T. Jabine, M. Straf, J. Tanur, & R. Tourangeau (Eds.), Cognitive aspects of survey design: Building a bridge between disciplines. Washington, DC: National Academy Press.

    Google Scholar 

  • Tourangeau, R., Rips, L. J., & Rasinski, K. A. (2000). The psychology of survey response. New York: Cambridge University Press.

    Book  Google Scholar 

  • U.S. Department of Health and Human Services. (2008). 2008 Physical activity guidelines for Americans. Office of Disease Prevention and Health Promotion, ODPHP U0036.

  • Washburn, R., Heath, G. W., & Jackson, A. W. (2000). Reliability and validity issues concerning large-scale surveillance of physical activity. Research Quarterly for Exercise and Sport, 71(2 Supplement), 104–113.

    Google Scholar 

  • Weisberg, H. F. (2005). The total survey error approach: A guide to the new science of survey research. Chicago: University of Chicago Press.

    Book  Google Scholar 

  • Williams, E., Klesges, R. C., Hanson, C. L., & Eck, L. (1989). A prospective study of the reliability and convergent validity of three physical activity measures in a field research trial. Journal of Clinical Epidemiology, 42(12), 1161–1170.

    Article  Google Scholar 

  • Woodberry, R. D. (1998). When surveys lie and people tell the truth: How surveys oversample church attenders. American Sociological Review, 63(1), 119–121.

    Article  Google Scholar 

  • Zerubavel, E. (1989). The seven day circle: The history and meaning of the week. Chicago: University of Chicago Press.

    Google Scholar 

  • Zuzanek, J., & Smale, B. J. A. (1999). Life-cycle and across-the-week allocation of time to daily activities. In W. E. Pentland, A. S. Harvey, M. P. Lawton, & M. A. McColl (Eds.), Time use research in the social sciences (pp. 127–154). New York: Klewer/Plenum.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Sociology, Center for Survey Research, University of Massachusetts, Boston, 100 Morrissey Blvd., Boston, MA, 02125, USA

    Philip S. Brenner

  2. Department of Sociology, University of Wisconsin, Madison, 1180 Observatory Drive, Madison, WI, 53706, USA

    John D. DeLamater

Authors
  1. Philip S. Brenner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. John D. DeLamater
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Philip S. Brenner.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Brenner, P.S., DeLamater, J.D. Social Desirability Bias in Self-reports of Physical Activity: Is an Exercise Identity the Culprit?. Soc Indic Res 117, 489–504 (2014). https://doi.org/10.1007/s11205-013-0359-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-013-0359-y

Keywords

  • Survey research
  • Measurement
  • Social desirability bias
  • Identity
  • Exercise