Abstract
In comparison to conventional questionnaires, calendar interviews produce higher quality retrospective reports of factual information. This study sought to examine whether calendar interviews would also be advantageous in collecting retrospective reports of subjective assessment information. Respondents in a panel study were randomly assigned to either a calendar or conventional questionnaire method; both methods asked for retrospective reports on years in which disability was present and annual health status since young childhood. Panel data served as a source of validation for the retrospective reports. Both methods tended to underreport the number of years disabled and yielded mean levels of better annual health status in comparison to the panel reports. Calendar interviews demonstrated higher quality retrospective reports for disability in yielding a significantly stronger correlation in the frequency of years being disabled and in providing a greater number of years of higher annual correspondence with the panel data in comparison to the conventional questionnaire. Calendar interviews also demonstrated the ability to preserve the slope of change associated with aging as seen in the panel data, whereas the conventional questionnaire led to a significantly shallower slope of change. This latter finding could not be explained by the presence of an acquiescence bias.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Abbreviations
- CQ:
-
Conventional questionnaire
- PSID:
-
Panel study of income dynamics
- NASIS:
-
Nebraska annual social indicators survey
References
Abelson R.P., Loftus E.F., Greenwald A.G.: Attempts to improve the accuracy of self-reports of voting. In: Tanur, J.M. (eds) Questions About Questions, pp. 138–153. Russell Sage Foundation, New York (1992)
Bailis D.S., Segall A., Chipperfield J.G.: Two views of self-rated general health status. Soc. Sci. Med. 56, 203–217 (2003)
Belli R.F.: The structure of autobiographical memory and the event history calendar: potential improvements in the quality of retrospective reports in surveys. Memory 6, 383–406 (1998)
Belli R.F., Callegaro M.: The emergence of calendar interviewing: a theoretical and empirical rationale. In: Belli, R.F., Stafford, F.P., Alwin, D.F. (eds) Calendar and Time Diary Methods in Life Course Research, pp. 31–52. Sage Publications, Thousands Oaks (2009)
Belli R.F., Smith L., Andreski P., Agrawal S.: Methodological comparisons between CATI event history calendar and conventional questionnaire instruments. Public Opin. Q. 71, 603–622 (2007)
Brown N.R.: Estimation strategies and the judgment of event frequency. J. Exp. Psychol. Learn. Mem. Cogn. 21, 1539–1553 (1995)
Callegaro, M., Yu, M., Cheng, F.-W., Liao, D., Belli, R.F.: Comparison of computerized event history calendar and question-list interviewing methods: a two year hospitalization history study. In: 2004 Proceedings of the American Statistical Association, 59th Annual conference of the American Association for Public Opinion Research, pp. 4746–4753. American Statistical Association, Alexandria (2005)
Chirikos T.N.: Accounting for the historical rise in work-disability prevalence. Milbank Q. 64, 271–301 (1986)
Couper M.P., Conrad F.G., Tourangeau R.: Visual context effects in web surveys. Public Opin. Q. 71, 623–634 (2007)
Converse J.M., Presser S.: Survey Questions: Handcrafting the Standardized Questionnaire. Sage Publications, Newbury Park (1986)
Idler E.L., Kasl S.: Health perceptions and survival: do global evaluations of health status really predict mortality. J. Gerontol. Soc. Sci. 46, S55–S65 (1991)
Jette A.M., Badley E.: Conceptual issues in the measurement of work disability. In: Mathiowetz, N., Wunderlich, G.S. (eds) Survey Measurement of Work Disability: A Workshop, pp. 4–27. National Academy Press, Washington (2000)
Kreider B.: Latent work disability and reporting bias. J. Hum. Resour. 34, 734–769 (1999)
Krosnick J.A.: Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5, 213–236 (1991)
Krosnick J.A.: Survey research. Annu. Rev. Psychol. 50, 537–567 (1999)
Mackenbach J.P., Siman J.G., Looman C.W.N., Jiung I.M.A.: Self-assessed health and mortality: could psychosocial factors explain the association?. Int. J. Epidemiol. 31, 1162–1168 (2002)
Mathiowetz N.: Methodological issues in the measurement of work disability. In: Mathiowetz, N., Wunderlich, G.S. (eds) Survey Measurement of Work Disability: A Workshop, pp. 28–52. National Academy Press, Washington (2000)
Menon G., Raghubir P., Schwarz N.: An accessibility-diagnosticity framework for behavioral frequency judgments. The use of response alternatives versus rates of occurrence as sources of information. J. Consum. Res. 22, 212–228 (1995)
Ross M.: The relation of implicit theories to the construction of personal histories. Psychol. Rev. 96, 341–357 (1989)
Sayles H., Belli R.F., Serrano E.: Interviewer variance between event history calendar and conventional questionnaire interviews. Public Opin. Q. 74, 140–153 (2010)
Schwarz N., Hippler H.J., Deutsch B., Strack F.: Response categories: effects on behavioral reports and comparative judgments. Public Opin. Q. 49, 388–395 (1985)
Schwarz N., Hippler H.J., Noelle-Neumann E.: A cognitive model of response order effects in survey measurement. In: Schwarz, N., Sudman, S. (eds) Context Eeffects in Social and Psychological Research, pp. 187–201. Springer-Verlag, New York (1992)
Schwarz N., Strack F., Mai H.P.: Assimilation and contrast effects in part-whole question sequences: a conversational logic analysis. Public Opin. Q. 55, 3–23 (1991)
Smyth J.D., Dillman D.A., Christian L.M., Stern M.J.: Comparing check-all and forced-choice question formats in web surveys. Public Opin. Q. 70, 66–77 (2006)
Stern S.: Measuring the effect of disability on labor force participation. J. Hum. Resour. 24, 361–395 (1989)
Sudman S., Bradburn N.M., Schwarz N.: Thinking about answers. Jossey-Bass, San Francisco (1996)
Tourangeau R.: Cognitive science and survey methods. In: Jabine, T., Straf, M., Tanur, J., Tourangeau, R. (eds) Cognitive Aspects of Survey Design: Building a Bridge between Disciplines, pp. 73–100. National Academy Press, Washingtron (1984)
Tourangeau R., Rasinski K.: Cognitive processes underlying context effects in attitude measurement. Psychol. Bull. 103, 299–314 (1988)
Tourangeau R., Rips L.J., Rasinski K.: The psychology of survey response. Cambridge University Press, Cambridge (2000)
Walker W.R., Skowronski J.J.: The fading affect bias: but what the hell is it for?. Appl. Cogn. Psychol. 23, 1122–1136 (2009)
Walker W.R., Vogl R.J., Thompson C.P.: Autobiographical memory: unpleasantness fades faster than pleasantness with time. Appl. Cogn. Psychol. 11, 399–413 (1997)
Yoshihama Mieko: Application of the life history calendar approach: understanding women’s experiences of intimate partner violence over the life course. In: Belli, R.F., Stafford, F.P., Alwin, D.F. (eds) Calendar and Time Diary Methods in Life Course Research, pp. 135–155. Sage Publications, Thousands Oaks (2009)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Belli, R.F., Agrawal, S. & Bilgen, I. Health status and disability comparisons between CATI calendar and conventional questionnaire instruments. Qual Quant 46, 813–828 (2012). https://doi.org/10.1007/s11135-010-9415-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-010-9415-8