Advertisement

Quality & Quantity

, Volume 47, Issue 2, pp 817–838 | Cite as

Improving retrospective life course data by combining modularized self-reports and event history calendars: experiences from a large scale survey

  • Katrin DraschEmail author
  • Britta Matthes
Article

Abstract

Event history calendars (EHC) have proven to be a powerful tool for collecting retrospective autobiographical life course data. One problem is that they are only standardized to a limited extent. This restricts their applicability in large-scale surveys. However, in such surveys, a modularized retrospective CATI design can be combined with an EHC. This data revision module is directly integrated into the interview and used as a data revision module, allowing insights from cognitive psychology to be applied. The data revision module stimulates the respondent’s memory retrieval by detecting both temporal inconsistencies, such as gaps, and overlapping or parallel events. This approach was implemented in the IAB-ALWA study (Working and Learning in a Changing World), a large-scale representative telephone survey involving 10,000 respondents. By comparing the uncorrected data with the final data after revision, we can investigate to what extent the application of this data revision module improves data quality or, more precisely, time consistency and dating accuracy of individual reports.

Keywords

Event history calendars Large-scale survey Retrospective life course reports Survey methodology 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Antoni, M., Drasch, K., Kleinert, C., Matthes, B., Ruland, M., Trahms, A.: Working and learning in a changing world. Part I: Overview of the study - March 2011 (second, updated version). FDZ Methodenreport 05/2010 (2010)Google Scholar
  2. Auriat N.: Who forgets? An analysis of memory effects in a retrospective survey on migration history. Eur. J. Popul. 7(4), 311–342 (1991)CrossRefGoogle Scholar
  3. Barclay C.: Schematization of autobiographical memory. In: Rubin, D.C. (eds) Autobiographical Memory., pp. 82–99. Cambridge University Press, Cambridge (1986)CrossRefGoogle Scholar
  4. Barsalou L.: The content and organization of autobiographical memories. In: Neisser, U., Winograd, E. (eds) Remembering Reconsidered: Ecological and Traditional Approaches to the Study of Memory, pp. 193–243. Cambridge University Press, New York (1988)CrossRefGoogle Scholar
  5. Belli R.F.: The structure of autobiographical memory and the event history calendar: potential improvements in the quality of retrospective reports in surveys. Memory 6(4), 383–406 (1998)CrossRefGoogle Scholar
  6. Belli R.F., Shay W.L., Stafford F.P.: Event history calendars and question list surveys: a direct comparison of interviewing methods. Public Opin. Q. 65(1), 45–74 (2001)CrossRefGoogle Scholar
  7. Belli R.F., Lee E.H., Stafford F.P., Chou C.: Calendar and question-list survey methods: association between interviewer behaviors and data quality. J. Official Stat. 20(2), 185–218 (2004)Google Scholar
  8. Belli R.F., Smith L.M., Andreski P.M., Agrawal S.: Methodological comparisons between CATI event history calendar and standardized conventional questionnaire instruments. Public Opin. Q. 71(4), 603–622 (2007)CrossRefGoogle Scholar
  9. Blossfeld H., Golsch K., Rohwer G.: Techniques of Event History Modeling Using Stata: New Approaches to Causal Analysis. Erlbaum, Mahwah (2007)Google Scholar
  10. Bradburn R.M.: Temporal representation and event dating. In: Stone, A.A., Turkkan, J.S., Bachrach, C.A., Jobe, J.B., Kurtzman, H.S., Cain, V.S. (eds) The Science of Self-Reports: Implications for Research and Practice., pp. 48–62. Erlbaum, Mahwah (2000)Google Scholar
  11. Conway M.A.: Autobiographical knowledge of autobiographical memory. In: Rubin, D.C. (eds) Remembering Our Past: Studies in Autobiographical Memory, pp. 67–93. Cambridge University Press, Cambridge (1996)CrossRefGoogle Scholar
  12. Conway M.A., Pleydell-Pearce C.W.: The construction of autobiographical memories in the self–memory system. Psychol. Rev. 107(2), 261–288 (2000)CrossRefGoogle Scholar
  13. Dex, S.: The reliability of recall data: a literature review. ISER working paper 1991-11 (1991)Google Scholar
  14. Dex S., McCulloch A.: The reliability of retrospective unemployment history data. Work Employ. Soc. 12(3), 497–509 (1998)Google Scholar
  15. Elias, P.: Who forgot they were unemployed? ISER working paper 1997-19 (1997)Google Scholar
  16. Freedman D., Thornton A., Camburn D., Alwin D., Young-DeMarco L.: The life history calendar: a technique for collecting retrospective data. Sociol. Methodol. 18, 37–68 (1988)CrossRefGoogle Scholar
  17. Glasner, T., van der Vaart, W.: Cognitive processes in event history calendar interviews: a verbal report analysis. In: Proceedings of the Seventh International Conference on Survey Methodology, Napels, Italy, 1–5 September (2008)Google Scholar
  18. Glasner T., van der Vaart W.: Applications of calendar instruments in social surveys: a review. Qual. Quant. 43(3), 333–349 (2009)CrossRefGoogle Scholar
  19. Groves R.M., Fowler F.J. Jr, Couper M.P., Lepkowski J.M., Singer E., Tourangeau R.: Survey Methodology. Wiley, Hoboken (2004)Google Scholar
  20. Hillmert S.: Edition von Lebensverlaufsdaten: Zur Relevanz einer systematischen Einzelfallbearbeitung bei standardisierten Befragungen. ZUMA-Nachrichten 26, 120–140 (2002)Google Scholar
  21. Hillmert, S., Künster, R., Spengemann, P., Mayer, K.: Projekt Ausbildungs- und Berufsverläufe der Geburtskohorten 1964 und 1971 in Westdeutschland. In: Materialien aus der Bildungsforschung no. 78. Berlin: Max-Planck-Institut für Bildungsforschung (2004)Google Scholar
  22. Huber P.J.: Robust estimation of a local parameter. Ann. Math. Stat. 35, 73–101 (1964)CrossRefGoogle Scholar
  23. Huttenlocher J., Hedges L.V., Bradburn N.M.: Reports of elapsed time: bounding and rounding processes in estimation. J. Exp. Psychol. Learn. Mem. Cogn. 34(1), 138–147 (1990)Google Scholar
  24. Jäckle, A., Lynn, P.: Dependent interviewing and seam effects in work history data. ISER working papers number 2004-24 (2004)Google Scholar
  25. King, G., Zeng, L.: Logistic regression in rare events data. Department of Government, Harvard University. http://GKing.Harvard.Edu (1999a)
  26. King, G., Zeng, L.: Estimating absolute, relative, and attributable risks in case-control studies. Department of Government, Harvard University. http://GKing.Harvard.Edu (1999b)
  27. King G., Zeng L.: Logistic regression in rare events data. Political Anal. 9(2), 137–163 (2001)CrossRefGoogle Scholar
  28. Klein T., Fischer-Kerli D.: Die Zuverlässigkeit retrospektiv erhobener Lebensverlaufsdaten: Analysen zur Partnerschaftsbiographie des Familiensurveys. Zeitschrift für Soziologie 29(4), 294–312 (2000)Google Scholar
  29. Kleinert, C., Matthes, B., Jacob, M.: Die Befragung “Arbeiten und Lernen im Wandel”: theoretischer Hintergrund und Konzeption. IAB Forschungsbericht 05/2008 (2008)Google Scholar
  30. Klijzing, E., Prophet, H.: On the quality of FFS event history data. Globalife working paper series no. 13 (1998)Google Scholar
  31. Mathiowetz N., Duncan G.: Out of work, out of mind: response errors in retrospective reports of unemployment. J. Bus. Econ. Stat. 6(2), 221–229 (1988)Google Scholar
  32. Matthes, B., Reimer, M., Künster, R.: TrueTales – Ein neues Instrument zur Erhebung von Längsschnittdaten. Arbeitsbericht 2 des Projektes Frühe Karrieren und Familiengründung: Lebensverläufe der Geburtskohorte 1971 in Ost- und Westdeutschland. Max-Planck-Institut für Bildungsforschung, Berlin (2005)Google Scholar
  33. Matthes, B., Reimer, M., Künster, R.: Techniken und Werkzeuge zur Unterstützung der Erinnerungsarbeit bei der computergestützten Erhebung retrospektiver Längsschnittdaten. Methoden, Daten, Analysen. Zeitschrift für empirische Sozialforschung 1(1), 69–92 (2007)Google Scholar
  34. Neisser, U.: Nested structure in autobiographical memory. In: Rubin, D.C. (ed.) Autobiographical Memory, pp. 71–82. Cambridge University Press, Cambridge (1986)Google Scholar
  35. OECD: Classifying educational programmes: manual for ISCED-97. Implementation in OECD countries 1999 edition. http://www.oecd.org/dataoecd/7/2/1962350.pdf (1999)
  36. Paull, G.: Dynamic labour market behaviour in the British Household Panel Survey: the effects of recall bias and panel attrition. Centre for Economic Performance & Institute of Economics paper no. 10 (1997)Google Scholar
  37. Paull, G.: Biases in the reporting of labour market dynamics. IFS working papers W02/10 (2002)Google Scholar
  38. Peters H.E.: Retrospective versus panel data in analyzing lifecycle events. J. Hum. Resour. 23(4), 488–513 (1988)CrossRefGoogle Scholar
  39. Reimer, M.: Die Zuverlässigkeit des autobiographischen Gedächtnisses und die Validität retrospektiv erhobener Lebensverlaufsdaten. Materialien aus der Bildungsforschung no. 71. Max-Planck-Institut für Bildungsforschung, Berlin (2001)Google Scholar
  40. Reimer, M.: Collecting event history data: about work careers retrospectively: mistakes that occur and ways to prevent them. Arbeitspapier no. 1 des Projektes Kognition und Kommunikation bei der Längsschnittdatenerhebung. Max-Planck-Institut für Bildungsforschung, Berlin (2004)Google Scholar
  41. Reimer M., Matthes B.: Collecting event histories with True Tales: techniques to improve autobiographical recall problems in standardized interviews. Qual. Quant. 41(5), 711–735 (2006)CrossRefGoogle Scholar
  42. Rubin D.C., Baddeley A.D.: Telescoping is not time compression: a model of the dating of autobiographical events. Mem. Cogn. 17(6), 653–661 (1989)CrossRefGoogle Scholar
  43. Schröder, M., Börsch-Supan, A.: Retrospective data collection in Europe. MEA discussion paper 172-08 (2008)Google Scholar
  44. Skowronski J.J., Thompson C.P.: Reconstructing the dates of personal events: gender differences in accuracy. Appl. Cogn. Psychol. 4(5), 371–381 (1990)CrossRefGoogle Scholar
  45. Tomz, M., King, G., Zeng, L.: RELOGIT: Rare Events Logistic Regression, Version 1.1. Harvard University, Cambridge, October 1.http://gking.harvard.edu/ (1999)
  46. Tomz M., King G., Zeng L.: ReLogit: rare events logistic regression. J. Stat. Softw. 8(2), 1–27 (2003)Google Scholar
  47. Tourangeau, R.: Remembering what happened: memory errors and survey reports. In: Stone, A.A., Turkkan, J.S., Bachrach, C.A., Jobe, J.B., Kurtzman, H.S., Cain, V.S. (eds.) The Science of Self-Reports: Implications for Research and Practice, pp. 29–48. Erlbaum, Mahwah (2000)Google Scholar
  48. Tourangeau R., Rips L.J., Rasinski K.: The Psychology of Survey Response. Cambridge University Press, Cambridge (2000)CrossRefGoogle Scholar
  49. Vander Vaart W.: The time-line as a device to enhance recall in standardized research interviews: a split ballot study. J. Official Stat. 20(2), 301–317 (2004)Google Scholar
  50. Vander Vaart W., Glasner T.: Applying a timeline as a recall aid in a telephone survey: a record check study. Appl. Cogn. Psychol. 21(2), 227–238 (2007)CrossRefGoogle Scholar
  51. Van der Vaart, W., Glasner, T.: Personal landmarks as recall aids in survey interviews. In: Proceedings of the Seventh International Conference on Survey Methodology, Napels, Italy, 1–5 September (2008)Google Scholar
  52. Wagenaar W.A.: My memory: a Study of autobiographical memory over six years. Cogn. Psychol. 18(2), 225–252 (1986)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.Institute for Employment Research (IAB) of the German Federal Employment Agency (BA)NurembergGermany

Personalised recommendations