Skip to main content
SpringerLink
Log in

Improving retrospective life course data by combining modularized self-reports and event history calendars: experiences from a large scale survey

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

Event history calendars (EHC) have proven to be a powerful tool for collecting retrospective autobiographical life course data. One problem is that they are only standardized to a limited extent. This restricts their applicability in large-scale surveys. However, in such surveys, a modularized retrospective CATI design can be combined with an EHC. This data revision module is directly integrated into the interview and used as a data revision module, allowing insights from cognitive psychology to be applied. The data revision module stimulates the respondent’s memory retrieval by detecting both temporal inconsistencies, such as gaps, and overlapping or parallel events. This approach was implemented in the IAB-ALWA study (Working and Learning in a Changing World), a large-scale representative telephone survey involving 10,000 respondents. By comparing the uncorrected data with the final data after revision, we can investigate to what extent the application of this data revision module improves data quality or, more precisely, time consistency and dating accuracy of individual reports.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Antoni, M., Drasch, K., Kleinert, C., Matthes, B., Ruland, M., Trahms, A.: Working and learning in a changing world. Part I: Overview of the study - March 2011 (second, updated version). FDZ Methodenreport 05/2010 (2010)

  • Auriat N.: Who forgets? An analysis of memory effects in a retrospective survey on migration history. Eur. J. Popul. 7(4), 311–342 (1991)

    Article  Google Scholar 

  • Barclay C.: Schematization of autobiographical memory. In: Rubin, D.C. (eds) Autobiographical Memory., pp. 82–99. Cambridge University Press, Cambridge (1986)

    Chapter  Google Scholar 

  • Barsalou L.: The content and organization of autobiographical memories. In: Neisser, U., Winograd, E. (eds) Remembering Reconsidered: Ecological and Traditional Approaches to the Study of Memory, pp. 193–243. Cambridge University Press, New York (1988)

    Chapter  Google Scholar 

  • Belli R.F.: The structure of autobiographical memory and the event history calendar: potential improvements in the quality of retrospective reports in surveys. Memory 6(4), 383–406 (1998)

    Article  Google Scholar 

  • Belli R.F., Shay W.L., Stafford F.P.: Event history calendars and question list surveys: a direct comparison of interviewing methods. Public Opin. Q. 65(1), 45–74 (2001)

    Article  Google Scholar 

  • Belli R.F., Lee E.H., Stafford F.P., Chou C.: Calendar and question-list survey methods: association between interviewer behaviors and data quality. J. Official Stat. 20(2), 185–218 (2004)

    Google Scholar 

  • Belli R.F., Smith L.M., Andreski P.M., Agrawal S.: Methodological comparisons between CATI event history calendar and standardized conventional questionnaire instruments. Public Opin. Q. 71(4), 603–622 (2007)

    Article  Google Scholar 

  • Blossfeld H., Golsch K., Rohwer G.: Techniques of Event History Modeling Using Stata: New Approaches to Causal Analysis. Erlbaum, Mahwah (2007)

    Google Scholar 

  • Bradburn R.M.: Temporal representation and event dating. In: Stone, A.A., Turkkan, J.S., Bachrach, C.A., Jobe, J.B., Kurtzman, H.S., Cain, V.S. (eds) The Science of Self-Reports: Implications for Research and Practice., pp. 48–62. Erlbaum, Mahwah (2000)

    Google Scholar 

  • Conway M.A.: Autobiographical knowledge of autobiographical memory. In: Rubin, D.C. (eds) Remembering Our Past: Studies in Autobiographical Memory, pp. 67–93. Cambridge University Press, Cambridge (1996)

    Chapter  Google Scholar 

  • Conway M.A., Pleydell-Pearce C.W.: The construction of autobiographical memories in the self–memory system. Psychol. Rev. 107(2), 261–288 (2000)

    Article  Google Scholar 

  • Dex, S.: The reliability of recall data: a literature review. ISER working paper 1991-11 (1991)

  • Dex S., McCulloch A.: The reliability of retrospective unemployment history data. Work Employ. Soc. 12(3), 497–509 (1998)

    Google Scholar 

  • Elias, P.: Who forgot they were unemployed? ISER working paper 1997-19 (1997)

  • Freedman D., Thornton A., Camburn D., Alwin D., Young-DeMarco L.: The life history calendar: a technique for collecting retrospective data. Sociol. Methodol. 18, 37–68 (1988)

    Article  Google Scholar 

  • Glasner, T., van der Vaart, W.: Cognitive processes in event history calendar interviews: a verbal report analysis. In: Proceedings of the Seventh International Conference on Survey Methodology, Napels, Italy, 1–5 September (2008)

  • Glasner T., van der Vaart W.: Applications of calendar instruments in social surveys: a review. Qual. Quant. 43(3), 333–349 (2009)

    Article  Google Scholar 

  • Groves R.M., Fowler F.J. Jr, Couper M.P., Lepkowski J.M., Singer E., Tourangeau R.: Survey Methodology. Wiley, Hoboken (2004)

    Google Scholar 

  • Hillmert S.: Edition von Lebensverlaufsdaten: Zur Relevanz einer systematischen Einzelfallbearbeitung bei standardisierten Befragungen. ZUMA-Nachrichten 26, 120–140 (2002)

    Google Scholar 

  • Hillmert, S., Künster, R., Spengemann, P., Mayer, K.: Projekt Ausbildungs- und Berufsverläufe der Geburtskohorten 1964 und 1971 in Westdeutschland. In: Materialien aus der Bildungsforschung no. 78. Berlin: Max-Planck-Institut für Bildungsforschung (2004)

  • Huber P.J.: Robust estimation of a local parameter. Ann. Math. Stat. 35, 73–101 (1964)

    Article  Google Scholar 

  • Huttenlocher J., Hedges L.V., Bradburn N.M.: Reports of elapsed time: bounding and rounding processes in estimation. J. Exp. Psychol. Learn. Mem. Cogn. 34(1), 138–147 (1990)

    Google Scholar 

  • Jäckle, A., Lynn, P.: Dependent interviewing and seam effects in work history data. ISER working papers number 2004-24 (2004)

  • King, G., Zeng, L.: Logistic regression in rare events data. Department of Government, Harvard University. http://GKing.Harvard.Edu (1999a)

  • King, G., Zeng, L.: Estimating absolute, relative, and attributable risks in case-control studies. Department of Government, Harvard University. http://GKing.Harvard.Edu (1999b)

  • King G., Zeng L.: Logistic regression in rare events data. Political Anal. 9(2), 137–163 (2001)

    Article  Google Scholar 

  • Klein T., Fischer-Kerli D.: Die Zuverlässigkeit retrospektiv erhobener Lebensverlaufsdaten: Analysen zur Partnerschaftsbiographie des Familiensurveys. Zeitschrift für Soziologie 29(4), 294–312 (2000)

    Google Scholar 

  • Kleinert, C., Matthes, B., Jacob, M.: Die Befragung “Arbeiten und Lernen im Wandel”: theoretischer Hintergrund und Konzeption. IAB Forschungsbericht 05/2008 (2008)

  • Klijzing, E., Prophet, H.: On the quality of FFS event history data. Globalife working paper series no. 13 (1998)

  • Mathiowetz N., Duncan G.: Out of work, out of mind: response errors in retrospective reports of unemployment. J. Bus. Econ. Stat. 6(2), 221–229 (1988)

    Google Scholar 

  • Matthes, B., Reimer, M., Künster, R.: TrueTales – Ein neues Instrument zur Erhebung von Längsschnittdaten. Arbeitsbericht 2 des Projektes Frühe Karrieren und Familiengründung: Lebensverläufe der Geburtskohorte 1971 in Ost- und Westdeutschland. Max-Planck-Institut für Bildungsforschung, Berlin (2005)

  • Matthes, B., Reimer, M., Künster, R.: Techniken und Werkzeuge zur Unterstützung der Erinnerungsarbeit bei der computergestützten Erhebung retrospektiver Längsschnittdaten. Methoden, Daten, Analysen. Zeitschrift für empirische Sozialforschung 1(1), 69–92 (2007)

  • Neisser, U.: Nested structure in autobiographical memory. In: Rubin, D.C. (ed.) Autobiographical Memory, pp. 71–82. Cambridge University Press, Cambridge (1986)

  • OECD: Classifying educational programmes: manual for ISCED-97. Implementation in OECD countries 1999 edition. http://www.oecd.org/dataoecd/7/2/1962350.pdf (1999)

  • Paull, G.: Dynamic labour market behaviour in the British Household Panel Survey: the effects of recall bias and panel attrition. Centre for Economic Performance & Institute of Economics paper no. 10 (1997)

  • Paull, G.: Biases in the reporting of labour market dynamics. IFS working papers W02/10 (2002)

  • Peters H.E.: Retrospective versus panel data in analyzing lifecycle events. J. Hum. Resour. 23(4), 488–513 (1988)

    Article  Google Scholar 

  • Reimer, M.: Die Zuverlässigkeit des autobiographischen Gedächtnisses und die Validität retrospektiv erhobener Lebensverlaufsdaten. Materialien aus der Bildungsforschung no. 71. Max-Planck-Institut für Bildungsforschung, Berlin (2001)

  • Reimer, M.: Collecting event history data: about work careers retrospectively: mistakes that occur and ways to prevent them. Arbeitspapier no. 1 des Projektes Kognition und Kommunikation bei der Längsschnittdatenerhebung. Max-Planck-Institut für Bildungsforschung, Berlin (2004)

  • Reimer M., Matthes B.: Collecting event histories with True Tales: techniques to improve autobiographical recall problems in standardized interviews. Qual. Quant. 41(5), 711–735 (2006)

    Article  Google Scholar 

  • Rubin D.C., Baddeley A.D.: Telescoping is not time compression: a model of the dating of autobiographical events. Mem. Cogn. 17(6), 653–661 (1989)

    Article  Google Scholar 

  • Schröder, M., Börsch-Supan, A.: Retrospective data collection in Europe. MEA discussion paper 172-08 (2008)

  • Skowronski J.J., Thompson C.P.: Reconstructing the dates of personal events: gender differences in accuracy. Appl. Cogn. Psychol. 4(5), 371–381 (1990)

    Article  Google Scholar 

  • Tomz, M., King, G., Zeng, L.: RELOGIT: Rare Events Logistic Regression, Version 1.1. Harvard University, Cambridge, October 1.http://gking.harvard.edu/ (1999)

  • Tomz M., King G., Zeng L.: ReLogit: rare events logistic regression. J. Stat. Softw. 8(2), 1–27 (2003)

    Google Scholar 

  • Tourangeau, R.: Remembering what happened: memory errors and survey reports. In: Stone, A.A., Turkkan, J.S., Bachrach, C.A., Jobe, J.B., Kurtzman, H.S., Cain, V.S. (eds.) The Science of Self-Reports: Implications for Research and Practice, pp. 29–48. Erlbaum, Mahwah (2000)

  • Tourangeau R., Rips L.J., Rasinski K.: The Psychology of Survey Response. Cambridge University Press, Cambridge (2000)

    Book  Google Scholar 

  • Vander Vaart W.: The time-line as a device to enhance recall in standardized research interviews: a split ballot study. J. Official Stat. 20(2), 301–317 (2004)

    Google Scholar 

  • Vander Vaart W., Glasner T.: Applying a timeline as a recall aid in a telephone survey: a record check study. Appl. Cogn. Psychol. 21(2), 227–238 (2007)

    Article  Google Scholar 

  • Van der Vaart, W., Glasner, T.: Personal landmarks as recall aids in survey interviews. In: Proceedings of the Seventh International Conference on Survey Methodology, Napels, Italy, 1–5 September (2008)

  • Wagenaar W.A.: My memory: a Study of autobiographical memory over six years. Cogn. Psychol. 18(2), 225–252 (1986)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Employment Research (IAB) of the German Federal Employment Agency (BA), Regensburger Strasse 104, 90478, Nuremberg, Germany

    Katrin Drasch & Britta Matthes

Authors
  1. Katrin Drasch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Britta Matthes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katrin Drasch.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Drasch, K., Matthes, B. Improving retrospective life course data by combining modularized self-reports and event history calendars: experiences from a large scale survey. Qual Quant 47, 817–838 (2013). https://doi.org/10.1007/s11135-011-9568-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-011-9568-0

Keywords

Search

Navigation