Capturing momentary, self-report data: A proposal for reporting guidelines

Abstract

Self-report data are ubiquitous in behavioral and medical research. Retrospective assessment strategies are prone to recall bias and distortion. New techniques for assessing immediate experiences in respondents' natural environments (e.g., Ecological Momentary Assessment [1], Experience Sampling [2]) are being used by many researchers to reduce reporting bias. This article discusses seven aspects of momentary research that are often overlooked or minimized in the presentation of momentary research reports, yet that are critical to the success of the research: (a) the rationale for the momentary sampling design, (b) the details of momentary sampling procedures, (c) the data acquisition interface, (d) rates of compliance with the sampling plan, (e) the procedures used to train and monitor participants, (f) data management procedures, and (g) the data analytic approach. Attention to these areas in both the design and reporting of momentary research studies will not only improve momentary research protocols but also allow for the successful replication of research findings by other investigators.

This is a preview of subscription content, access via your institution.

References

  1. (1)

    Stone A, Neale J, Cox D, et al.: Daily events are associated with a secretory response to an oral antigen in humans.Health Psychology. 1994,13:440–446.

    PubMed  Article  CAS  Google Scholar 

  2. (2)

    DeVries M:The Experience of Psychopathology. Cambridge, England: Cambridge University Press, 1992.

    Google Scholar 

  3. (3)

    Stone A, Turkkan J, Jobe J, et al.:The Science of Self Report. Mahwah, NJ: Lawrence Erlbaum Associates, Inc., 2000.

    Google Scholar 

  4. (4)

    Bradburn N, Rips L, Shevell S: Answering autobiographical questions: The impact of memory and inference on surveys.Science. 1987,236:151–167.

    Article  Google Scholar 

  5. (5)

    Gorin AA, Stone AA: Recall biases and cognitive errors in retrospective self-reports: A call for momentary assessments. In Baum A, Revenson T, Singer J (eds),Handbook of Health Psychology. Mahwah, NJ: Lawrence Erlbaum Associates, Inc. (inpress), 405–413.

  6. (6)

    Erskine A, Morley S, Pearce S: Memory for pain: A review.Pain. 1990,41:255–265.

    PubMed  Article  CAS  Google Scholar 

  7. (7)

    Salovey P, Sieber W, Jobe J, Willis G: The recall of physical pain. In Schwarz N, Sudman S (eds),Autobiographical Memory and the Validity of Retrospective Reports. New York:Springer-Verlag, 1993,89–106.

    Google Scholar 

  8. (8)

    Schwarz N: Self-reports. How the questions shape the answers.American Psychologist. 1999,54:93–105.

    Article  Google Scholar 

  9. (9)

    Schwarz N, Sudman S:Autobiographical Memory and the Validity of Retrospective Reports. New York: Springer-Verlag, 1994.

    Google Scholar 

  10. (10)

    Salovey P, Smith A, Turk D, Jobe J, Willis G: The accuracy of memory for pain: Not so bad most of the time.American Pain Society Journal. 1993,2:181–191.

    Google Scholar 

  11. (11)

    Stone A, Broderick J, Porter L, Kaell A: The experience of rheumatoid arthritis pain and fatigue: Examining momentary reports and correlates over one week.Arthritis Care and Research. 1997,10:185–193.

    PubMed  Article  CAS  Google Scholar 

  12. (12)

    Reis H, Gable S: Event-sampling and other methods for studying everyday experience. In Reis H, Judd C (eds),Handbook of Research Methods in Social and Personality Psychology. Cambridge, England: Cambridge University Press, 2000,190–223.

    Google Scholar 

  13. (13)

    Delespaul P:Assessing Schizophrenia in Daily Life-The Experience Sampling Method. Maastricht, The Netherlands: Maastricht University Press, 1995.

    Google Scholar 

  14. (14)

    Shiffman S: Real-time self-report of momentary states in the natural environment: Computerized Ecological Momentary Assessment. In Stone A, Turkkan J, Jobe J, et al. (eds),The Science of Self-Report: Implications for Research and Practice. Mahwah, NJ: Lawrence Erlbaum Associates, Inc., 2000,277–296.

    Google Scholar 

  15. (15)

    Stone A, Valdimarsdottir H, Katkin E, et al.: Stressed-induced autonomic reactions are associated with altered mitogen responses.Psychosomatic Medicine. 1991,2:211–212.

    Google Scholar 

  16. (16)

    Stone A, Neale J: Development of a methodology for assessing daily experiences. InAdvances in Environmental Psychology: Environment and Health (Vol. 4). Hillsdale, New Jersey: Lawrence Erlbaum Associates, Inc., 1982,49–83.

    Google Scholar 

  17. (17)

    RaudenbushS: Statistical analysis and optimal design for cluster randomized trials.Psychological Methods. 1997,2:173–185.

    Article  Google Scholar 

  18. (18)

    Marco C, Schwartz J, Neale J, Shiffman S, Stone A: Do appraisals of daily problems and how they are coped with moderate mood in everyday life?Journal of Consulting and Clinical Psychology. 1999,67:755–764.

    PubMed  Article  CAS  Google Scholar 

  19. (19)

    Litt M, Cooney N, Morse P: Ecological Momentary Assessment (EMA) with treated alcoholics: Methodological problems and potential solutions.Health Psychology. 1998,17:48–52.

    PubMed  Article  CAS  Google Scholar 

  20. (20)

    Rand C, Nides M, Cowles M, Wise R, Connett J: Long-term me-tered-dose inhaler adherence in a clinical trial.American Journal of Respiratory & Critical Care Medicine. 1995,152:580–588.

    CAS  Google Scholar 

  21. (21)

    Stone AA, Shiffman SS, Schwartz JE, Hufford M, Broderick JB: Patient non-compliance with paper diaries.British Medical Journal. 2002,324:1193–1194.

    PubMed  Article  Google Scholar 

  22. (22)

    Shiffman S, Hufford M, Paty J: Subject Experience Diaries in Clinical Research. Part 1: The patient experience movement.Applied Clinical Trials. 2001,10:46–56.

    Google Scholar 

  23. (23)

    Raymond S, Ross R: Electronic subject diaries in clinical trials.Applied Clinical Trials. 2000,9:48–58.

    Google Scholar 

  24. (24)

    Affleck G, Tennen H, Keefe F, et al.: Everyday life with osteoarthritis or rheumatoid arthritis: Independent effects of disease and gender on daily pain, mood, and coping.Pain. 1999,83:601–609.

    PubMed  Article  CAS  Google Scholar 

  25. (25)

    Michela J: Within-person correlational design. In Hendrick C, Clark M (eds),Review of Personality and Social Psychology Series. 1990,279–311.

  26. (26)

    Schwartz J, Stone A: Data analysis for EMA studies.Health Psychology. 1998,17:6–16.

    PubMed  Article  CAS  Google Scholar 

  27. (27)

    West S, Hepworth J: Statistical issues in the study of temporal data: Daily experiences.Journal of Personality. 1991,59:609–662.

    PubMed  Article  CAS  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Arthur A. Stone Ph.D..

Additional information

We thank Dr. Joseph Schwartz and Dr. Michael Hufford for comments on an early draft of this article.

About this article

Cite this article

Stone, A.A., Shiffman, S. Capturing momentary, self-report data: A proposal for reporting guidelines. ann. behav. med. 24, 236–243 (2002). https://doi.org/10.1207/S15324796ABM2403_09

Download citation

Keywords

  • Behavioral Medicine
  • Ecological Momentary Assessment
  • Experience Sampling Method
  • Momentary Sampling
  • Momentary Data