Experience Sampling: Promises and Pitfalls, Strength and Weaknesses

Part of the Social Indicators Research Series book series (SINS, volume 39)

Abstract

The experience-sampling (ESM) technique is a method in which recording of feelings and activities is done on-line at the moment, either at randomly selected moments or at predetermined times. This method has the advantage of being able to not only assess people’s general feelings, but to link feelings with situations, times of day, and other circumstances. Thus, ESM provides a powerful way of moving beyond simple questions about who is “happy” and who is not, to more intricate questions about when and why people experience positive and negative feelings. Compared to retrospective reports of feelings, ESM is less influenced by memory biases. ESM also allows researchers to analyze the patterning and relationships of feelings as they unfold over time. Despite the strengths and promise of this method, there are also limitations. For example, the heavy demand placed on research participants means that the sample might be biased toward highly conscientious individuals, and repeatedly reporting one’s moods might itself influence feelings. How to analyze ESM data is discussed, including the issue of how to aggregate momentary feelings into global measures of the average subjective well-being of individuals.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alliger, G. M., & K. J. Williams. (1993). Using signal-contingent experience sampling methodology to study work in the field: A discussion and illustration examining task perceptions and mood. Personnel Psychology, 46, 525–549.Google Scholar
  2. Ayllon, T., & E. Haughton. (1964). Modification of symptomatic verbal behavior of mental patients. Behavioral Research Therapy, 2, 87–98.CrossRefGoogle Scholar
  3. Bank, L., Dishion, T. J., Skinner, M., & Patterson, G. R. (1990). Method variance in structural equation modeling: Living with “glop”. In G. R. Patterson (Ed.), Depression and Aggression in family interaction: Advances in family research (pp. 247–279). Lawrence Erlbaum Hillsdale, NJ: Associates Inc.Google Scholar
  4. Barnes, R. M. (1956). Work sampling. New York: Wiley.Google Scholar
  5. Beidel, D. C., Neal, A. M., & Lederer, A. S. (1991). The feasibility and validity of a daily diary for the assessment of anxiety in children. Behavior Therapy, 22, 505–517.CrossRefGoogle Scholar
  6. Brandstaetter, H. (1983). Emotional responses to other persons in everyday life situations. Journal of Personality and Social Psychology, 45, 871–883.CrossRefGoogle Scholar
  7. Brunswik, E. (1949). Systematic and representative design of psychological experiments. Berkeley, CA: University of California Press.Google Scholar
  8. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.PubMedCrossRefGoogle Scholar
  9. Case Institute of Technology. (1958). An operations research study of the scientific acitivy of chemists. Cleveland, Ohio: Operations Research Group.Google Scholar
  10. Cattell, R. B. (1957). Personality and motivation: Structure and measurement. New York: World Book.Google Scholar
  11. Cerin, E., Szabo, A., & Williams, C. (2001). Is the experience sampling method (ESM) appropriate for studying pre-competitive emotions? Psychology of Sport and Exercise, 2, 27–45.CrossRefGoogle Scholar
  12. Conner, T., Feldman Barrett, L., Bliss-Moreau, E., Lebo, K., & Kaschub, C. (2003). A practical guide to experience-sampling procedures. Journal of Happiness Studies, 4, 53–78.CrossRefGoogle Scholar
  13. Cote, S., & Moskowitz, D. S. (1998). On the dynamic covariation between interpersonal behavior and affect: Prediction from neuroticism, extroversion, and agreeableness. Journal of Personality and Social Psychology, 75, 1032–1046.PubMedCrossRefGoogle Scholar
  14. Cruise, C. E., Broderick, J., Porter, L., Kaell, A., & Stone, A. A. (1996). Reactive effects of diary self-assessment in chronic pain patients. Pain, 67, 253–258.PubMedCrossRefGoogle Scholar
  15. Csikszentmihalyi, M., & Larson, R. (1984). Being adolescent: Conflict and growth in the teenage years. New York: Basic Books.Google Scholar
  16. Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience sampling method. Journal of Nervous and Mental Disease, 175, 526–537.PubMedCrossRefGoogle Scholar
  17. Csikszentmihalyi, M., Larson, R., & Prescott, S. (1977). The ecology of adolescent activity and experience. Journal of Youth and Adolescence, 6, 281–294.CrossRefGoogle Scholar
  18. Cutler, S. E., Larsen, R. J., & Bruce, S. C. (1996). Repressive coping style and the experience and recall of emotion: A naturalistic study of daily affect. Journal of Personality, 64, 379–405.PubMedCrossRefGoogle Scholar
  19. delle Fave, A., & Massimini, F. (1992). The ESM and the measurement of clinical change: A case of anxiety disorder. In M. W. deVries (Ed.), The experience of psychopathology: investigating mental disorders in their natural settings (pp. 280–289). New York: Cambridge University Press.Google Scholar
  20. Diener, E., & Biswas-Diener, R. (2000). New directions in subjective well-being research: The cutting edge. Indian Journal of Clinical Psychology, 27, 21–23.Google Scholar
  21. Diener, E., & Diener, C. (1996). Most people are happy. Psychological Science, 7, p.181–185.Google Scholar
  22. Diener, E., & Emmons, R. A. (1985). The independence of positive and negative affect. Journal of Personality and Social Psychology, 47, 1108–1117.Google Scholar
  23. Diener, E., & Fujita, F. (1995). Resources, personal strivings, and subjective wellbeing: A nomthetic and idiographic approach. Journal of Personality and Social Psychology, 68,\break 926–935.Google Scholar
  24. Diener, E., & Larsen, R. J. (1984). Temporal stability and cross-situational consistency of affective, behavioral, and cognitive responses. Journal of Personality and Social Psychology, 47, 871–883.PubMedCrossRefGoogle Scholar
  25. Diener, E., Larsen, R. J., & Emmons, R. A. (1984). Person X situation interactions: Choice of situations and congruence response models. Journal of Personality and Social Psychology, 47, 580–592.PubMedCrossRefGoogle Scholar
  26. Diener, E., Larsen, R. J., Levine, S., & Emmons, R. A. (1985). Intensity and frequency: Dimensions underlying positive and negative affect. Journal of Personality and Social Psychology, 48, 1253–1265.PubMedCrossRefGoogle Scholar
  27. Diener, E., Lucas, R. E., Oishi, S., & Suh, E. M. (2002). Looking up and looking down: Weighting good and bad information in life satisfaction judgments. Personality and Social Psychology Bulletin, 28, 437–445.CrossRefGoogle Scholar
  28. Diener, E., Smith, H., & Fujita, F. (1995). The personality structure of affect. Journal of Personality and Social Psychology, 69, 130–141.CrossRefGoogle Scholar
  29. Egloff, B., Tausch, A., Kohlmann, C.-W., & Krohne, H. W. (1995). Relationships between time of day, day of the week, and positive mood: Exploring the role of the mood measure. Motivation and Emotion, 19, 99–110.Google Scholar
  30. Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51, 1058–1068.CrossRefGoogle Scholar
  31. Epstein, S. (1980). The stability of behavior: Implications for psychological research. American Psychologist, 9, 790–806.CrossRefGoogle Scholar
  32. Fahrenberg, J., & Myrtek, M. (Eds.). (2001). Progress in ambulatory assessment: Computer-assisted psychological and psychophysiological methods in monitoring and field studies. Kirkland, WA: Hogrefe and Huber Publishers.Google Scholar
  33. Feldman Barrett, L. (1997). The relationships among momentary emotion experiences, personality descriptions, and retrospective ratings of emotion. Personality and Social Psychology Bulletin, 23, 1100–1110.CrossRefGoogle Scholar
  34. Fiske, D. (1971). Measuring the concepts of personality. Chicago: Aldine.Google Scholar
  35. Flory, J. D., Raeikkoenen, K., Matthews, K. A., & Owens, J. F. (2000). Self-focused attention and mood during everyday social interactions. Personality and Social Psychology Bulletin, 26, 875–883.CrossRefGoogle Scholar
  36. Flügel, J. C. (1925). quantitative study of feeling and emotion in every day life. British Journal of Psychology, 15, 318–355.Google Scholar
  37. Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197–221.PubMedCrossRefGoogle Scholar
  38. Han, J. J., Leichtman, M. D., & Wang, Q. (1998). Autobiographical memory in Korean, Chinese, and American children. Developmental Psychology, 34, 701–713.PubMedCrossRefGoogle Scholar
  39. Heiland, R. E., & Richardson, W. J. (1957). Work sampling. New York: McGraw-Hill.Google Scholar
  40. Henry, B., Moffitt, T., Caspi, A., Langley, J., & Silva, P. A. (1994). On the “remembrance of things past”: A longitudinal evaluation of the retrospective method. Psychological Assessment, 6, 92–101.CrossRefGoogle Scholar
  41. Hinricks, J. R. (1964). Communications activity of industrial research personnel. Personnel Psychology, 17, 193–204.CrossRefGoogle Scholar
  42. Hormuth, S. E. (1986). The sampling of experiences in situ. Journal of Personality, 54, 262–293.CrossRefGoogle Scholar
  43. Hurlburt, R. T. (1997). Randomly sampling thinking in the natural environment. Journal of Consulting and Clinical Psychology, 65, 941–949.PubMedCrossRefGoogle Scholar
  44. Isen, A. M. (1970). Success, failure, attention, and reaction to others: The warm glow of success. Journal of Personality and Social Psychology, 15, 294–301.CrossRefGoogle Scholar
  45. Isen, A. M., & Levin, P. F. (1972). Effect of feeling good on helping: Cookies and kindness. Journal of Personality and Social Psychology, 21, 384–388.PubMedCrossRefGoogle Scholar
  46. Ji, L.-J., Schwarz, N., & Nisbett, R. E. (2000). Culture, autobiographical memory, and behavioral frequency reports: Measurement issues in cross-cultural studies. Personality and Social Psychology Bulletin, 26, 585–593.CrossRefGoogle Scholar
  47. Kahneman, D. (1999). Objective happiness. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: The foundations of hedonic psychology (pp. 3–25). New York: Russell Sage \nobreak Foundation.Google Scholar
  48. Klinger, E. (1978–1979). Dimensions of thought an dimagery in normal waking states. Journal of Altered States of Consciousness, 4, 97–113.Google Scholar
  49. Lamiell, J. T. (1997). Individuals and the differences between them. In R. Hogan, J. A. Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 117–141). San Diego, CA: Academic Press. \bibitem Larsen, R. J. (1987). The stability of mood variability: A spectral analytic approach to daily mood assessments. Journal of Personality and Social Psychology, 52, 1195–1204.Google Scholar
  50. Larsen, R. J., & Diener, E. (1987). Affect intensity as an individual difference characteristic: A review. Journal of Research in Personality, 21, 1–39.CrossRefGoogle Scholar
  51. Larsen, R. J., & Kasimatis, M. (1990). Individual differences in entrainment of mood to the weekly calendar. Journal of Personality and Social Psychology, 58, 164–171.PubMedCrossRefGoogle Scholar
  52. Larson, R. W., Richards, M. H., & Perry-Jenkins, M. (1994). Divergent worlds: The daily emotional experience of mothers and fathers in the domestic and public spheres. Journal of Personality and Social Psychology, 67, 1034–1046.Google Scholar
  53. Larson, R., & Delespaul, P. A. E. G. (1992). Analyzing experience sampling data: A guidebook for the perplexed. In M. W. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings (pp. 58–78). New York: Cambridge University Press.Google Scholar
  54. Litt, M. D., Cooney, N. L., & Morse, P. (1998). Ecological momentary assessment (EMA) with treated alcoholics: Methodological problems and potential solutions. Health Psychology, 17, 48–52.PubMedCrossRefGoogle Scholar
  55. Lucas, R. E. (2000). Pleasant affect and sociability: Towards a comprehensive model of extraverted feelings and behaviors. Unpublished Doctoral Dissertation, University of Illinois, Urbana-Champaign.Google Scholar
  56. Lynn, P. (2001). The impact of incentives on response rates to personal interview surveys: Role and perceptions of interviewers. International Journal of Public Opinion Research, 13, 326–336.CrossRefGoogle Scholar
  57. Mathews, A., & MacLeod, C. (1994). Cognitive approaches to emotion and emotional disorderes. Annual Review of Psychology, 45, 25–50.PubMedCrossRefGoogle Scholar
  58. McAdams, D. P. (1995). What do we know when we know a person? Journal of Personality, 63, 365–396.CrossRefGoogle Scholar
  59. McFarland, C., Ross, M., & DeCourville, N. (1989). Womens theories of menstruation and biases in recall of menstrual symptoms. Journal of Personality and Social Psychology, 57, 522–531.PubMedCrossRefGoogle Scholar
  60. Mehl, M. R., Pennebaker, J. W., Crow, M., Dabbs, J., & Price, J. (2001). The electronically activated recorder (EAR): A device for sampling naturalistic daily activities and conversations. Behavioral Research Methods, Instruments, and Computers, 33, 517–523.Google Scholar
  61. Mischel, W. (1968). Personality and assessment. New York: Wiley.Google Scholar
  62. Nolen-Hoeksema, S. (1993). Sex differences in control of depression. In P. D. M. Wegner & J. W. Pennebaker (Eds.), Handbook of mental control (pp. 306–324). New Jersey: Prentice-Hall.Google Scholar
  63. Nowlis, D. P., & Cohen, A. Y. (1968). Mood-reports and the college natural setting: A day in the lives of three roommates under academic pressure. Psychological Reports, 23, 551–566.PubMedGoogle Scholar
  64. Oishi, S. (2002). The function of daily vs. retrospective judgments of satisfaction in relationship longevity. Manuscript in preparation.Google Scholar
  65. Oishi, S., MDiener, E., Scollon, C. N., & Biswas-Diener, R. (2004). Cross-situational consistency of affective experiences across cultures. Journal of Personality and Social Psychology, 86,\break 460–472.Google Scholar
  66. Pavot, W., Diener, E., & Fujita, F. (1990). Extraversion and happiness. Personality and Individual Differences, 11, 1299–1306.CrossRefGoogle Scholar
  67. Pelham, B. W. (1993). The idiographic nature of human personality: Examples of the idiographic self-concept. Journal of Personality and Social Psychology, 64, 665–677.PubMedCrossRefGoogle Scholar
  68. Ptacek, J. T., Smith, R. E., Espe, K., & Raffety, B. (1994). Limited correspondence between daily coping reports and retrospective coping recall. Psychological Assessment, 6, 41–49.CrossRefGoogle Scholar
  69. Redelmeier, D. A., & Kahneman, D., (1996). Patients memories of painful medical treatments: Real-time and retrospective evaluations of two minimally invasive procedures. Pain, 66,\break 3–8.Google Scholar
  70. Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 190–222). New York: Cambridge University Press.Google Scholar
  71. Robinson, D., & Clore, G. L., (2002). Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes. Journal of Personality and Social Psychology, 83, 198–215.PubMedCrossRefGoogle Scholar
  72. Ross, M. (1989). Relation of implicit theories to the construction of personal histories. Psychological Review, 96, 341–357.CrossRefGoogle Scholar
  73. Rusting, C. L., & Larsen, R. J. (1998). Diurnal patterns of unpleasant mood: Associations with neuroticism, depression, and anxiety. Journal of Personality, 66, 85–103.PubMedCrossRefGoogle Scholar
  74. Ruble, D. N. (1977). Premenstrual symptoms: A reinterpretation. Science, 197, 291–292.PubMedCrossRefGoogle Scholar
  75. Schimmack, U. (2003). Affect measurement in experience sampling research. Journal of Happiness Studies, 4, 79–106.CrossRefGoogle Scholar
  76. Schimmack, U. (2002). Frequency judgments of emotions: The cognitive basis of personality assessment. In P. Sedelmeier & T. Betsch (Eds.), Frequency processing and cognition. Oxford: Oxford University Press.Google Scholar
  77. Schimmack, U., & Diener, E. (1997). Affect intensity: Separating intensity and frequency in repeatedly measured affect. Journal of Personality and Social Psychology, 73, 1313–1329.CrossRefGoogle Scholar
  78. Schimmack, U., Bockenholt, U., & Reisenzein, R. (2002). Response styles in affect ratings: Making a moutain out of a molehill. Journal of Personality Assessment, 78, 461–483.PubMedCrossRefGoogle Scholar
  79. Schwarz, N. (1994). Judgment in a social context: Biases, shortcomings, and the logic of conversation. In M. Zanna (Ed.), Advances in experimental social psychology (Vol. 26, pp. 123–162). San Diego, CA: Academic Press.Google Scholar
  80. Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.CrossRefGoogle Scholar
  81. Shedler, J., Mayman, M., & Manis, M. (1993). The illusion of mental health. American Psychologist, 48, 1117–1131.PubMedCrossRefGoogle Scholar
  82. Scollon, C. N., Diener, E., Oishi, S., & Biswas-Diener, R. (2002). Culture, selfconcept, and memory for emotions. Manuscript under review.Google Scholar
  83. Scollon, C. N., Diener, E., & Oishi, S. (2002). An experience sampling and cross-cultural investigation of dialectical emotional experience. Manuscript in preparation.Google Scholar
  84. Snijders,T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage Publications.Google Scholar
  85. Stone, A. A., Kessler, R. C., & Haythornwaite, J. A. (1991). Measuring daily events and experiences: Decisions for the researcher. Journal of Personality, 59, 575–607.PubMedCrossRefGoogle Scholar
  86. Stone, A. A., Schwartz, J. E., Neale, J. M., Shiffman, S., Marco, C. A., Hickcox, M., et al. (1998). A comparison of coping assessed by ecological momentary assessment and retrospective recall. Journal of Personality and Social Psychology, 74, 1670–1680.PubMedCrossRefGoogle Scholar
  87. Stone, A. A., Shiffman, S. S., & DeVries, M. W. (1999). Ecological momentary assessment. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: Foundations of a hedonic psychology (pp. 26–39). New York: Russell Sage Foundation.Google Scholar
  88. Tennen, H., Suls, J., & Affleck, G. (1991). Personality and daily experience: The promise and the challenge. Journal of Personality, 59, \hbox{313–337}.Google Scholar
  89. Thomas, D. L., & Diener, E. (1990). Memory and accuracy in the recall of emotions. Journal of Personality and Social Psychology, 59, 291–297.CrossRefGoogle Scholar
  90. Tversky, A., & Kahneman, D. (1973). Judgment under uncertainty: Heuristics and biases. Eugene, OR: Oregon Research Institute.Google Scholar
  91. Wang, Q. (2001). Culture effects on adults earliest childhood recollection and selfdescription: Implications for the relation between memory and the self. Journal of Personality and Social Psychology, 81, 220–233.PubMedCrossRefGoogle Scholar
  92. Wessman, A. E., & Ricks, D. F. (1966). Mood and personality. New York: Holt, Rinehart and Winston.Google Scholar
  93. West, S. G., & Hepworth, J. T. (1991). Statistical issues in the study of temporal data: Daily experiences. Journal of Personality, 59, 609–662.PubMedCrossRefGoogle Scholar
  94. Wheeler, L., & Reis, H. T. (1991). Self-recordings of everyday life events: Origins, types, and uses. Journal of Personality, 59, 339–354.CrossRefGoogle Scholar
  95. Wilson, K. C. M., Hopkins, R., deVries, M. W., & Copeland, J. R. M. (1992). Research alliance and the limit of compliance: Experience sampling with the depressed elderly. In M. W. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings. New York: Cambridge University Press.Google Scholar
  96. Winkielman, P., Knäuper, B., & Schwarz, N. (1998). Looking back at anger: Reference periods change the interpretation of (emotion) frequency questions. Journal of Personality and Social Psychology, 75, 719–728.PubMedCrossRefGoogle Scholar
  97. Wirtz, D., Kruger, J., Scollon, C. N., & Diener, E. (2003). What to do on spring break? The role of predicted, on-line, and remembered experience in future choice. Psychological Science, 14, 520–524.PubMedCrossRefGoogle Scholar
  98. Wong, M., & Csikszentmihalyi, M. (1991). Motivation and academic achievement: The effects of personality traits and the quality of experience. Journal of Personality, 59, 539–574.PubMedCrossRefGoogle Scholar
  99. Zelenski, M., & Larsen, R. J. (2000). The distribution of basic emotions in everyday life: A state and trait perspective from experience sampling data. Journal of Research in Personality, 34, 178–197.CrossRefGoogle Scholar
  100. Zirkel, S., & Cantor, N. (1990). Personal construal of life tasks: Those who struggle for independence. Journal of Personality and Social Psychology, 58, 172–185.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, B.V. 2009

Authors and Affiliations

  • Christie Napa Scollon
    • 1
  • Chu-Kim Prieto
    • 2
  • Ed Diener
    • 3
  1. 1.University of Illinois, Urbana-ChampaignChampaignUSA
  2. 2.Department of PsychologyCollege of New JerseyEwingUSA
  3. 3.Department of PsychologyUniversity of Illinois, Urbana-ChampaignChampaignUSA

Personalised recommendations