Skip to main content

Experience Sampling: Promises and Pitfalls, Strength and Weaknesses

  • Chapter

Part of the Social Indicators Research Series book series (SINS,volume 39)

Abstract

The experience-sampling (ESM) technique is a method in which recording of feelings and activities is done on-line at the moment, either at randomly selected moments or at predetermined times. This method has the advantage of being able to not only assess people’s general feelings, but to link feelings with situations, times of day, and other circumstances. Thus, ESM provides a powerful way of moving beyond simple questions about who is “happy” and who is not, to more intricate questions about when and why people experience positive and negative feelings. Compared to retrospective reports of feelings, ESM is less influenced by memory biases. ESM also allows researchers to analyze the patterning and relationships of feelings as they unfold over time. Despite the strengths and promise of this method, there are also limitations. For example, the heavy demand placed on research participants means that the sample might be biased toward highly conscientious individuals, and repeatedly reporting one’s moods might itself influence feelings. How to analyze ESM data is discussed, including the issue of how to aggregate momentary feelings into global measures of the average subjective well-being of individuals.

Keywords

  • Experience Sampling
  • Autobiographical Memory
  • Memory Bias
  • Ecological Momentary Assessment
  • Experience Sampling Method

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-90-481-2354-4_8
  • Chapter length: 24 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-90-481-2354-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Alliger, G. M., & K. J. Williams. (1993). Using signal-contingent experience sampling methodology to study work in the field: A discussion and illustration examining task perceptions and mood. Personnel Psychology, 46, 525–549.

    Google Scholar 

  • Ayllon, T., & E. Haughton. (1964). Modification of symptomatic verbal behavior of mental patients. Behavioral Research Therapy, 2, 87–98.

    CrossRef  Google Scholar 

  • Bank, L., Dishion, T. J., Skinner, M., & Patterson, G. R. (1990). Method variance in structural equation modeling: Living with “glop”. In G. R. Patterson (Ed.), Depression and Aggression in family interaction: Advances in family research (pp. 247–279). Lawrence Erlbaum Hillsdale, NJ: Associates Inc.

    Google Scholar 

  • Barnes, R. M. (1956). Work sampling. New York: Wiley.

    Google Scholar 

  • Beidel, D. C., Neal, A. M., & Lederer, A. S. (1991). The feasibility and validity of a daily diary for the assessment of anxiety in children. Behavior Therapy, 22, 505–517.

    CrossRef  Google Scholar 

  • Brandstaetter, H. (1983). Emotional responses to other persons in everyday life situations. Journal of Personality and Social Psychology, 45, 871–883.

    CrossRef  Google Scholar 

  • Brunswik, E. (1949). Systematic and representative design of psychological experiments. Berkeley, CA: University of California Press.

    Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.

    PubMed  CrossRef  Google Scholar 

  • Case Institute of Technology. (1958). An operations research study of the scientific acitivy of chemists. Cleveland, Ohio: Operations Research Group.

    Google Scholar 

  • Cattell, R. B. (1957). Personality and motivation: Structure and measurement. New York: World Book.

    Google Scholar 

  • Cerin, E., Szabo, A., & Williams, C. (2001). Is the experience sampling method (ESM) appropriate for studying pre-competitive emotions? Psychology of Sport and Exercise, 2, 27–45.

    CrossRef  Google Scholar 

  • Conner, T., Feldman Barrett, L., Bliss-Moreau, E., Lebo, K., & Kaschub, C. (2003). A practical guide to experience-sampling procedures. Journal of Happiness Studies, 4, 53–78.

    CrossRef  Google Scholar 

  • Cote, S., & Moskowitz, D. S. (1998). On the dynamic covariation between interpersonal behavior and affect: Prediction from neuroticism, extroversion, and agreeableness. Journal of Personality and Social Psychology, 75, 1032–1046.

    PubMed  CrossRef  Google Scholar 

  • Cruise, C. E., Broderick, J., Porter, L., Kaell, A., & Stone, A. A. (1996). Reactive effects of diary self-assessment in chronic pain patients. Pain, 67, 253–258.

    PubMed  CrossRef  Google Scholar 

  • Csikszentmihalyi, M., & Larson, R. (1984). Being adolescent: Conflict and growth in the teenage years. New York: Basic Books.

    Google Scholar 

  • Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience sampling method. Journal of Nervous and Mental Disease, 175, 526–537.

    PubMed  CrossRef  Google Scholar 

  • Csikszentmihalyi, M., Larson, R., & Prescott, S. (1977). The ecology of adolescent activity and experience. Journal of Youth and Adolescence, 6, 281–294.

    CrossRef  Google Scholar 

  • Cutler, S. E., Larsen, R. J., & Bruce, S. C. (1996). Repressive coping style and the experience and recall of emotion: A naturalistic study of daily affect. Journal of Personality, 64, 379–405.

    PubMed  CrossRef  Google Scholar 

  • delle Fave, A., & Massimini, F. (1992). The ESM and the measurement of clinical change: A case of anxiety disorder. In M. W. deVries (Ed.), The experience of psychopathology: investigating mental disorders in their natural settings (pp. 280–289). New York: Cambridge University Press.

    Google Scholar 

  • Diener, E., & Biswas-Diener, R. (2000). New directions in subjective well-being research: The cutting edge. Indian Journal of Clinical Psychology, 27, 21–23.

    Google Scholar 

  • Diener, E., & Diener, C. (1996). Most people are happy. Psychological Science, 7, p.181–185.

    Google Scholar 

  • Diener, E., & Emmons, R. A. (1985). The independence of positive and negative affect. Journal of Personality and Social Psychology, 47, 1108–1117.

    Google Scholar 

  • Diener, E., & Fujita, F. (1995). Resources, personal strivings, and subjective wellbeing: A nomthetic and idiographic approach. Journal of Personality and Social Psychology, 68,\break 926–935.

    Google Scholar 

  • Diener, E., & Larsen, R. J. (1984). Temporal stability and cross-situational consistency of affective, behavioral, and cognitive responses. Journal of Personality and Social Psychology, 47, 871–883.

    PubMed  CrossRef  Google Scholar 

  • Diener, E., Larsen, R. J., & Emmons, R. A. (1984). Person X situation interactions: Choice of situations and congruence response models. Journal of Personality and Social Psychology, 47, 580–592.

    PubMed  CrossRef  Google Scholar 

  • Diener, E., Larsen, R. J., Levine, S., & Emmons, R. A. (1985). Intensity and frequency: Dimensions underlying positive and negative affect. Journal of Personality and Social Psychology, 48, 1253–1265.

    PubMed  CrossRef  Google Scholar 

  • Diener, E., Lucas, R. E., Oishi, S., & Suh, E. M. (2002). Looking up and looking down: Weighting good and bad information in life satisfaction judgments. Personality and Social Psychology Bulletin, 28, 437–445.

    CrossRef  Google Scholar 

  • Diener, E., Smith, H., & Fujita, F. (1995). The personality structure of affect. Journal of Personality and Social Psychology, 69, 130–141.

    CrossRef  Google Scholar 

  • Egloff, B., Tausch, A., Kohlmann, C.-W., & Krohne, H. W. (1995). Relationships between time of day, day of the week, and positive mood: Exploring the role of the mood measure. Motivation and Emotion, 19, 99–110.

    Google Scholar 

  • Emmons, R. A. (1986). Personal strivings: An approach to personality and subjective well-being. Journal of Personality and Social Psychology, 51, 1058–1068.

    CrossRef  Google Scholar 

  • Epstein, S. (1980). The stability of behavior: Implications for psychological research. American Psychologist, 9, 790–806.

    CrossRef  Google Scholar 

  • Fahrenberg, J., & Myrtek, M. (Eds.). (2001). Progress in ambulatory assessment: Computer-assisted psychological and psychophysiological methods in monitoring and field studies. Kirkland, WA: Hogrefe and Huber Publishers.

    Google Scholar 

  • Feldman Barrett, L. (1997). The relationships among momentary emotion experiences, personality descriptions, and retrospective ratings of emotion. Personality and Social Psychology Bulletin, 23, 1100–1110.

    CrossRef  Google Scholar 

  • Fiske, D. (1971). Measuring the concepts of personality. Chicago: Aldine.

    Google Scholar 

  • Flory, J. D., Raeikkoenen, K., Matthews, K. A., & Owens, J. F. (2000). Self-focused attention and mood during everyday social interactions. Personality and Social Psychology Bulletin, 26, 875–883.

    CrossRef  Google Scholar 

  • Flügel, J. C. (1925). quantitative study of feeling and emotion in every day life. British Journal of Psychology, 15, 318–355.

    Google Scholar 

  • Funder, D. C. (2001). Personality. Annual Review of Psychology, 52, 197–221.

    PubMed  CrossRef  Google Scholar 

  • Han, J. J., Leichtman, M. D., & Wang, Q. (1998). Autobiographical memory in Korean, Chinese, and American children. Developmental Psychology, 34, 701–713.

    PubMed  CrossRef  Google Scholar 

  • Heiland, R. E., & Richardson, W. J. (1957). Work sampling. New York: McGraw-Hill.

    Google Scholar 

  • Henry, B., Moffitt, T., Caspi, A., Langley, J., & Silva, P. A. (1994). On the “remembrance of things past”: A longitudinal evaluation of the retrospective method. Psychological Assessment, 6, 92–101.

    CrossRef  Google Scholar 

  • Hinricks, J. R. (1964). Communications activity of industrial research personnel. Personnel Psychology, 17, 193–204.

    CrossRef  Google Scholar 

  • Hormuth, S. E. (1986). The sampling of experiences in situ. Journal of Personality, 54, 262–293.

    CrossRef  Google Scholar 

  • Hurlburt, R. T. (1997). Randomly sampling thinking in the natural environment. Journal of Consulting and Clinical Psychology, 65, 941–949.

    PubMed  CrossRef  Google Scholar 

  • Isen, A. M. (1970). Success, failure, attention, and reaction to others: The warm glow of success. Journal of Personality and Social Psychology, 15, 294–301.

    CrossRef  Google Scholar 

  • Isen, A. M., & Levin, P. F. (1972). Effect of feeling good on helping: Cookies and kindness. Journal of Personality and Social Psychology, 21, 384–388.

    PubMed  CrossRef  Google Scholar 

  • Ji, L.-J., Schwarz, N., & Nisbett, R. E. (2000). Culture, autobiographical memory, and behavioral frequency reports: Measurement issues in cross-cultural studies. Personality and Social Psychology Bulletin, 26, 585–593.

    CrossRef  Google Scholar 

  • Kahneman, D. (1999). Objective happiness. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: The foundations of hedonic psychology (pp. 3–25). New York: Russell Sage \nobreak Foundation.

    Google Scholar 

  • Klinger, E. (1978–1979). Dimensions of thought an dimagery in normal waking states. Journal of Altered States of Consciousness, 4, 97–113.

    Google Scholar 

  • Lamiell, J. T. (1997). Individuals and the differences between them. In R. Hogan, J. A. Johnson, & S. R. Briggs (Eds.), Handbook of personality psychology (pp. 117–141). San Diego, CA: Academic Press. \bibitem Larsen, R. J. (1987). The stability of mood variability: A spectral analytic approach to daily mood assessments. Journal of Personality and Social Psychology, 52, 1195–1204.

    Google Scholar 

  • Larsen, R. J., & Diener, E. (1987). Affect intensity as an individual difference characteristic: A review. Journal of Research in Personality, 21, 1–39.

    CrossRef  Google Scholar 

  • Larsen, R. J., & Kasimatis, M. (1990). Individual differences in entrainment of mood to the weekly calendar. Journal of Personality and Social Psychology, 58, 164–171.

    PubMed  CrossRef  Google Scholar 

  • Larson, R. W., Richards, M. H., & Perry-Jenkins, M. (1994). Divergent worlds: The daily emotional experience of mothers and fathers in the domestic and public spheres. Journal of Personality and Social Psychology, 67, 1034–1046.

    Google Scholar 

  • Larson, R., & Delespaul, P. A. E. G. (1992). Analyzing experience sampling data: A guidebook for the perplexed. In M. W. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings (pp. 58–78). New York: Cambridge University Press.

    Google Scholar 

  • Litt, M. D., Cooney, N. L., & Morse, P. (1998). Ecological momentary assessment (EMA) with treated alcoholics: Methodological problems and potential solutions. Health Psychology, 17, 48–52.

    PubMed  CrossRef  Google Scholar 

  • Lucas, R. E. (2000). Pleasant affect and sociability: Towards a comprehensive model of extraverted feelings and behaviors. Unpublished Doctoral Dissertation, University of Illinois, Urbana-Champaign.

    Google Scholar 

  • Lynn, P. (2001). The impact of incentives on response rates to personal interview surveys: Role and perceptions of interviewers. International Journal of Public Opinion Research, 13, 326–336.

    CrossRef  Google Scholar 

  • Mathews, A., & MacLeod, C. (1994). Cognitive approaches to emotion and emotional disorderes. Annual Review of Psychology, 45, 25–50.

    PubMed  CrossRef  Google Scholar 

  • McAdams, D. P. (1995). What do we know when we know a person? Journal of Personality, 63, 365–396.

    CrossRef  Google Scholar 

  • McFarland, C., Ross, M., & DeCourville, N. (1989). Womens theories of menstruation and biases in recall of menstrual symptoms. Journal of Personality and Social Psychology, 57, 522–531.

    PubMed  CrossRef  Google Scholar 

  • Mehl, M. R., Pennebaker, J. W., Crow, M., Dabbs, J., & Price, J. (2001). The electronically activated recorder (EAR): A device for sampling naturalistic daily activities and conversations. Behavioral Research Methods, Instruments, and Computers, 33, 517–523.

    Google Scholar 

  • Mischel, W. (1968). Personality and assessment. New York: Wiley.

    Google Scholar 

  • Nolen-Hoeksema, S. (1993). Sex differences in control of depression. In P. D. M. Wegner & J. W. Pennebaker (Eds.), Handbook of mental control (pp. 306–324). New Jersey: Prentice-Hall.

    Google Scholar 

  • Nowlis, D. P., & Cohen, A. Y. (1968). Mood-reports and the college natural setting: A day in the lives of three roommates under academic pressure. Psychological Reports, 23, 551–566.

    PubMed  Google Scholar 

  • Oishi, S. (2002). The function of daily vs. retrospective judgments of satisfaction in relationship longevity. Manuscript in preparation.

    Google Scholar 

  • Oishi, S., MDiener, E., Scollon, C. N., & Biswas-Diener, R. (2004). Cross-situational consistency of affective experiences across cultures. Journal of Personality and Social Psychology, 86,\break 460–472.

    Google Scholar 

  • Pavot, W., Diener, E., & Fujita, F. (1990). Extraversion and happiness. Personality and Individual Differences, 11, 1299–1306.

    CrossRef  Google Scholar 

  • Pelham, B. W. (1993). The idiographic nature of human personality: Examples of the idiographic self-concept. Journal of Personality and Social Psychology, 64, 665–677.

    PubMed  CrossRef  Google Scholar 

  • Ptacek, J. T., Smith, R. E., Espe, K., & Raffety, B. (1994). Limited correspondence between daily coping reports and retrospective coping recall. Psychological Assessment, 6, 41–49.

    CrossRef  Google Scholar 

  • Redelmeier, D. A., & Kahneman, D., (1996). Patients memories of painful medical treatments: Real-time and retrospective evaluations of two minimally invasive procedures. Pain, 66,\break 3–8.

    Google Scholar 

  • Reis, H. T., & Gable, S. L. (2000). Event-sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 190–222). New York: Cambridge University Press.

    Google Scholar 

  • Robinson, D., & Clore, G. L., (2002). Episodic and semantic knowledge in emotional self-report: Evidence for two judgment processes. Journal of Personality and Social Psychology, 83, 198–215.

    PubMed  CrossRef  Google Scholar 

  • Ross, M. (1989). Relation of implicit theories to the construction of personal histories. Psychological Review, 96, 341–357.

    CrossRef  Google Scholar 

  • Rusting, C. L., & Larsen, R. J. (1998). Diurnal patterns of unpleasant mood: Associations with neuroticism, depression, and anxiety. Journal of Personality, 66, 85–103.

    PubMed  CrossRef  Google Scholar 

  • Ruble, D. N. (1977). Premenstrual symptoms: A reinterpretation. Science, 197, 291–292.

    PubMed  CrossRef  Google Scholar 

  • Schimmack, U. (2003). Affect measurement in experience sampling research. Journal of Happiness Studies, 4, 79–106.

    CrossRef  Google Scholar 

  • Schimmack, U. (2002). Frequency judgments of emotions: The cognitive basis of personality assessment. In P. Sedelmeier & T. Betsch (Eds.), Frequency processing and cognition. Oxford: Oxford University Press.

    Google Scholar 

  • Schimmack, U., & Diener, E. (1997). Affect intensity: Separating intensity and frequency in repeatedly measured affect. Journal of Personality and Social Psychology, 73, 1313–1329.

    CrossRef  Google Scholar 

  • Schimmack, U., Bockenholt, U., & Reisenzein, R. (2002). Response styles in affect ratings: Making a moutain out of a molehill. Journal of Personality Assessment, 78, 461–483.

    PubMed  CrossRef  Google Scholar 

  • Schwarz, N. (1994). Judgment in a social context: Biases, shortcomings, and the logic of conversation. In M. Zanna (Ed.), Advances in experimental social psychology (Vol. 26, pp. 123–162). San Diego, CA: Academic Press.

    Google Scholar 

  • Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.

    CrossRef  Google Scholar 

  • Shedler, J., Mayman, M., & Manis, M. (1993). The illusion of mental health. American Psychologist, 48, 1117–1131.

    PubMed  CrossRef  Google Scholar 

  • Scollon, C. N., Diener, E., Oishi, S., & Biswas-Diener, R. (2002). Culture, selfconcept, and memory for emotions. Manuscript under review.

    Google Scholar 

  • Scollon, C. N., Diener, E., & Oishi, S. (2002). An experience sampling and cross-cultural investigation of dialectical emotional experience. Manuscript in preparation.

    Google Scholar 

  • Snijders,T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Stone, A. A., Kessler, R. C., & Haythornwaite, J. A. (1991). Measuring daily events and experiences: Decisions for the researcher. Journal of Personality, 59, 575–607.

    PubMed  CrossRef  Google Scholar 

  • Stone, A. A., Schwartz, J. E., Neale, J. M., Shiffman, S., Marco, C. A., Hickcox, M., et al. (1998). A comparison of coping assessed by ecological momentary assessment and retrospective recall. Journal of Personality and Social Psychology, 74, 1670–1680.

    PubMed  CrossRef  Google Scholar 

  • Stone, A. A., Shiffman, S. S., & DeVries, M. W. (1999). Ecological momentary assessment. In D. Kahneman, E. Diener, & N. Schwarz (Eds.), Well-being: Foundations of a hedonic psychology (pp. 26–39). New York: Russell Sage Foundation.

    Google Scholar 

  • Tennen, H., Suls, J., & Affleck, G. (1991). Personality and daily experience: The promise and the challenge. Journal of Personality, 59, \hbox{313–337}.

    Google Scholar 

  • Thomas, D. L., & Diener, E. (1990). Memory and accuracy in the recall of emotions. Journal of Personality and Social Psychology, 59, 291–297.

    CrossRef  Google Scholar 

  • Tversky, A., & Kahneman, D. (1973). Judgment under uncertainty: Heuristics and biases. Eugene, OR: Oregon Research Institute.

    Google Scholar 

  • Wang, Q. (2001). Culture effects on adults earliest childhood recollection and selfdescription: Implications for the relation between memory and the self. Journal of Personality and Social Psychology, 81, 220–233.

    PubMed  CrossRef  Google Scholar 

  • Wessman, A. E., & Ricks, D. F. (1966). Mood and personality. New York: Holt, Rinehart and Winston.

    Google Scholar 

  • West, S. G., & Hepworth, J. T. (1991). Statistical issues in the study of temporal data: Daily experiences. Journal of Personality, 59, 609–662.

    PubMed  CrossRef  Google Scholar 

  • Wheeler, L., & Reis, H. T. (1991). Self-recordings of everyday life events: Origins, types, and uses. Journal of Personality, 59, 339–354.

    CrossRef  Google Scholar 

  • Wilson, K. C. M., Hopkins, R., deVries, M. W., & Copeland, J. R. M. (1992). Research alliance and the limit of compliance: Experience sampling with the depressed elderly. In M. W. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings. New York: Cambridge University Press.

    Google Scholar 

  • Winkielman, P., Knäuper, B., & Schwarz, N. (1998). Looking back at anger: Reference periods change the interpretation of (emotion) frequency questions. Journal of Personality and Social Psychology, 75, 719–728.

    PubMed  CrossRef  Google Scholar 

  • Wirtz, D., Kruger, J., Scollon, C. N., & Diener, E. (2003). What to do on spring break? The role of predicted, on-line, and remembered experience in future choice. Psychological Science, 14, 520–524.

    PubMed  CrossRef  Google Scholar 

  • Wong, M., & Csikszentmihalyi, M. (1991). Motivation and academic achievement: The effects of personality traits and the quality of experience. Journal of Personality, 59, 539–574.

    PubMed  CrossRef  Google Scholar 

  • Zelenski, M., & Larsen, R. J. (2000). The distribution of basic emotions in everyday life: A state and trait perspective from experience sampling data. Journal of Research in Personality, 34, 178–197.

    CrossRef  Google Scholar 

  • Zirkel, S., & Cantor, N. (1990). Personal construal of life tasks: Those who struggle for independence. Journal of Personality and Social Psychology, 58, 172–185.

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christie Napa Scollon .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 Springer Science+Business Media, B.V.

About this chapter

Cite this chapter

Napa Scollon, C., Prieto, CK., Diener, E. (2009). Experience Sampling: Promises and Pitfalls, Strength and Weaknesses. In: Diener, E. (eds) Assessing Well-Being. Social Indicators Research Series, vol 39. Springer, Dordrecht. https://doi.org/10.1007/978-90-481-2354-4_8

Download citation