Validity and Reliability of the Experience-Sampling Method

Chapter

Abstract

To understand the dynamics of mental health, it is essential to develop measures for the frequency and the patterning of mental processes in every-day-life situations. The Experience-Sampling Method (ESM) is an attempt to provide a valid instrument to describe variations in self-reports of mental processes. It can be used to obtain empirical data on the following types of variables: (a) frequency and patterning of daily activity, social interaction, and changes in location; (b) frequency, intensity, and patterning of psychological states, i.e., emotional, cognitive, and conative dimensions of experience; (c) frequency and patterning of thoughts, including quality and intensity of thought disturbance. The article reviews practical and methodological issues of the ESM and presents evidence for its short-and long-term reliability when used as an instrument for assessing the variables outlined above.

References

  1. Altschuller, M. l. (1923). Byudzhet vremeni (Time Budgets). Perm: USSR.Google Scholar
  2. Barker, R. G. (1968). Ecological psychology. Stanford: Stanford University Press.Google Scholar
  3. Barker, R. G., & Wright, H. F. (1955). Midwest and its children. New York: Row, Peterson, Evannton.Google Scholar
  4. Barker, R. G., Wright, H. F., Barker, L. S., & Schoggen, M. F. (1961). Specimen records of American and english children. Lawrence: University of Kansas Press.Google Scholar
  5. Bernard, H. R., Killworth, P., Kronenfeld, D., & Sailer, L. (1984). On the validity of retrospective data: The problem of informant accuracy. Annual Review of Anthropology, 13, 495–517.Google Scholar
  6. Bevans, G. E. (1913). How workingmen spend their spare time. New York: Columbia University Press.Google Scholar
  7. Bradburn, N. (1969). The structure of psychological well-being. Chicago: Aldine.Google Scholar
  8. Brandstatter, H. (1983). Emotional responses to other persona in everyday life situations. Journal of Personality and Social Psychology, 46, 871–883.Google Scholar
  9. Brunawick, E. (Ed.). (1952). The conceptual framework of psychology. International encyclopedia of unified science (Vol. 1(10)). Chicago: University of Chicago Press.Google Scholar
  10. Buse, L., & Pawlik, K. (1984). Inter-Setting-Korrelationen und Setting-Personlichkelts-Weschelwirkungen: Ergebnisse einer Feldunter-suchung zur Konsistenz von Verhalten and Erleben. Zeitschrift fur Socialpyschologie, 15, 44–59.Google Scholar
  11. CsikuMntmihalyi, M., & Figurski, T. J. (1982). Self-awareness and aversive experience in everyday life. Journal of Personality, 50, 14–26.Google Scholar
  12. Csikszentmihalyi, M., & Graef, R. (1980). The experience of freedom in everyday life. American Journal of Community Psychology, 18, 401–414.Google Scholar
  13. Csikszentmihalyi, M., & Larson, R. (1984). Being adolescent: Conflict and growth in the teenage years. New York: Basic.Google Scholar
  14. Csikszentmihalyi, M., Larson, R., & Prescott, S. (1977). The ecology of adolescent activity and experience. Journal of Youth and Adolescence, 6, 281–294.Google Scholar
  15. deVries, M. (1983). Temporal patterning of psychiatric symptoms. Vienna: World Psychiatric Association Congress.Google Scholar
  16. deVries, M. (1984). Temperament and infant mortality. American Journal of Psychiatry, 141, 1189–1194.Google Scholar
  17. deVries, M., Delespaul, P., Dijkman, C., & Theunissen, J. (1986). Temporal and situational aspects of severe mental disorders. Milan Angeli: L’Esperienza quotidiana.Google Scholar
  18. Diener, E., Larson, R. J., & Emmons, R. A. (1984). Person X situation interactions: Choices of situations and congruence response models. Journal of Personality and Social Psychology, 47, 592–680.Google Scholar
  19. Dijkman, C. I. M., & deVries, M. W. (1987). The social ecology of anxiety: Theoretical and quantitative perspectives. Journal of Nervous and Mental Disease, 175, 550–557.Google Scholar
  20. Divilbiss, J., & Self, P. (1978). Work analysis by random sampling. Bulletin of the Medical Library Association, 66, 19–32.Google Scholar
  21. Endler, N. S., & Magnusson, D. (Eds.). (1976). Interactional psychology and personality. New York: Wiley.Google Scholar
  22. Ericsson, K., & Simon, H. (1980). Verbal reports as data. Psychological Review, 87, 216–251.Google Scholar
  23. Filstead, W., Reich, W., Parrella, D., & Rossi, J. (1985). Using electronic pagers to monitor the process of recovery in alcoholics and drug abusers. Paper presented at the 34th international congress on alcohol, drug Abuse and Tobacco, Calgary, Alberta, Canada.Google Scholar
  24. Fiske, D. (1971). Measuring the concept of personality. Chicago: Aldine.Google Scholar
  25. Franzoi, S. L., & Brewer, L. C. (1984) The experience of self-awareness and its relation to level of self-consciousness: An experiential sampling study. Journal of Research in Personality, 18, 522–540.Google Scholar
  26. Freeman, M., Larson, R., & Csikszentmihalyi, M. (1980) Immediate experience and its recollection. Merrill Palmer Quarterly, 32, 167–185.Google Scholar
  27. Giannino, S., Graef, R., & Csikszentmihalyi, M. (1979) Well-being and the perceived balance between opportunities and capabilities. Paper presented at the 87th convention of the American Psychiatric Association, New York, New York.Google Scholar
  28. Graef, R., Csikszentmihalyi, M., & Gianinno, S. (1983). Measuring intrinsic motivation in everyday life. Leisure Studies, 2, 155–168.Google Scholar
  29. Greene, A. (1985). Self-concept and life transitions in early adolescence. Paper presented at the biannual meeting of the society for research on child development, Toronto, Ontario, Canada.Google Scholar
  30. Gurin, G., Veroff, J., & Field, S. (1960). Americans view their mental health. New York: Basic.Google Scholar
  31. Hamilton, J. A., Hater, R. J., & Buchsbaum, M. S. (1984). Intrinsic enjoyment and boredom coping scales: Validation with personality, evoked potential and attention measures. Personality and Individual Differences, 5, 183–193.Google Scholar
  32. Harre, R., & Secord, P. F. (1972). The explanation of social behavior. Oxford: Blackwelt.Google Scholar
  33. Hormuth, S. E. (1984). Transitions in commitments to roles and self-concept change; recreation as a paradigm. In V. L. Allen & E. van de Vliert (Eds.), Role transitions: Explorations and explanations. New York: Plenum.Google Scholar
  34. Harmuth, S. E. (1985). Methaden fur psychologische Forschung im Pels (Diskussionspapier Nr 43). Heidelberg: Paychologischen Institut der Universitat Heidelberg.Google Scholar
  35. Hormuth, S. E. (1986). The sampling of experiences in situ. Journal of Personality, 54, 262–293.Google Scholar
  36. Hurlburt, R. T. (1979). Random sampling of cognitions and behavior. Journal of Research in Personality, 13, 103–111.Google Scholar
  37. Hurlburt, R. T. (1980). Validation and correlation of thought sampling with retrospective measures. Cognitive Therapy and Research, 4, 235–238.Google Scholar
  38. Johnson, A. (1973). Time allocation in a machiquenga community. Ethology, 14, 301–310.Google Scholar
  39. Johnson, C., & Larson, R. (1982). Bulimia: An analysis of moods and behavior. Psychosomatic Medicine, 44, 341–351.Google Scholar
  40. Klinger, E., Barta, S., & Mexeimer, M. (1980). Motivational correlates of thought content frequency and commitment. Journal of Personality and Social Psychology, 39, 1222–1237.Google Scholar
  41. Larson, R., & Csikszentmihalyi, M. (1983). The experience sampling method. In H. Reis (Ed.), New directions for naturalistic methods in the behavioral sciences. San Francisco: Jossey-Bass.Google Scholar
  42. Larson, R., Csikszentmihalyi, M., & Freeman, M. (1984). Alcohol and marijuana use in adolescents’ daily lives: A random sample of experiences. The International Journal of the Addictions, 19, 367–381.Google Scholar
  43. Larson, R., Csikszentmihalyi, M., & Graef, R. (1982). Time alone in daily eiperience: loneliness or renewal? In L. A. Peplau & D. Perlman (Eds.), Loneliness; A sourcebook of research and theory. New York: Wiley.Google Scholar
  44. LeFevre, J., Hendricks, C., Church, R., & McClintock, M. (1985). Psycho-logical and social behavior in couples over menstrual cycle: ‘On-the-spot’ sampling from everyday life. Paper presented at the 6th conference of the society for menstrual cycle research, Galveston.Google Scholar
  45. Lewin, K. (1936). Principles of topological psychology. New York: McGraw-Hill.Google Scholar
  46. Loewenstein, R. J., Hamilton, J., Magna, S. et al. (1987). Experiential sampling in the study of multiple personality disorder. American Journal of Psychiatry, 144, 19–24.Google Scholar
  47. Maddi, S. R., Kobasa, S. C., & Hoover, M. (1979). An alienation test. Journal of Humanistic Psychology, 19, 73–76.Google Scholar
  48. Magnusson, D., & Endler, N. S. (1977). Interactional psychology: Present status and future prospects. In D. Magnusson & N. S. Endler (Eds.), Personality at the crossroads: Current issues in interactional psychology. Hillside: Erlbaum.Google Scholar
  49. Margraf, J., Taylor, C. B., Ehlers, A. et al. (1987). Panic attacks in the natural environment. Journal of Nervous and Mental Disease, 175, 558–565.Google Scholar
  50. McAdams, D., & Constantian, C. A. (1983). Intimacy and affiliation motives in daily living: An experience sampling analysis. Journal of Personality and Social Psychology, 45, 851–861.Google Scholar
  51. Mischel, W. (1968). Personality and assessment. New York: Wiley.Google Scholar
  52. Mischel, W. (1981). A cognitive-social learning approach to assess-ment. In T. Merluzzi, C. Glass M. Genest (Eds.), Cognitive assessment. New York: Guilford.Google Scholar
  53. Munroe, R. H., & Munroe, R. L. (1971a). Household density and infant care in an East African society. Journal of Social Psychology, 83, 9–13.Google Scholar
  54. Munroe, R. H., & Munroe, R. L. (1971b). Effect of environmental experience on spatial ability in an East African society. Journal of Social Psychology, 83, 15–22.Google Scholar
  55. Murray, H. A. (1938). Explorations in personality. New York: Oxford University Press.Google Scholar
  56. Pawlik, K., & Buse, L. (1982). Rechnergestutzt verhattensregistrierung im Fetd: Beschreibung und erst psychometrische Uberprufung einfer neuen Erhebungsmethode. Zeitschrift fur Differentielle und Diagnostiche Psychobgie, 3, 101–118.Google Scholar
  57. Pervin, L. A. (1985). Personality: Current controversies, issues, and directions. Annual Review of Psychology, 36, 83–114.Google Scholar
  58. Robinson, J. (1977). How Americans use time. New York: Praeger.Google Scholar
  59. Rogoff, B. (1978). Spot observation: An introduction and examination. Quarterly Newsletter of the Institute for Comparative Human Development, 2, 21–26.Google Scholar
  60. Savin-Williams, R. C., & Demo, D. H. (1983). Situational and transnational determinants of adolescents’ self-feelings. Journal of Personality and Social Psychology, 44, 824–833.Google Scholar
  61. Sorokin, P., & Berger, C. (1939). Time budgets and human behavior. Cambridge: Harvard University Press.Google Scholar
  62. Spencer, C. (1971). Random time sampling with self-observation for library cost studies: Unit costs of interlibrary loans and photocopies at a regional medical library. Journal of the American Society for Information Science, 32, 153–160.Google Scholar
  63. Szalai, A. (1972). The use of time. Mouton: The Hauge.Google Scholar
  64. Thorndike, E. L. (1937) How we spend our time and what we spend it for. Scientific Monthly, 44(5), 464–469.Google Scholar
  65. Wegner, D. M., & Vallacher, R. R. (1977). Implicit psychology an introduction to social cognition. New York: Oxford University Press.Google Scholar
  66. Yarmey, D. (1979). The psychology of eyewitness testimony. New York: Free Press.Google Scholar
  67. Zuzanek, J. (1980). Work and leisure in the Soviet Union: A time budget analysis. New York: Praeger.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2014

Authors and Affiliations

  1. 1.Division of Behavioral & Organizational ScienceClaremont Graduate UniversityClaremontUSA
  2. 2.Department of PsychologyUniversity of IllinoisUrbanaUSA

Personalised recommendations