Lessons Learned from Creating a General Purpose Tool for Experience Sampling Methods

  • André Coelho
  • Rui José
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 206)


Experience sampling methods (ESM) are a commonly used technique for capturing information from real or potential technology usage. The ubiquity of mobile phones has created a particularly appealing opportunity for all sorts of ESM studies, but there are complex technical challenges involved. In this work, we have sought to understand those challenges and the overall viability of a general purpose ESM application. The contribution of this work is the identification of the key challenges and approaches that may be more relevant in creating this type of general purpose study support. We have found that the main challenges are associated with data synchronisation, proper notification management, flexible questionnaire design, generalisation of study workflow processes, and efficient positioning. This contribution may inform the design of other generic tools for ESM-based studies.


Experience sampling User studies User study tools 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wac, K., Ickin, S., Hong, J., Janowski, L., Fiedler, M., Dey, A.K.: Studying the experience of mobile applications used in different contexts of daily life. In: Proceedings of the First ACM SIGCOMM Workshop on Measurements up the Stack - W-MUST 2011, p. 7 (2011)Google Scholar
  2. 2.
    Fischer, J.E.: Studying and tackling temporal challenges in mobile HCI. In: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA 2010, p. 2927 (2010)Google Scholar
  3. 3.
    Welpe, I.M., Reiss, M., Seiffert, P., Flake, C., Lauterbach, R., Tumasjan, A., Strobel, M., Hassold, S., Freundorfer, K.: Mobile Experience Sampling (MobXamp). Technische Universität München (2010),
  4. 4.
    Killingworth, M., Pitiyanuvath, V.: Track your happiness. Harvard University (2009),
  5. 5.
    Vastenburg, M.H., Herrera, N.R.: Adaptive Experience Sampling: Addressing the Dynamic Nature of In-Situ User Studies. In: Augusto, J.C., Corchado, J.M., Novais, P., Analide, C. (eds.) ISAmI 2010. AISC, vol. 72, pp. 197–200. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  6. 6.
    Cherubini, M., Oliver, N.: A Refined Experience Sampling Method to Capture Mobile User Experience. In: CHI 2009 Workshop: Mobile User Experience Research: Challenges, Methods & Tools, p. 12 (2009)Google Scholar
  7. 7.
    Iachello, G., Truong, K.N., Abowd, G.D., Hayes, G.R., Stevens, M.: Prototyping and sampling experience to evaluate ubiquitous computing privacy in the real world. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2006, pp. 1009–1018 (2006)Google Scholar
  8. 8.
    Consolvo, S., Walker, M.: Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2(2), 24–31 (2003)CrossRefGoogle Scholar
  9. 9.
    Intille, S.S., Rondoni, J., Kukla, C., Ancona, I., Bao, L.: A context-aware experience sampling tool. In: CHI 2003 Extended Abstracts on Human Factors in Computing Systems - CHI 2003, pp. 972–973 (2003)Google Scholar
  10. 10.
    Froehlich, J., Chen, M.Y., Consolvo, S., Harrison, B., Landay, J.A.: MyExperience. In: Proceedings of the 5th International Conference on Mobile Systems, Applications and Services - MobiSys 2007, p. 57 (2007)Google Scholar
  11. 11.
    Fischer, J.E.: Experience-Sampling Tools: a Critical Review. Journal of Youth and Adolescence, 1–3 (2009)Google Scholar
  12. 12.
    Fogarty, J., Hudson, S.E., Atkeson, C.G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J.C., Yang, J.: Predicting human interruptibility with sensors. ACM Transactions on Computer-Human Interaction 12(1), 119–146 (2005)CrossRefGoogle Scholar
  13. 13.
    Coelho, A., Meneses, F., José, R.: Delay-tolerant positioning for location-based logging with mobile devices. In: 6th International Conference on Ubiquitous Computing and Ambient Inteligence (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Centro AlgoritmiUniversity of MinhoGuimarãesPortugal

Personalised recommendations