Skip to main content
SpringerLink
Log in

User Interfaces for Self-reporting Emotions: A Systematic Literature Review

  • Conference paper
  • First Online:
Ubiquitous Computing and Ambient Intelligence. Sensing, Processing, and Using Environmental Information (UCAmI 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9454))

Abstract

Affective computing has focused on emotion acquisition using techniques of objective (sensors, facial recognition, physiological signals) and subjective measurement (self-report). Each technique has advantages and drawbacks, and a combination of the information generated from each could provide systems more balanced and accurate information about user emotions. However, there are several benefits to self-reporting emotions, over objective techniques: the collected information may be more precise and it is less intrusive to determine. This systematic literature review focuses on analyzing which technologies have been proposed to conduct subjective measurements of emotions through self-report. We aim to understand the state of the art regarding the features of interfaces for emotional self-report, identify the context for which they were designed, and describe several other aspects of the technologies. A SLR was conducted, resulting in 18 selected papers, 13 of which satisfied the inclusion criteria. We identified most existing systems use graphical user interfaces, and there are very few proposals that use tangible user interfaces to self-report emotional information, which may be an opportunity to design novel interfaces, especially for populations with low digital skills, e.g. older adults.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://dl.acm.org.

  2. 2.

    http://ieee.org/ieeexplore.

  3. 3.

    http://www.sciencedirect.com.

  4. 4.

    http://link.springer.com.

  5. 5.

    http://www.scopus.com.

  6. 6.

    http://onlinelibrary.wiley.com.

References

  1. Bardzell, S., Bardzell, J., Pace, T.: Understanding affective interaction: Emotion, engagement, and internet videos. In: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops (ACII 2009), pp. 1–8. IEEE, September 2009

    Google Scholar 

  2. Caon, M., Khaled, O.A., Mugellini, E., Lalanne, D., Angelini, L.: Ubiquitous interaction for computer mediated communication of emotions. In: Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII 2013), pp. 717–718. IEEE Computer Society, September 2013

    Google Scholar 

  3. Design, I.: Interaction Style (2014). http://www.interaction-design.org. Accessed May 2015

  4. Desmet, P.: Measuring emotion: development and application of an instrument to measure emotional responses to products. In: Blythe, M., Overbeeke, K., Monk, A., Wright, P. (eds.) Funology: From Usability to Enjoyment. Funology, Human-Computer Interaction Series, vol. 3, pp. 111–123. Springer, Dordrecht (2005)

    Chapter  Google Scholar 

  5. Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human-Computer Interaction, 3rd edn. Pearson Education Limited, Harlow (2004)

    Google Scholar 

  6. Doryab, A., Frost, M., Faurholt-Jepsen, M., Kessing, L.V., Bardram, J.E.: Impact factor analysis: combining prediction with parameter ranking to reveal the impact of behavior on health outcome. Pers. Ubiquit. Comput. 19(2), 355–365 (2015)

    Article  Google Scholar 

  7. Gallacher, S., O’Connor, J., Bird, J., Rogers, Y., Capra, L., Harrison, D., Marshall, P.: Mood squeezer: Lightening up the workplace through playful and lightweight interactions. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW 2015), pp. 891–902. ACM, March 2015

    Google Scholar 

  8. Holman, D., Vertegaal, R.: Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51(6), 48–55 (2008)

    Article  Google Scholar 

  9. Isbister, K., Höök, K., Laaksolahti, J., Sharp, M.: The sensual evaluation instrument: developing a trans-cultural self-report measure of affect. Int. J. Hum. Comput. Stud. 65(4), 315–328 (2007)

    Article  Google Scholar 

  10. Ishii, H.: Tangible bits: beyond pixels. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, pp. xv-xxv. ACM, February 2008

    Google Scholar 

  11. Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008)

    Article  Google Scholar 

  12. Jacko, J.A.: Human Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications. CRC Press, Boca Raton (2012)

    Book  Google Scholar 

  13. Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), pp. 201–210. ACM, April 2008

    Google Scholar 

  14. Jain, J., Lund, A., Wixon, D.: The future of natural user interfaces. In: Extended Abstracts on Human Factors in Computing Systems (CHI EA 2011), pp. 211–214. ACM, May 2011

    Google Scholar 

  15. Kitchenham, B., Charters, S.: Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical report EBSE 2007–01, Keele University and Durham University, July 2007

    Google Scholar 

  16. Lahey, B., Girouard, A., Burleson, W., Vertegaal, R.: Paperphone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), pp. 1303–1312. ACM, May 2011

    Google Scholar 

  17. Laurans, G., Desmet, P., Hekkert, P.: The emotion slider: A self-report device for the continuous measurement of emotion. In: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops (ACII 2009), pp. 1–6, September 2009

    Google Scholar 

  18. Lin, C.L., Gau, P.S., Lai, K.J., Chu, Y.K., Chen, C.H.: Emotion Caster: Tangible emotion sharing device and multimedia display platform for intuitive interactions. In: Proceedings of the 13th International Symposium on Consumer Electronics (ISCE 2009), pp. 988–989. IEEE, May 2009

    Google Scholar 

  19. Lisboa, L.B., Garcia, V.C., Lucrédio, D., de Almeida, E.S., de Lemos Meira, S.R., de Mattos Fortes, R.P.: A systematic review of domain analysis tools. Inf. Softw. Technol. 52(1), 1–13 (2010)

    Article  Google Scholar 

  20. Niforatos, E., Karapanos, E.: EmoSnaps: a mobile application for emotion recall from facial expressions. Pers. Ubiquit. Comput. 19(2), 425–444 (2015)

    Article  Google Scholar 

  21. Oliveira, E., Martins, P., Chambel, T.: Accessing movies based on emotional impact. Multimedia Syst. 19(6), 559–576 (2013)

    Article  Google Scholar 

  22. Picard, R.W.: Affective computing: challenges. Int. J. Hum. Comput. Stud. 59(1–2), 55–64 (2003)

    Article  Google Scholar 

  23. Read, R., Belpaeme, T.: Using the AffectButton to measure affect in child and adult-robot interaction. In: Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2013), pp. 211–212. IEEE Press, March 2013

    Google Scholar 

  24. Sánchez, J.A., Kirschning, I., Palacio, J.C., Ostróvskaya, Y.: Towards mood-oriented interfaces for synchronous interaction. In: Proceedings of the 2005 Latin American Conference on Human-Computer Interaction (CLIHC 2005), pp. 1–7. ACM, October 2005

    Google Scholar 

  25. Schubert, E., Ferguson, S., Farrar, N., Taylor, D., McPherson, G.E.: The six emotion-face clock as a tool for continuously rating discrete emotional responses to music. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 1–18. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  26. Weiser, M.: The computer for the 21st century. In: Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S. (eds.) Human-Computer Interaction, pp. 933–940. Morgan Kaufmann Publishers Inc., San Francisco (1995)

    Google Scholar 

  27. Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)

    Google Scholar 

  28. Yu, S.H., Wang, L.S., Chu, H.H., Chen, S.H., Chen, C.C.H., You, C.W., Huang, P.: A mobile mediation tool for improving interaction between depressed individuals and caregivers. Pers. Ubiquit. Comput. 15(7), 695–706 (2011)

    Article  Google Scholar 

Download references

Acknowledgements

This project was partially funded by CONICYT Chile PhD scholarship, CONICIT and MICIT Costa Rica PhD scholarship and Universidad de Costa Rica, and Fondecyt (Chile) Project No. 1150365.

Author information

Authors and Affiliations

  1. Departamento de Ciencia de la Computación, Pontificia Universidad Católica de Chile, Santiago, Chile

    Carolina Fuentes, Carmen Gerea, Valeria Herskovic & Iyubanit Rodríguez

  2. Departamento de Ciencias de la Computación, Universidad de Chile, Santiago, Chile

    Maíra Marques

  3. Departamento de Ingeniería Informática, Universidad Católica de la Santísima Concepción, Concepción, Chile

    Pedro O. Rossel

Authors
  1. Carolina Fuentes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Carmen Gerea
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Valeria Herskovic
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Maíra Marques
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Iyubanit Rodríguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Pedro O. Rossel
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carolina Fuentes .

Editor information

Editors and Affiliations

  1. Universidad de Alicante, Alicante, Spain

    Juan M. García-Chamizo

  2. University of Calabria, Rende, Italy

    Giancarlo Fortino

  3. Universidad de Chile, Santiago, Chile

    Sergio F. Ochoa

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Fuentes, C., Gerea, C., Herskovic, V., Marques, M., Rodríguez, I., Rossel, P.O. (2015). User Interfaces for Self-reporting Emotions: A Systematic Literature Review. In: García-Chamizo, J., Fortino, G., Ochoa, S. (eds) Ubiquitous Computing and Ambient Intelligence. Sensing, Processing, and Using Environmental Information. UCAmI 2015. Lecture Notes in Computer Science(), vol 9454. Springer, Cham. https://doi.org/10.1007/978-3-319-26401-1_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26401-1_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26400-4

  • Online ISBN: 978-3-319-26401-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation