User Interfaces for Self-reporting Emotions: A Systematic Literature Review

  • Carolina FuentesEmail author
  • Carmen Gerea
  • Valeria Herskovic
  • Maíra Marques
  • Iyubanit Rodríguez
  • Pedro O. Rossel
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9454)


Affective computing has focused on emotion acquisition using techniques of objective (sensors, facial recognition, physiological signals) and subjective measurement (self-report). Each technique has advantages and drawbacks, and a combination of the information generated from each could provide systems more balanced and accurate information about user emotions. However, there are several benefits to self-reporting emotions, over objective techniques: the collected information may be more precise and it is less intrusive to determine. This systematic literature review focuses on analyzing which technologies have been proposed to conduct subjective measurements of emotions through self-report. We aim to understand the state of the art regarding the features of interfaces for emotional self-report, identify the context for which they were designed, and describe several other aspects of the technologies. A SLR was conducted, resulting in 18 selected papers, 13 of which satisfied the inclusion criteria. We identified most existing systems use graphical user interfaces, and there are very few proposals that use tangible user interfaces to self-report emotional information, which may be an opportunity to design novel interfaces, especially for populations with low digital skills, e.g. older adults.


User Interface Register Emotion Digital Library Systematic Literature Review Target User 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This project was partially funded by CONICYT Chile PhD scholarship, CONICIT and MICIT Costa Rica PhD scholarship and Universidad de Costa Rica, and Fondecyt (Chile) Project No. 1150365.


  1. 1.
    Bardzell, S., Bardzell, J., Pace, T.: Understanding affective interaction: Emotion, engagement, and internet videos. In: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops (ACII 2009), pp. 1–8. IEEE, September 2009Google Scholar
  2. 2.
    Caon, M., Khaled, O.A., Mugellini, E., Lalanne, D., Angelini, L.: Ubiquitous interaction for computer mediated communication of emotions. In: Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII 2013), pp. 717–718. IEEE Computer Society, September 2013Google Scholar
  3. 3.
    Design, I.: Interaction Style (2014). Accessed May 2015
  4. 4.
    Desmet, P.: Measuring emotion: development and application of an instrument to measure emotional responses to products. In: Blythe, M., Overbeeke, K., Monk, A., Wright, P. (eds.) Funology: From Usability to Enjoyment. Funology, Human-Computer Interaction Series, vol. 3, pp. 111–123. Springer, Dordrecht (2005)CrossRefGoogle Scholar
  5. 5.
    Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human-Computer Interaction, 3rd edn. Pearson Education Limited, Harlow (2004)Google Scholar
  6. 6.
    Doryab, A., Frost, M., Faurholt-Jepsen, M., Kessing, L.V., Bardram, J.E.: Impact factor analysis: combining prediction with parameter ranking to reveal the impact of behavior on health outcome. Pers. Ubiquit. Comput. 19(2), 355–365 (2015)CrossRefGoogle Scholar
  7. 7.
    Gallacher, S., O’Connor, J., Bird, J., Rogers, Y., Capra, L., Harrison, D., Marshall, P.: Mood squeezer: Lightening up the workplace through playful and lightweight interactions. In: Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW 2015), pp. 891–902. ACM, March 2015Google Scholar
  8. 8.
    Holman, D., Vertegaal, R.: Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM 51(6), 48–55 (2008)CrossRefGoogle Scholar
  9. 9.
    Isbister, K., Höök, K., Laaksolahti, J., Sharp, M.: The sensual evaluation instrument: developing a trans-cultural self-report measure of affect. Int. J. Hum. Comput. Stud. 65(4), 315–328 (2007)CrossRefGoogle Scholar
  10. 10.
    Ishii, H.: Tangible bits: beyond pixels. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, pp. xv-xxv. ACM, February 2008Google Scholar
  11. 11.
    Ishii, H.: The tangible user interface and its evolution. Commun. ACM 51(6), 32–36 (2008)CrossRefGoogle Scholar
  12. 12.
    Jacko, J.A.: Human Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications. CRC Press, Boca Raton (2012)CrossRefGoogle Scholar
  13. 13.
    Jacob, R.J., Girouard, A., Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J.: Reality-based interaction: a framework for post-wimp interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2008), pp. 201–210. ACM, April 2008Google Scholar
  14. 14.
    Jain, J., Lund, A., Wixon, D.: The future of natural user interfaces. In: Extended Abstracts on Human Factors in Computing Systems (CHI EA 2011), pp. 211–214. ACM, May 2011Google Scholar
  15. 15.
    Kitchenham, B., Charters, S.: Guidelines for performing Systematic Literature Reviews in Software Engineering. Technical report EBSE 2007–01, Keele University and Durham University, July 2007Google Scholar
  16. 16.
    Lahey, B., Girouard, A., Burleson, W., Vertegaal, R.: Paperphone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), pp. 1303–1312. ACM, May 2011Google Scholar
  17. 17.
    Laurans, G., Desmet, P., Hekkert, P.: The emotion slider: A self-report device for the continuous measurement of emotion. In: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops (ACII 2009), pp. 1–6, September 2009Google Scholar
  18. 18.
    Lin, C.L., Gau, P.S., Lai, K.J., Chu, Y.K., Chen, C.H.: Emotion Caster: Tangible emotion sharing device and multimedia display platform for intuitive interactions. In: Proceedings of the 13th International Symposium on Consumer Electronics (ISCE 2009), pp. 988–989. IEEE, May 2009Google Scholar
  19. 19.
    Lisboa, L.B., Garcia, V.C., Lucrédio, D., de Almeida, E.S., de Lemos Meira, S.R., de Mattos Fortes, R.P.: A systematic review of domain analysis tools. Inf. Softw. Technol. 52(1), 1–13 (2010)CrossRefGoogle Scholar
  20. 20.
    Niforatos, E., Karapanos, E.: EmoSnaps: a mobile application for emotion recall from facial expressions. Pers. Ubiquit. Comput. 19(2), 425–444 (2015)CrossRefGoogle Scholar
  21. 21.
    Oliveira, E., Martins, P., Chambel, T.: Accessing movies based on emotional impact. Multimedia Syst. 19(6), 559–576 (2013)CrossRefGoogle Scholar
  22. 22.
    Picard, R.W.: Affective computing: challenges. Int. J. Hum. Comput. Stud. 59(1–2), 55–64 (2003)CrossRefGoogle Scholar
  23. 23.
    Read, R., Belpaeme, T.: Using the AffectButton to measure affect in child and adult-robot interaction. In: Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2013), pp. 211–212. IEEE Press, March 2013Google Scholar
  24. 24.
    Sánchez, J.A., Kirschning, I., Palacio, J.C., Ostróvskaya, Y.: Towards mood-oriented interfaces for synchronous interaction. In: Proceedings of the 2005 Latin American Conference on Human-Computer Interaction (CLIHC 2005), pp. 1–7. ACM, October 2005Google Scholar
  25. 25.
    Schubert, E., Ferguson, S., Farrar, N., Taylor, D., McPherson, G.E.: The six emotion-face clock as a tool for continuously rating discrete emotional responses to music. In: Aramaki, M., Barthet, M., Kronland-Martinet, R., Ystad, S. (eds.) CMMR 2012. LNCS, vol. 7900, pp. 1–18. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  26. 26.
    Weiser, M.: The computer for the 21st century. In: Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S. (eds.) Human-Computer Interaction, pp. 933–940. Morgan Kaufmann Publishers Inc., San Francisco (1995)Google Scholar
  27. 27.
    Wigdor, D., Wixon, D.: Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, Amsterdam (2011)Google Scholar
  28. 28.
    Yu, S.H., Wang, L.S., Chu, H.H., Chen, S.H., Chen, C.C.H., You, C.W., Huang, P.: A mobile mediation tool for improving interaction between depressed individuals and caregivers. Pers. Ubiquit. Comput. 15(7), 695–706 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Carolina Fuentes
    • 1
    Email author
  • Carmen Gerea
    • 1
  • Valeria Herskovic
    • 1
  • Maíra Marques
    • 2
  • Iyubanit Rodríguez
    • 1
  • Pedro O. Rossel
    • 3
  1. 1.Departamento de Ciencia de la ComputaciónPontificia Universidad Católica de ChileSantiagoChile
  2. 2.Departamento de Ciencias de la ComputaciónUniversidad de ChileSantiagoChile
  3. 3.Departamento de Ingeniería InformáticaUniversidad Católica de la Santísima ConcepciónConcepciónChile

Personalised recommendations