Is the Mood Really in the Eye of the Beholder?

  • Mojgan HashemianEmail author
  • Hadi Moradi
  • Maryam S. Mirian
  • Mehdi Tehrani-Doost
  • Rabab K. Ward
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 528)


A great deal of scientific evidence suggests that there is a close relationship between mood and cognitive processes of human in everyday tasks. In this study, we have investigated the feasibility of determining mood from gaze, which is one of the human cognitive processes that can be recorded during interaction with computers. To do so, we have designed a feature vector composed of typical gaze patterns, and piloted the approach on the dataset which we gathered. It consists of 145 samples of 30 people. A supervised machine learning technique was employed for classification and recognition of mood. The results of this pilot test suggests that even during these initial steps, the approach is quite promising and opens other research paths for improvement through multi-modal recognition and information fusion. Multi-modal approach would employ the added information provided by our previously developed mood extraction approach using camera and/or the information gained by the use of EEG signals. Further analysis will be performed in feature extraction process to enhance the model accuracy by enriching the feature-set of each modality.


Mood Gaze Cognition Affective computing Human computer interaction 



The first author would like to thank members of Advanced Robotics and Intelligent Systems lab, Social Networks lab, and Mobile Robot lab for their endless helps and participation in the experiment. This work was supported by NPRP grant 09- 310-1– 058, and grant 7-684-1-127 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibly of the authors.


  1. 1.
    Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)Google Scholar
  2. 2.
    Lewis, P.A., Critchley, H.D.: Mood-dependent memory. Trends Cogn. Sci. 7(10), 431–433 (2003)CrossRefGoogle Scholar
  3. 3.
    Bryan, T., Mathur, S., Sullivan, K.: The impact of positive mood on learning. Learn. Disabil. Q. 19(3), 153–162 (1996)CrossRefGoogle Scholar
  4. 4.
    Suzanne, K., Vosburg, G.K.: ‘Paradoxical’ mood effects on creative problem-solving. Cogn. Emot. 11(2), 151–170 (1997)CrossRefGoogle Scholar
  5. 5.
    Thayer, R.E.: The Origin of Everyday Moods. Oxford University Press, New York (1996)Google Scholar
  6. 6.
    Hashemian, M., Nikoukaran, A., Moradi, H., Mirian, M.S., Tehrani-doost, M.: Determining mood using emotional features. In: 2014 7th International Symposium on Telecommunications (IST), pp. 418–423. IEEE (2014)Google Scholar
  7. 7.
    Hudlicka, E.: To feel or not to feel: the role of affect in human–computer interaction. Int. J. Hum. Comput. Stud. 59(1), 1–32 (2003)CrossRefGoogle Scholar
  8. 8.
    Picard, R.W.: Toward computers that recognize and respond to user emotion. IBM Syst. J. 39(3–4), 705–719 (2000)CrossRefGoogle Scholar
  9. 9.
    Bower, G.H.: Mood and memory. Am. Psychol. 36(2), 129 (1981)CrossRefGoogle Scholar
  10. 10.
    Zimmermann, P., Guttormsen, S., Danuser, B., Gomez, P.: Affective computing–a rationale for measuring mood with mouse and keyboard. Int. J. Occup. Saf. Ergon. 9(4), 539–551 (2003)CrossRefGoogle Scholar
  11. 11.
    Henderson, J.M., Hollingworth, A.: Eye movements during scene viewing: an overview. In: Eye Guidance in Reading and Scene Perception, vol. 11, pp. 269−293 (1998)Google Scholar
  12. 12.
  13. 13.
    Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-doost, M.: Determining mood via emotions observed in face by induction. In: 2014 Second RSI/ISM International Conference on Robotics and Mechatronics (ICRoM), pp. 717–722. IEEE (2014)Google Scholar
  14. 14.
    Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-doost, M., Mahmoudyar, N.: Recognizing Mood using Facial Emotional Features. IEEE Transaction on Affective Computing (Under Review)Google Scholar
  15. 15.
    Tobii Technology AB. Accuracy and precision Test report X2-30 fw 1.0.1. 28 May 2013Google Scholar
  16. 16.
    Frederick, S.: Cognitive reflection and decision making. J. Econ. Perspect. 19, 25–42 (2005)CrossRefGoogle Scholar
  17. 17.
    Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)CrossRefGoogle Scholar
  18. 18.
    Martin, E., Kerns, J.: The influence of positive mood on different aspects of cognitive control. Cogn. Emot. 25(2), 265–279 (2011)CrossRefGoogle Scholar
  19. 19.
    Subramanian, R., Shankar, D., Sebe, N., Melcher, D.: Emotion modulates eye movement patterns and subsequent memory for the gist and details of movie scenes. J. Vis. 14(3), 31 (2014)CrossRefGoogle Scholar
  20. 20.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Mojgan Hashemian
    • 1
    Email author
  • Hadi Moradi
    • 1
  • Maryam S. Mirian
    • 1
    • 2
  • Mehdi Tehrani-Doost
    • 3
  • Rabab K. Ward
    • 4
  1. 1.Advanced Robotics and Intelligent Systems LabUniversity of TehranTehranIran
  2. 2.Department of Computer ScienceUBCVancouverCanada
  3. 3.Tehran University of Medical SciencesTehranIran
  4. 4.Department of Electrical and Computer EngineeringUBCVancouverCanada

Personalised recommendations