Is the Mood Really in the Eye of the Beholder?
A great deal of scientific evidence suggests that there is a close relationship between mood and cognitive processes of human in everyday tasks. In this study, we have investigated the feasibility of determining mood from gaze, which is one of the human cognitive processes that can be recorded during interaction with computers. To do so, we have designed a feature vector composed of typical gaze patterns, and piloted the approach on the dataset which we gathered. It consists of 145 samples of 30 people. A supervised machine learning technique was employed for classification and recognition of mood. The results of this pilot test suggests that even during these initial steps, the approach is quite promising and opens other research paths for improvement through multi-modal recognition and information fusion. Multi-modal approach would employ the added information provided by our previously developed mood extraction approach using camera and/or the information gained by the use of EEG signals. Further analysis will be performed in feature extraction process to enhance the model accuracy by enriching the feature-set of each modality.
KeywordsMood Gaze Cognition Affective computing Human computer interaction
The first author would like to thank members of Advanced Robotics and Intelligent Systems lab, Social Networks lab, and Mobile Robot lab for their endless helps and participation in the experiment. This work was supported by NPRP grant 09- 310-1– 058, and grant 7-684-1-127 from the Qatar National Research Fund (a member of Qatar Foundation). The statements made herein are solely the responsibly of the authors.
- 1.Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)Google Scholar
- 5.Thayer, R.E.: The Origin of Everyday Moods. Oxford University Press, New York (1996)Google Scholar
- 6.Hashemian, M., Nikoukaran, A., Moradi, H., Mirian, M.S., Tehrani-doost, M.: Determining mood using emotional features. In: 2014 7th International Symposium on Telecommunications (IST), pp. 418–423. IEEE (2014)Google Scholar
- 11.Henderson, J.M., Hollingworth, A.: Eye movements during scene viewing: an overview. In: Eye Guidance in Reading and Scene Perception, vol. 11, pp. 269−293 (1998)Google Scholar
- 13.Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-doost, M.: Determining mood via emotions observed in face by induction. In: 2014 Second RSI/ISM International Conference on Robotics and Mechatronics (ICRoM), pp. 717–722. IEEE (2014)Google Scholar
- 14.Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-doost, M., Mahmoudyar, N.: Recognizing Mood using Facial Emotional Features. IEEE Transaction on Affective Computing (Under Review)Google Scholar
- 15.Tobii Technology AB. Accuracy and precision Test report X2-30 fw 1.0.1. 28 May 2013Google Scholar
- 20.Tobii eye-tracking white papers. http://www.tobii.com/en/eye-tracking-research/global/library/white-papers/tobii-eye-tracking-white-paper/. Accessed 9 April 2015