Expression Strength for the Emotional Scene Detection from Lifelog Videos

  • Atsushi MorikuniEmail author
  • Hiroki Nomiya
  • Teruhisa Hochin
Part of the Studies in Computational Intelligence book series (SCI, volume 578)


For the purpose of retrieving emotional scenes from a lifelog video database, and showing them, we propose a criterion to measure the strength of emotions. Conventionally, the retrieval of the emotional scenes has been performed by distinguishing the kind of the emotion of a person. However, precisely judging the importance of the scene is difficult without the consideration of the strength of the emotion. Therefore, we introduce a criterion called expression strength in order to measure the strength of emotions based on the amount of the change of several facial feature values. The effectiveness of the expression strength for the detection of the emotional scenes with smiles is shown through an experiment using a lifelog video data set.


Lifelog Video retrieval Facial expression recognition Emotion 


  1. 1.
    Aizawa, K., Hori, T., Kawasaki, S., Ishikawa, T.: Capture and efficient retrieval of life log. In: Proceedings of Pervasive 2004 Workshop on Memory and Sharing Experiences, pp. 15–20. (2004)Google Scholar
  2. 2.
    Gemmell, J., Bell, G., Luederand, R., Drucker, S., Wong, C.: MyLifeBits: fulfilling the Memex vision. In: Proceedings of the 10th ACM International Conference on Multimedia, pp. 235–238. (2002)Google Scholar
  3. 3.
    Nomiya, H., Morikuni, A., Hochin, T.: Emotional video scene detection from lifelog videos using facial feature selection. In: Proceedings of 4th International Conference on Applied Human Factors and Ergonomics, pp. 8500–8509. (2012)Google Scholar
  4. 4.
    YouTube: (2014). Accessed 1 Apr 2014
  5. 5.
    Shimura, S., Hirano, Y., Kajita, S., Mase, K.: Experiment of recalling emotions in wearable experience recordings. In: Proceedings of the 3rd International Conference on Pervasive Computing, pp. 19–22. (2005)Google Scholar
  6. 6.
    Hu, W., Xie, N., Li, L., Zeng, X., Maybank, S.: A survey on visual content-based video indexing and retrieval. IEEE Trans. Syst. Man Cybern. 41(6), 797–819 (2011)Google Scholar
  7. 7.
    Luxand Inc.: Luxand FaceSDK 4.0. 2014. Accessed 2 Apr 2014
  8. 8.
    Ekman, P., Friesen, W.: Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. Prentice Hall, Englewood Cliffs, NJ (1975)Google Scholar
  9. 9.
    Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the 4th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53 (2000)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Atsushi Morikuni
    • 1
    Email author
  • Hiroki Nomiya
    • 1
  • Teruhisa Hochin
    • 1
  1. 1.Department of Information ScienceKyoto Institute of TechnologySakyo-kuJapan

Personalised recommendations