Multimedia Tools and Applications

, Volume 51, Issue 2, pp 505–523

Looking at the viewer: analysing facial activity to detect personal highlights of multimedia contents

  • Hideo Joho
  • Jacopo Staiano
  • Nicu Sebe
  • Joemon M. Jose
Article
  • 290 Downloads

Abstract

This paper presents an approach to detect personal highlights in videos based on the analysis of facial activities of the viewer. Our facial activity analysis was based on the motion vectors tracked on twelve key points in the human face. In our approach, the magnitude of the motion vectors represented a degree of a viewer’s affective reaction to video contents. We examined 80 facial activity videos recorded for ten participants, each watching eight video clips in various genres. The experimental results suggest that useful motion vectors to detect personal highlights varied significantly across viewers. However, it was suggested that the activity in the upper part of face tended to be more indicative of personal highlights than the activity in the lower part.

Keywords

Facial activity Facial expression Affective summarization 

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Hideo Joho
    • 1
  • Jacopo Staiano
    • 2
  • Nicu Sebe
    • 2
  • Joemon M. Jose
    • 3
  1. 1.Department of Library, Information and Media StudiesUniversity of TsukubaTsukubaJapan
  2. 2.Department of Information Engineering and Computer ScienceUniversity of TrentoPovoItaly
  3. 3.School of Computing ScienceUniversity of GlasgowGlasgowUK

Personalised recommendations