ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results

  • Víctor Ponce-López
  • Baiyu Chen
  • Marc Oliu
  • Ciprian Corneanu
  • Albert Clapés
  • Isabelle Guyon
  • Xavier Baró
  • Hugo Jair Escalante
  • Sergio Escalera
Conference paper

DOI: 10.1007/978-3-319-49409-8_32

Volume 9915 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Ponce-López V. et al. (2016) ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results. In: Hua G., Jégou H. (eds) Computer Vision – ECCV 2016 Workshops. ECCV 2016. Lecture Notes in Computer Science, vol 9915. Springer, Cham

Abstract

This paper summarizes the ChaLearn Looking at People 2016 First Impressions challenge data and results obtained by the teams in the first round of the competition. The goal of the competition was to automatically evaluate five “apparent” personality traits (the so-called “Big Five”) from videos of subjects speaking in front of a camera, by using human judgment. In this edition of the ChaLearn challenge, a novel data set consisting of 10,000 shorts clips from YouTube videos has been made publicly available. The ground truth for personality traits was obtained from workers of Amazon Mechanical Turk (AMT). To alleviate calibration problems between workers, we used pairwise comparisons between videos, and variable levels were reconstructed by fitting a Bradley-Terry-Luce model with maximum likelihood. The CodaLab open source platform was used for submission of predictions and scoring. The competition attracted, over a period of 2 months, 84 participants who are grouped in several teams. Nine teams entered the final phase. Despite the difficulty of the task, the teams made great advances in this round of the challenge.

Keywords

Behavior analysis Personality traits First impressions 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Víctor Ponce-López
    • 1
    • 2
    • 6
  • Baiyu Chen
    • 4
  • Marc Oliu
    • 6
  • Ciprian Corneanu
    • 1
    • 2
  • Albert Clapés
    • 2
  • Isabelle Guyon
    • 3
    • 5
  • Xavier Baró
    • 1
    • 6
  • Hugo Jair Escalante
    • 3
    • 7
  • Sergio Escalera
    • 1
    • 2
    • 3
  1. 1.Computer Vision CenterCampus UABBarcelonaSpain
  2. 2.Department of MathematicsUniversity of BarcelonaBarcelonaSpain
  3. 3.ChaLearnBerkeleyUSA
  4. 4.UC BerkeleyBerkeleyUSA
  5. 5.University of Paris-SaclayParisFrance
  6. 6.EIMT/IN3 at the Open University of CataloniaBarcelonaSpain
  7. 7.INAOEPueblaMexico