Journal on Multimodal User Interfaces

, Volume 7, Issue 1, pp 79–91

RAVEL: an annotated corpus for training robots with audiovisual abilities

  • Xavier Alameda-Pineda
  • Jordi Sanchez-Riera
  • Johannes Wienke
  • Vojtěch Franc
  • Jan Čech
  • Kaustubh Kulkarni
  • Antoine Deleforge
  • Radu Horaud
Original Paper

DOI: 10.1007/s12193-012-0111-y

Cite this article as:
Alameda-Pineda, X., Sanchez-Riera, J., Wienke, J. et al. J Multimodal User Interfaces (2013) 7: 79. doi:10.1007/s12193-012-0111-y

Abstract

We introduce Ravel (Robots with Audiovisual Abilities), a publicly available data set which covers examples of Human Robot Interaction (HRI) scenarios. These scenarios are recorded using the audio-visual robot head POPEYE, equipped with two cameras and four microphones, two of which being plugged into the ears of a dummy head. All the recordings were performed in a standard room with no special equipment, thus providing a challenging indoor scenario. This data set provides a basis to test and benchmark methods and algorithms for audio-visual scene analysis with the ultimate goal of enabling robots to interact with people in the most natural way. The data acquisition setup, sensor calibration, data annotation and data content are fully detailed. Moreover, three examples of using the recorded data are provided, illustrating its appropriateness for carrying out a large variety of HRI experiments. The Ravel data are publicly available at: http://ravel.humavips.eu/.

Keywords

Audio-visual data set Binocular vision Binaural hearing Action/gesture recognition Human robot interaction Audio-visual robotics 

Copyright information

© OpenInterface Association 2012

Authors and Affiliations

  • Xavier Alameda-Pineda
    • 1
  • Jordi Sanchez-Riera
    • 1
  • Johannes Wienke
    • 2
  • Vojtěch Franc
    • 3
  • Jan Čech
    • 1
  • Kaustubh Kulkarni
    • 1
  • Antoine Deleforge
    • 1
  • Radu Horaud
    • 1
  1. 1.INRIA Grenoble Rhône-AlpesMontobonnotFrance
  2. 2.Universität BielefeldBielefeldGermany
  3. 3.Czech Technical UniversityPragueCzech Republic