Abstract
We report on the procedures followed in order to acquire a multimodal sensory corpus that will become the primary source of data retrieval, data analysis and testing of mobility assistive robot prototypes in the European project MOBOT. Analysis of the same corpus with respect to all sensorial data will lead to the definition of the multimodal interaction model; gesture and audio data analysis is foreseen to be integrated into the platform in order to facilitate the communication channel between end users and the assistive robot prototypes expected to be the project’s outcomes. In order to allow estimation of the whole range of sensorial data acquired, we will refer to the data acquisition scenarios followed in order to obtain the required multisensory data and to the initial post-processing outcomes currently available.
Chapter PDF
Similar content being viewed by others
References
Sigal, L., Balan, A., Black, M.: HumanEva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. Int. Journal of Comput. Vis. 87, 4–27 (2010)
Tenorth, M., Bandouch, J., Beetz, M.: The TUM Kitchen Data Set of everyday manipulation activities for motion tracking and action recognition. In: IEEE Int. Conf. on Computer Vision Workshops (ICCVW), pp. 1089–1096 (2009)
De La Torre, F., Hodgins, J., Montano, J., Valcarcel, S., Forcada, R.: Macey. J.: Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) database. Technical Report CMU-RI-TR-08-22, Robotics Institute, Carnegie Mellon University (2009)
Ofli, F., Chaudhry, R., Kurillo, G., Vidal, R., Bajcsy, R.: MHAD: A Comprehensive Multimodal Human Action Database. In: Workshop on the Applications of Computer Vision, pp. 53–60 (2013)
MOBOT’s Deliverable D5.1- Preliminary report on use cases and user needs
Matthes, S., Hanke, T., Regen, A., Storz, J., Worseck, S., Efthimiou, E., Dimou, A.-L., Braffort, A., Glauert, J., Safar, E.: Dicta-Sign – Building a Multilingual Sign Language Corpus. In: Proc. of the 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon (LREC 2012), Istanbul, Turkey (2012)
Matthes, S., Hanke, T., Storz, J., Efthimiou, E., Dimou, A.-L., Karioris, P., Braffort, A., Choisier, A., Pelhate, J., Safar, E.: Elicitation Tasks and Materials designed for Dicta-Sign’s Multi-lingual Corpus. In: Proc. of the 5th Workshop on the Representation and Processing of Sign Languages: Interactions between Corpus and Lexicon (LREC 2012), Istanbul, Turkey (2012)
Wallraven, C., Schultze, M., Mohler, B., Vatakis, A., Pastra, K.: The POETICON enacted scenario corpus - a tool for human and computational experiments on action understanding. In: Proc. 9th IEEE Conference on Automatic Face and Gesture Recognition (2011)
Pastra, K., Wallraven, C., Schultze, M., Vatakis, A., Kaulard, K.: The POETICON Corpus: Capturing Language Use and Sensorimotor Experience in Everyday Interaction. In: Proc. of LREC 2010, 7th Int’l Conference on Language Resources and Evaluation (2010)
MOBOT’s Deliverable D2.1- Data acquisition and multimodal sensory corpora collection
Folstein, M.F., Folstein, S.E., McHugh, P.R.: Mini-mental state. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatry Res. 12(3), S.89–S.98 (1975)
Woodford, H.J., George, J.: Cognitive assessment in the elderly: a review of clinical methods. Q. J. Med. 100, 469–484 (2007)
Brugman, H., Russel, A.: Annotating Multimedia/ Multi-modal resources with ELAN. In: Proc. of LREC 2004, 4th Int’l Conference on Language Resources and Evaluation (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Fotinea, ES. et al. (2014). Data Acquisition towards Defining a Multimodal Interaction Model for Human – Assistive Robot Communication. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Aging and Assistive Environments. UAHCI 2014. Lecture Notes in Computer Science, vol 8515. Springer, Cham. https://doi.org/10.1007/978-3-319-07446-7_59
Download citation
DOI: https://doi.org/10.1007/978-3-319-07446-7_59
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07445-0
Online ISBN: 978-3-319-07446-7
eBook Packages: Computer ScienceComputer Science (R0)