Recognition of Gestural Object Reference with Auditory Feedback

  • Ingo Bax
  • Holger Bekel
  • Gunther Heidemann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2714)

Abstract

We present a cognitively motivated vision architecture for the evaluation of pointing gestures. The system views a scene of several structured objects and a pointing human hand. A neural classifier gives an estimation of the pointing direction, then the object correspondence is established using a sub-symbolic representation of both the scene and the pointing direction. The system achieves high robustness because the result (the indicated location) does not primarily depend on the accuracy of the pointing direction classification. Instead, the scene is analysed for low level saliency features to restrict the set of all possible pointing locations to a subset of highly likely locations. This transformation of the “continuous” to a “discrete” pointing problem simultaneously facilitates an auditory feedback whenever the object reference changes, which leads to a significantly improved human-machine interaction.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Ingo Bax
    • 1
  • Holger Bekel
    • 1
  • Gunther Heidemann
    • 1
  1. 1.Neuroinformatics Group, Faculty of TechnologyBielefeld UniversityBielefeldGermany

Personalised recommendations