Recognition of Gestural Object Reference with Auditory Feedback

  • Ingo Bax
  • Holger Bekel
  • Gunther Heidemann
Conference paper

DOI: 10.1007/3-540-44989-2_51

Volume 2714 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Bax I., Bekel H., Heidemann G. (2003) Recognition of Gestural Object Reference with Auditory Feedback. In: Kaynak O., Alpaydin E., Oja E., Xu L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg

Abstract

We present a cognitively motivated vision architecture for the evaluation of pointing gestures. The system views a scene of several structured objects and a pointing human hand. A neural classifier gives an estimation of the pointing direction, then the object correspondence is established using a sub-symbolic representation of both the scene and the pointing direction. The system achieves high robustness because the result (the indicated location) does not primarily depend on the accuracy of the pointing direction classification. Instead, the scene is analysed for low level saliency features to restrict the set of all possible pointing locations to a subset of highly likely locations. This transformation of the “continuous” to a “discrete” pointing problem simultaneously facilitates an auditory feedback whenever the object reference changes, which leads to a significantly improved human-machine interaction.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Ingo Bax
    • 1
  • Holger Bekel
    • 1
  • Gunther Heidemann
    • 1
  1. 1.Neuroinformatics Group, Faculty of TechnologyBielefeld UniversityBielefeldGermany