Chapter

Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003

Volume 2714 of the series Lecture Notes in Computer Science pp 425-432

Date:

Recognition of Gestural Object Reference with Auditory Feedback

  • Ingo BaxAffiliated withNeuroinformatics Group, Faculty of Technology, Bielefeld University
  • , Holger BekelAffiliated withNeuroinformatics Group, Faculty of Technology, Bielefeld University
  • , Gunther HeidemannAffiliated withNeuroinformatics Group, Faculty of Technology, Bielefeld University

* Final gross prices may vary according to local VAT.

Get Access

Abstract

We present a cognitively motivated vision architecture for the evaluation of pointing gestures. The system views a scene of several structured objects and a pointing human hand. A neural classifier gives an estimation of the pointing direction, then the object correspondence is established using a sub-symbolic representation of both the scene and the pointing direction. The system achieves high robustness because the result (the indicated location) does not primarily depend on the accuracy of the pointing direction classification. Instead, the scene is analysed for low level saliency features to restrict the set of all possible pointing locations to a subset of highly likely locations. This transformation of the “continuous” to a “discrete” pointing problem simultaneously facilitates an auditory feedback whenever the object reference changes, which leads to a significantly improved human-machine interaction.