Recognition of Gestural Object Reference with Auditory Feedback
- First Online:
- Cite this paper as:
- Bax I., Bekel H., Heidemann G. (2003) Recognition of Gestural Object Reference with Auditory Feedback. In: Kaynak O., Alpaydin E., Oja E., Xu L. (eds) Artificial Neural Networks and Neural Information Processing — ICANN/ICONIP 2003. Lecture Notes in Computer Science, vol 2714. Springer, Berlin, Heidelberg
We present a cognitively motivated vision architecture for the evaluation of pointing gestures. The system views a scene of several structured objects and a pointing human hand. A neural classifier gives an estimation of the pointing direction, then the object correspondence is established using a sub-symbolic representation of both the scene and the pointing direction. The system achieves high robustness because the result (the indicated location) does not primarily depend on the accuracy of the pointing direction classification. Instead, the scene is analysed for low level saliency features to restrict the set of all possible pointing locations to a subset of highly likely locations. This transformation of the “continuous” to a “discrete” pointing problem simultaneously facilitates an auditory feedback whenever the object reference changes, which leads to a significantly improved human-machine interaction.
Unable to display preview. Download preview PDF.