Abstract
Critical to natural human-robot interaction is the capability of robots to detect the contingent reactions by humans. In various interaction scenarios, a robot can recognize a human’s intention by detecting the presence or absence of a human response to its interactive signal. In our prior work [1], we addressed the problem of detecting visible reactions by developing a method of detecting changes in human behavior resulting from a robot signal. We extend the previous behavior change detector by integrating multiple cues using a mechanism that operates at two levels of information integration and then adaptively applying these cues based on their reliability. We propose a new method for evaluating reliability of cues online during interaction. We perform a data collection experiment with help of the Wizard-of-Oz methodology in a turn-taking scenario in which a humanoid robot plays the turn-taking imitation game “Simon says” with human partners. Using this dataset, which includes motion and body pose cues from a depth and color image, we evaluate our contingency detection module with the proposed integration mechanisms and show the importance of selecting the appropriate level of cue integration.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Lee, J.H., Keiser, J.F., Bobick, A.F., Thomaz, A.L.: Vision-based Contingency Detection. In: ACM/IEEE International Conference on Human-Robot Interaction, HRI (2011)
Chao, C., Lee, J.H., Begum, M., Thomaz, A.L.: Simon plays Simon says: The timing of turn-taking in an imitation game. In: IEEE International Symposium on Robot and Human Interactive Communication, ROMAN (2011)
Poppe, R.: A survey on vision-based human action recognition. Image and Vision Computing (2010)
Zhong, H., Shi, J., Visontai, M.: Detecting Unusual Activity in Video. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR (2004)
Boiman, O., Irani, M.: Detecting irregularities in images and in video. In: International Conference on Computer Vision, ICCV (2005)
Werlberger, M., Trobin, W., Pock, T., Wedel, A., Cremers, D., Bishof, H.: Anisotropic Huber-L1 Optical Flow. In: Proceedings of the British Machine Vision Conference, BMVC (2009)
Mutlu, B., Shiwa, T., Ishiguro, T.K.H., Hagita, N.: Footing in human-robot conversations: how robots might shape participant roles using gaze cues. In: ACM/IEEE International Conference on Human-Robot Interaction, HRI (2009)
Rich, C., Ponsler, B., Holroyd, A., Sidner, C.L.: Recognizing engagement in human-robot interaction. In: ACM International Conference on Human-Robot Interaction, HRI (2010)
Michalowski, M.P., Sabanovic, S., Simmons, R.: A spatial model of engagement for a social robot. In: International Workshop on Advanced Motion Control, AMC (2006)
Muller, S., Hellbach, S., Schaffernicht, E., Ober, A., Scheidig, A., Gross, H.M.: Whom to talk to? Estimating user interest from movement trajectories. In: IEEE International Symposium on Robot and Human Interactive Communication, ROMAN (2008)
Butko, N.J., Movellan, J.R.: Detecting Contingencies: An Infomax Approach. IEEE Transactions on Neural Networks (2010)
Shen, Q., Saunders, J., Kose-Bagci, H., Dautenhahn, K.: Acting and Interacting Like me? A Method for Identifying Similarity and Synchronous Behavior between a Human and a Robot. In: IEEE IROS Workshop on From Motor to Interaction Learning in Robots (2008)
The OpenNI API, http://www.openni.org
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, J., Chao, C., Thomaz, A.L., Bobick, A.F. (2011). Adaptive Integration of Multiple Cues for Contingency Detection. In: Salah, A.A., Lepri, B. (eds) Human Behavior Understanding. HBU 2011. Lecture Notes in Computer Science, vol 7065. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25446-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-25446-8_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25445-1
Online ISBN: 978-3-642-25446-8
eBook Packages: Computer ScienceComputer Science (R0)