Abstract
With recent advances in robotics technologies and autonomous systems, the idea of human-robot teams is gaining ever-increasing attention. In this context, our research focuses on developing an intelligent robot that can autonomously perform non-trivial, but specific tasks conveyed through natural language. Toward this goal, a consortium of researchers develop and integrate various types of intelligence into mobile robot platforms, including cognitive abilities to reason about high-level missions, perception to classify regions and detect relevant objects in an environment, and linguistic abilities to associate instructions with the robot’s world model and to communicate with human teammates in a natural way. This paper describes the resulting system with integrated intelligence and reports on the latest assessment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anderson, J.R., Bothell, D., Byrne, M.D., Douglass, S.A., Lebiere, C., Qin, Y.: An integrated theory of the mind. Psychol. Rev. 111, 1036–1060 (2004)
Barber, D., Howard, T.M., Walter, M.R.: A multimodal interface for real-time soldier-robot teaming. In Proceedings of the SPIE 9837, Unmanned Systems Technology XVIII (2016)
Boularias, A., Duvallet, F., Oh, F., Stentz, A.: Grounding spatial relations for outdoor robot navigation. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1976–1982 (2015)
Chung, I., Propp, O., Walter, M.R., Howard, T.M.: On the performance of hierarchical distributed correspondence graphs for efficient symbol grounding of robot instructions. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5247–5252 (2015)
Dean, R.: Common world model for unmanned systems. In: Procedings of the SPIE 8741, Unmanned Systems Technology XV (2013)
Duvallet, F., Walter, M.R., Howard, T., Hemachandra, S., Oh, J., Teller, S., Roy, N., Stentz, A.: Inferring maps and behaviors from natural language instructions. In: Hsieh, M.A., Khatib, O., Kumar, V. (eds.) Experimental Robotics. STAR, vol. 109, pp. 373–388. Springer, Heidelberg (2016). doi:10.1007/978-3-319-23778-7_25
Eiter, T., Mannila, H.: Computing discrete frechet distance. Technical report, Christian Doppler Laboratory, Vienna University of Technology (1994)
Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32(9), 1627–1645 (2010)
Golland, D., Liang, P., Klein, D.: A game-theoretic approach to generating spatial descriptions. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing, pp. 410–419 (2010)
Hawes, N., Klenk, M., Lockwood, K., Horn, G.S., Kelleher, J.D.: Towards a cognitive system that can recognize spatial regions based on context. In: Proceedings of the AAAI Conference on Artificial Intelligence (2012)
Hemachandra, S., Duvallet, F., Howard, T.M., Roy, N., Stentz, A., Walter, M.R.: Learning models for following natural language directions in unknown environments. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 5608–5615 (2015)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Proceedings of the Neural Information Processing Systems, pp. 1097–1105 (2012)
Lebiere, C., Jentsch, F., Ososky, S.: Cognitive models of decision making processes for human-robot interaction. In: Proceedings of the International Conference on Virtual, Augmented and Mixed Reality, pp. 285–294 (2013)
Lennon, C., Bodt, B., Childers, M., Dean, R., Oh, J., DiBerardino, C.: Assessment of navigation using a hybrid cognitive/metric world model. Technical Report ARL-TR-7175, Army Research Labs, January 2015
Lennon, C., Bodt, B., Childers, M., Dean, R., Oh, J., DiBerardino, C., Keegan, T.: RCTA Capstone Assessment. In Proceedings of the SPIE 9468, Unmanned Systems Technology XVII (2015)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Matuszek, C., Herbst, E., Zettlemoyer, L., Fox, D.: Learning to parse natural language commands to a robot control system. In: Proceedings of the International Symposium on Experimental Robotics (2012)
Munoz, D.: Inference Machines: Parsing Scenes via Iterated Predictions. PhD thesis, The Robotics Institute, Carnegie Mellon University, 2013
Oh, J., Suppe, A., Duvallet, F., Boularias, A., Vinokurov, J., Navarro-Serment, L., Romero, O., Dean, R., Lebiere, C., Hebert, M., Stentz, A.: Toward mobile robots reasoning like humans. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1371–1379 (2015)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Proceedings of the Neural Information Processing Systems (2015)
Tellex, S., Kollar, T., Dickerson, S., Walter, M.R., Banerjee, A.G., Teller, S.J., Roy, M.: Understanding natural language commands for robotic navigation and mobile manipulation. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1507–1514 (2011)
Yang, Y., Ramanan, D.: Articulated pose estimation using flexible mixtures of parts. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1385–1392 (2011)
Zhu, M., Atanasov, N., Pappas, G.J., Daniilidis, K.: Active deformable part models inference. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 281–296. Springer, Heidelberg (2014). doi:10.1007/978-3-319-10584-0_19
Acknowledgments
This work was conducted in part through collaborative participation in the Robotics Consortium sponsored by the U.S Army Research Laboratory under the Collaborative Technology Alliance Program, Cooperative Agreement W911NF-10-2-0016, and in part by ONR under MURI grant “Reasoning in Reduced Information Spaces” (no. N00014-09-1-1052). The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Army Research Laboratory of the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation herein.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Oh, J. et al. (2017). Integrated Intelligence for Human-Robot Teams. In: Kulić, D., Nakamura, Y., Khatib, O., Venture, G. (eds) 2016 International Symposium on Experimental Robotics. ISER 2016. Springer Proceedings in Advanced Robotics, vol 1. Springer, Cham. https://doi.org/10.1007/978-3-319-50115-4_28
Download citation
DOI: https://doi.org/10.1007/978-3-319-50115-4_28
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-50114-7
Online ISBN: 978-3-319-50115-4
eBook Packages: EngineeringEngineering (R0)