Human-Robot Collaborative Remote Object Search
Object search is one of the typical tasks for remotely controlled service robots. Although object recognition technologies have been well developed, an efficient search strategy (or viewpoint planning method) is still an issue. This paper describes a new approach to human-robot collaborative remote object search. An analogy for our approach is ride on shoulders; a user controls a fish-eye camera on a remote robot to change views and search for a target object, independently of the robot. Combined with a certain level of automatic search capability of the robot, this collaboration can realize an efficient target object search. We developed an experimental system to show the feasibility of the approach.
KeywordsHuman-robot collaboration Object search Observation planning
- 1.A.A. Makarenko, S.B. Williams, F. Bourgault, and H.F. Durrant-Whyte. An Experiment in Integrated Exploration. In Proceedings of 2002 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 534–539, 2002.Google Scholar
- 5.F. Saidi, O. Stasse, K. Yokoi, and F. Kanehiro. Online Object Search with a Humanoid Robot. In Proceedings of 2007 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 1677–1682, 2007.Google Scholar
- 6.A. Aydemir, K. Sjöö, J. Folkesson, A. Pronobis, and P. Jensfelt. Search in the Real World: Active Visual Object Search Based on Spatial Relations. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Automation, pp. 2818–2824, 2011.Google Scholar
- 7.H. Masuzawa and J. Miura. Observation Planning for Efficient Environment Information Summarization. In Proceedings of 2009 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 5794–5780, 2009.Google Scholar
- 8.H. Masuzawa and J. Miura. Observation Planning for Environment Information Summarization with Deadlines. In Proceedings of 2010 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 30–36, 2010.Google Scholar
- 9.M. Boussard and J. Miura. Observation planning for object search by a mobile robot with uncertain recognition. In Proceedings of the 12th Int. Conf. on Intelligent Autonomous Systems, 2012. F3B.5 (CD-ROM).Google Scholar
- 10.B. Bonet and H. Geffner. Labeled RTDP: Improving the Convergence of Real-Time Dynamic Programming. In Enrico Giunchiglia, Nicola Muscettola, and Dana S. Nau, editors, Proceedings 13th Int. Conf. on Automated Planning and Scheduling (ICAPS-2003), pp. 12–31. AAAI, 2003.Google Scholar
- 12.S. Suzuki. A Vision System for Remote Control of Mobile Robot to Enlarge Field of View in Horizontal and Vertical. In Proceedings of 2011 IEEE Int. Conf. on Robotics and Biomimetics, pp. 8–13, 2011.Google Scholar
- 13.K. Saitoh, T. Machida, K. Kiyokawa, and H. Takemura. A 2D-3D Integrated Interface for Mobile Robot Control using Omnidirectional Images and 3D Geometric Models. In Proceedings of 2006 IEEE/ACM Int. Symp. on Mixed and Augmented Reality, pp. 173–176, 2006.Google Scholar
- 14.N. Shiroma, N. Sato, Y. Chiu, and F. Matsuno. Study on Effective Camera Images for Mobile Robot Teleoperation. In Proceedings of 13th IEEE Int. Workshop on Robot and Human Interactive Communication, pp. 107–112, 2004.Google Scholar
- 15.T. Fong, C. Thorpe, and C. Baur. A Safeguarded Teleoperation Controller. In Proceedings of 2001 IEEE Int. Conf. on Advanced Robotics, 2001.Google Scholar
- 17.N. Ando, T. Suehiro, and T. Kotoku. A Software Platform for Component Based RT System Development: OpenRTM-aist. In Proceedings of the 1st Int. Conf. on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR ’08), pp. 87–98, 2008.Google Scholar
- 18.OpenRTM. http://openrtm.org/openrtm/en/.
- 20.Point Cloud Library. http://pointclouds.org/.
- 21.OpenCV. http://opencv.org/.
- 22.Y. Ueno, T. Ohno, K. Terashima, H. Kitagawa, K. Funato, and K. Kakihara. Novel Differential Drive Steering System with Energy Saving and Normal Tire using Spur Gear for Omni-directional Mobile Robot. In Proceedings of the 2010 IEEE Int. Conf. on Robotics and Automation, pp. 3763–3768, 2010.Google Scholar
- 23.MRPT. http://www.mrpt.org/.