An IPM Approach to Multi-robot Cooperative Localization: Pepper Humanoid and Wheeled Robots in a Shared Space
In this work we investigate the problem of multi-robot cooperative localization in dynamic environments. Specifically, we propose an approach where wheeled robots are localized using the monocular camera embedded in the head of a Pepper humanoid robot, to the end of minimizing deviations from their paths and avoiding each other during navigation tasks. Indeed, position estimation requires obtaining a linear relationship between points in the image and points in the world frame: to this end, an Inverse Perspective mapping (IPM) approach has been adopted to transform the acquired image into a bird eye view of the environment. The scenario is made more complex by the fact that Pepper’s head is moving dynamically while tracking the wheeled robots, which requires to consider a different IPM transformation matrix whenever the attitude (Pitch and Yaw) of the camera changes. Finally, the IPM position estimate returned by Pepper is merged with the estimate returned by the odometry of the wheeled robots through an Extened Kalman Filter. Experiments are shown with multiple robots moving along different paths in a shared space, by avoiding each other without onboard sensors, i.e., by relying only on mutual positioning information.
KeywordsMulti-robot cooperative localization Wheeled robots Humanoid robots Inverse perspective mapping
This work has been partially funded by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 737858 (CARESSES (www.caressesrobot.org)).
- 2.Bruno B, Chong N, Kamide H, Kanoria S, Lee J, Lim Y, Pandey A, Papadopoulos C, Papadopoulos I, Pecora F, Saffiotti A, Sgorbissa A (2017) Paving the way for culturally competent robots: a position paper. In: RO-MAN 2017 - 26th IEEE international symposium on robot and human interactive communication, vol 2017-January, pp 553–560Google Scholar
- 4.Guo C, Meguro JI, Kojima Y, Naito T (2014) Automatic lane-level map generation for advanced driver assistance systems using low-cost sensors. In: 2014 IEEE international conference on robotics and automation (ICRA), pp 3975–3982. IEEEGoogle Scholar
- 5.Laganiere R (2000) Compositing a bird’s eye view mosaic. Image 10:3Google Scholar
- 10.Mastrogiovanni F, Sgorbissa A, Zaccaria R (2009) Context assessment strategies for ubiquitous robots. In: Proceedings IEEE international conference on robotics and automation (ICRA 2009), pp 2717–2722Google Scholar
- 12.Maurino DE, Reason J, Johnston N, Lee RB (2017) Beyond aviation human factors: safety in high technology systems. RoutledgeGoogle Scholar
- 14.Moreno D, Taubin G (2012) Simple, accurate, and robust projector-camera calibration. In: 2012 second international conference on 3D imaging, modeling, processing, visualization and transmission (3DIMPVT), pp 464–471. IEEE (2012)Google Scholar
- 21.Parmiggiani A, Fiorio L, Scalzo A, Sureshbabu A, Randazzo M, Maggiali M, Pattacini U, Lehmann H, Tikhanoff V, Domenichelli D, Cardellino A, Congiu P, Pagnin A, Cingolani R, Natale L, Metta G (2017) The design and validation of the R1 personal humanoid. In: IEEE international conference on intelligent robots and systems, vol 2017-September, pp 674–680Google Scholar
- 24.Saffiotti A, Broxvall M, Gritti M, LeBlanc K, Lundh R, Rashid J, Seo B, Cho Y (2008) The PEIS-ecology project: vision and results. In: 2008 IEEE/RSJ international conference on intelligent robots and systems, IROS, pp 2329–2335Google Scholar
- 26.Stein G, Dagan E, Mano O, Shashua, A (2017) Collision warning system. US Patent 9,656,607Google Scholar
- 28.Tanveer MH, Recchiuto CT, Sgorbissa A (2018) Coordinated behaviour with a Pepper Humanoid robot to estimate the distance of other robot using inverse perspective mapping. In: IEEE international conference on automation and robotics (ICAROB)Google Scholar
- 29.Tanveer MH, Sgorbissa A (2018) An inverse perspective mapping approach using monocular camera of pepper humanoid robot to determine the position of other moving robot in plane. In: Proceedings of the 15th international conference on informatics in control, automation and robotics, vol 2. ICINCO, pp 219–225. INSTICC, SciTePressGoogle Scholar
- 30.Tuohy S, O’Cualain D, Jones E, Glavin M (2010) Distance determination for an automobile environment using inverse perspective mapping in OpenCV. In: IET irish signals and systems conference (ISSC)Google Scholar