Skip to main content
SpringerLink
Log in

Object-spatial layout-route based hybrid map and global localization for mobile robots

  • Regular Papers
  • Robotics and Automation
  • Published:
International Journal of Control, Automation and Systems Aims and scope Submit manuscript

Abstract

This paper presents new object-spatial layout-route based hybrid map representation and global localization approaches using a stereo camera. By representing objects as high-level features in a map, a robot can deal more effectively with different contexts such as dynamic environments, human-robot interaction, and semantic information. However, the use of objects alone for map representation has inherent problems. For example, it is difficult to represent empty spaces for robot navigation, and objects are limited to readily recognizable things. One way to overcome these problems is to develop a hybrid map that includes objects and the spatial layout of a local space. The map developed in this research has a hybrid structure that combines a global topological map and a local hybrid map. The topological map represents the spatial relationships between local spaces. The local hybrid map combines the spatial layout of the local space with the objects found in that space. Based on the proposed map, we suggest a novel coarse-to-fine global localization method that uses object recognition, point cloud fitting and probabilistic scan matching. This approach can accurately estimate robot pose with respect to the correct local space.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. S. Thrun, “Robotic mapping: A survey,” Exploring Artificial Intelligence in the New Millenium, G. Lakemeyer and B. Nebel, editors, Morgan Kaufmann, 2002.

  2. A. Elfes, Occupancy Grids: A Probabilistic Frameork for Robot Perception and Navigation, Ph.D. Dissertation, Department of Electrical and Computer Engineering, Carnegie Mellon University, 1989.

  3. I. J. Cox and J. J. Leonard, “Modeling a dynamic environment using a bayesian multiple hypothesis approach,” Artificial Intelligence, vol. 66, pp. 311–344, 1994.

    Article  MATH  Google Scholar 

  4. F. Lu and E. Millos, “Robot pose estimation in unknown environments by matching 2D range scans,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 935–938, 1994.

  5. D. Kortenkamp and T. Weymonth, “Topological mapping for mobile robots using a combination of sonar and vision sensing,” Proc. of 12th National Conference on Artificial Intelligence, pp. 979–984, 1994.

  6. H. Choset and K. Nagatani, “Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization,” IEEE Trans. on Robotics and Automation, vol. 17, pp. 125–137, 2001.

    Article  Google Scholar 

  7. S. Thrun, S. Gutmann, D. Fox, W. Burgard, and B. Kuipers, “Integrating topological and metric maps for mobile robot navigation: a statistical approach,” Proc. of the 15th National Conference on Artificial Intelligence, pp. 989–995, 1998.

  8. S. Simhon and G. Dudek, “A global topological map formed by local metric map,” Proc. IEEE/RSJ Int. Conf. Intelligence Robots and Systems, pp. 1708–1714, 1998.

  9. P. Buschka and A. Saffiotti, “some notes on the use of hybrid maps for mobile robots,” Proc. Int. Conf. on Intelligent Autonomous Systems, pp. 547–556, 2004.

  10. R. Biswas, B. Limketkai, S. Sanner, and S. Thrun, “Towards object mapping in dynamic environments with mobile robots,” Proc. IEEE/RSJ Int. Conf. Intelligence Robots and Systems, pp. 1014–1019, 2002.

  11. D. F. Wolf and G. S. Sukhatme, “Towards mapping dynamic environments,” Proc. of the International Conference on Advanced Robotics, pp. 594–600, 2003.

  12. B.-D. Yim, Y.-J. Lee, J.-B. Song, and W. Chung, “Mobile robot localization using fusion of object recognition and range information,” Proc. IEEE Int. Conf. on Robotics and Automation, pp. 3533–3538, 2007.

  13. S. Ekvall, D. Kragic, and P. Jensfelt, “Object detection and mapping for service robot tasks,” Robotica, vol. 25, pp. 175–187, 2007.

    Article  Google Scholar 

  14. C. Galindo, A. Saffiotti, S. Coradeschi, P. Buschka, J. A. Fernández-Madrigal, and J. González, “Multihierarchical semantic maps for mobile robotics,” Proc. IEEE/RSJ Int. Conf. Intelligence Robots and Systems, pp. 3492–3497, 2005.

  15. H. Zender and G.-J. M. Kruijff, “Multi-layered conceptual spatial mapping for autonomous mobile robots,” Symposium on Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems, AAAI Spring Symposium Series, pp. 62–66, 2007.

  16. A. W. Siegel and S. H. White, “The development of spatial representations of large scale environments,” Advances in Child Development & Behavior by H. W. Reese, vol. 10, pp. 9–55, 1975.

    Google Scholar 

  17. P. Foo, A. Duchon, W. H. Warren Jr., and M. J. Tarr, “Human do not switch between path knowledge and landmarks when learning a new environment,” Psychological Research, vol. 71, pp. 240–251, 2007.

    Article  Google Scholar 

  18. W. K. Yeap and M. E. Jefferies, “On early cognitive mapping,” Spatial Cognition and Computation, vol. 2, no. 2, pp. 85–116, 2000.

    Article  Google Scholar 

  19. P. Hebert, S. Betge-Brezetz, and R. Chatila, “Decoupling odometry and exteroceptive perception in building a global world map of a mobile robot: the use of local maps,” Proc. IEEE Int. Conf. on Robotics and Automation, pp. 757–764, 1996.

  20. J. A. Castellanos, J. M. M. Montiel, J. Neira, and J. D. Tardos, “The SPmap: a probabilistic framework for simultaneous localization and map building,” IEEE Trans. on Robotics and Autonomous, vol. 15, pp. 948–952, 1999.

    Article  Google Scholar 

  21. M. Tomono and S. Yuta, “Mobile robot localization based on an inaccurate map,” Proc. IEEE/RSJ Int. Conf. Intelligence Robots and Systems, pp. 399–404, 2001.

  22. S. Vasudevan, S. Gächter, M. Berger, and R. Siegwart, “Cognitive maps for mobile robots-An object based approach,” Robotics and Autonomous Systems, vol. 55, pp. 359–371, 2007.

    Article  Google Scholar 

  23. R. F. Wang and E. S. Spelke, “Human spatial representation: insights from animals,” Trends in Cognitive Sciences, vol. 6, pp. 376–382, 2002.

    Article  Google Scholar 

  24. N. Burgess, “Spatial memory: how egocentric and allocentric combine,” Trends in Cognitive Sciences, vol. 10, pp. 551–557, 2006.

    Article  Google Scholar 

  25. B. Kuipers and Y.-T. Byun, “A robot exploration and mapping strategy based on semantic hierarchy of spatial representations,” Journal of Robotics and Autonomous Systems, vol. 8, pp. 47–63, 1991.

    Article  Google Scholar 

  26. Y. Ke and R. Sukthankar, “PCA-SIFT: a more distinctive representation for local image descriptors,” Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, pp. 506–513, 2004.

  27. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision, Prentice Hall, 1998.

  28. D. Lowe, “Distinctive image features from scale-invariant keypoints,” International Journal of Computer Vision, vol. 60, pp. 91–110, 2004.

    Article  Google Scholar 

  29. G. N. Desouza and A. C. Kak, “Vision for mobile robot navigation: a survey,” IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 237–267, 2002.

    Article  Google Scholar 

  30. P. Althaus and H. I. Christensen, “Automatic map acquisition for navigation in domestic environments,” Proc. IEEE Int. Conf. on Robotics and Automation, pp. 1551–1556, 2003.

  31. E. Horowitz, S. Sahni, and S. Rajasekaran, Computer Algorithm with C++, W. H. Freeman and Company, 1997.

  32. S.-K. Park, M. Kim, and C.-W. Lee, “Mobile robot navigation based on direct depth and color-based environment modeling,” Proc. IEEE Int. Conf. on Robotics and Automation, pp. 4253–4258, 2004.

  33. M. Leordeanu and M. Herbert, “A spectral technique for correspondence problems using pairwise constraints,” Proc. IEEE Int. Conf. on Computer Vision, pp. 1482–1489, 2005.

  34. J. J. Craig, Introduction to Robotics: Mechanics and Control, 3rd Edition, Prentice Hall, 2005.

  35. H. Zhuang and R. Sudhakar, “Simultaneous rotation and translation fitting of two 3-D point sets,” IEEE Trans. Syst., Man, and Cybernet.-Part B: Cybernet., vol. 27, pp. 127–131, 1997.

    Article  Google Scholar 

  36. C. Andrieu, N. De Freitas, A. Doucet, and M. I. Jordan, “An introduction to MCMC for machine learning,” Machine Learning, vol. 50, pp. 5–43, 2003.

    Article  MATH  Google Scholar 

  37. I. Isard and A. Blake, “Condensation — conditional density propagation for visual tracking,” International Journal of Computer Vision, vol. 29, pp. 5–28, 1998.

    Article  Google Scholar 

  38. http://www.sick.com/

  39. http://www.videredesign.com/

  40. Z. Zhang, “Iterative point matching for registration of freeform curves and surfaces,” International Journal of Computer Vision, vol. 13, no. 2, pp. 119–152, 1994.

    Article  Google Scholar 

  41. D. Fox, W. Burgard, F. Dellaert, and S. Thrun, “Monte Carlo localization: efficient position estimation for mobile robots,” Proc. Nat. Conf. Artif. Intell., pp. 896–901, 1999.

  42. Y.-J. Lee, T.-B. Kwon, and J.-B. Song, “SLAM of a mobile robot using thinning-based topological information,” International Journal of Control, Automation, and Systems, vol. 5, no. 5, pp. 577–583, 2007.

    Google Scholar 

  43. H. Cheong, S. Park, and S.-K. Park, “Topological map building and exploration based on concave nodes,” Proc. International Conference on Control, Automation and Systems, pp. 1115–1120, 2008.

Download references

Author information

Authors and Affiliations

  1. Center for Cognitive Robotics Research, Korea Institute of Science and Technology (KIST), 5 Wolsong-gil, Sungbuk-gu, Seoul, 136-791, Korea

    Soonyong Park & Sung-Kee Park

  2. Department of Electrical and Electronic Engineering, Yonsei University, 262 Seongsanno, Seodaemun-gu, Seoul, 120-749, Korea

    Mignon Park

Authors
  1. Soonyong Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mignon Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sung-Kee Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soonyong Park.

Additional information

Recommended by Editor Jae-Bok Song. This research was performed for the Intelligent Robotics Development Program, one of the 21st Century Frontier R&D Programs funded by the Ministry of Knowledge Economy of Korea.

Soonyong Park received the B.S. and M.S. degrees from the Department of Mechanical Engineering, Kyunghee University, Seoul, Korea, in 2001 and 2003, respectively. He is currently working toward the Ph.D. degree in the Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Korea. Since 2001, he has been a student researcher in the Center for Cognitive Robotics Research, Korea Institute of Science and Technology (KIST), Seoul, Korea. His research interests include mobile robot navigation and computer vision.

Mignon Park received the B.S. and M.S. degrees in Electronics from Yonsei University, Seoul, Korea, in 1973 and 1977, respectively. He received the Ph.D. degree in University of Tokyo, Japan, 1982. He was a researcher with the Institute of Biomedical Engineering, University of Tokyo, Japan, from 1972 to 1982, as well as at the Massachusetts Institute of Technology, Cambridge, and the University of California Berkeley, in 1982. He was a visiting researcher in Robotics Division, Mechanical Engineering Laboratory, Ministry of International Trade and Industry, Tsukuba, Japan, from 1986 to 1987. He has been a Professor in the Department of Electrical and Electronic Engineering in Yonsei University, since 1982. His research interests include fuzzy control and application, robotics, and fuzzy biomedical system.

Sung-Kee Park is a principal research scientist for Korea Institute of Science and Technology (KIST). He received the B.S. and M.S. degrees in Mechanical Design and Production Engineering from Seoul National University, Seoul, Korea, in 1987 and 1989, respectively. He received the Ph.D. degree (2000) from Korea Advanced Institue of Science and Technology (KAIST), Korea, in the area of computer vision. Since then, he has been working for the center for cognitive robotics research at KIST. During his period at KIST, he held a visiting position at the Robotics Institute of Carnegie Mellon University in 2005, where he did research on object recognition. His recent work has been on cognitive visual processing, object recognition, visual navigation, and human-robot interaction.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, S., Park, M. & Park, SK. Object-spatial layout-route based hybrid map and global localization for mobile robots. Int. J. Control Autom. Syst. 7, 598–614 (2009). https://doi.org/10.1007/s12555-009-0411-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12555-009-0411-5

Keywords

Search

Navigation