Skip to main content
SpringerLink
Log in

Towards Planning in Generalized Belief Space

  • Chapter
  • First Online:
Robotics Research

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 114))

Abstract

We investigate the problem of planning under uncertainty, which is of interest in several robotic applications, ranging from autonomous navigation to manipulation. Recent effort from the research community has been devoted to design planning approaches working in a continuous domain, relaxing the assumption that the controls belong to a finite set. In this case robot policy is computed from the current robot belief (planning in belief space), while the environment in which the robot moves is usually assumed to be known or partially known. We contribute to this branch of the literature by relaxing the assumption of known environment; for this purpose we introduce the concept of generalized belief space (GBS), in which the robot maintains a joint belief over its state and the state of the environment. We use GBS within a Model Predictive Control (MPC) scheme; our formulation is valid for general cost functions and incorporates a dual-layer optimization: the outer layer computes the best control action, while the inner layer computes the generalized belief given the action. The resulting approach does not require prior knowledge of the environment and does not assume maximum likelihood observations. We also present an application to a specific family of cost functions and we elucidate on the theoretical derivation with numerical examples.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In principle, for planning it is only necessary to maintain a distribution over the states \(X_{k+l}^{c}\) while marginalizing out the remaining states. This would avoid performing computation over a large state space, hence resulting in a computational advantage. We leave the investigation of this aspect as an avenue for future research.

  2. 2.

    The robot considers a goal as achieved when its estimated position coincides with the goal; therefore, the miss distance is defined as the mismatch between the goal and the actual position at that time.

References

  1. Bai, H., David, H., Lee, W.S.: Integrated perception and planning in the continuous space: a POMDP approach. In: Robotics: Science and Systems (RSS) (2013)

    Google Scholar 

  2. Binney, J., Sukhatme, G.S.: Branch and bound for informative path planning. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2147–2154 (2012)

    Google Scholar 

  3. Blanco, J., Fernandez-Madrigal, J., Gonzalez, J.: A novel measure of uncertainty for mobile robot SLAM with rao-blackwellized particle filters. Int. J. Robot. Res. 27(1), 73–89 (2008)

    Article  Google Scholar 

  4. Bryson, M., Sukkarieh, S.: Observability analysis and active control for airborne SLAM. IEEE Trans. Aerosp. Electron. Syst. 44, 261–280 (2008)

    Article  Google Scholar 

  5. Carrillo, H., Reid, I., Castellanos, J.A.: On the comparison of uncertainty criteria for active SLAM. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2080–2087 (2012)

    Google Scholar 

  6. Du, J., Carlone, L., Kaouk Ng, M., Bona, B., Indri, M.: A comparative study on active SLAM and autonomous exploration with particle filters. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 916–923 (2011)

    Google Scholar 

  7. Hollinger, G., Sukhatme, G.: Stochastic motion planning for robotic information gathering. In: Robotics: Science and Systems (RSS) (2013)

    Google Scholar 

  8. Huang, S., Kwok, N., Dissanayake, G., Ha, Q., Fang, G.: Multi-step look-ahead trajectory planning in SLAM: possibility and necessity. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1091–1096 (2005)

    Google Scholar 

  9. Kaelbling, L.P., Lozano-Pérez, T.: Pre-image backchaining in belief space for mobile manipulation. In: Proceedings of the International Symposium of Robotics Research (ISRR) (2011)

    Google Scholar 

  10. Kaelbling, L.P., Lozano-Pérez, T.: Unifying perception, estimation and action for mobile manipulation via belief space planning. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2952–2959 (2012)

    Google Scholar 

  11. Kaelbling, L.P., Lozano-Pérez, T.: Integrated task and motion planning in belief space. Int. J. Robot. Res. 32, 1194–1227 (2013)

    Article  Google Scholar 

  12. Kim, A., Eustice, R.M.: Perception-driven navigation: active visual SLAM for robotic area coverage. In: IEEE International Conference on Robotics and Automation (ICRA) (2012)

    Google Scholar 

  13. Kontitsis, M., Theodorou, E.A., Todorov, E.: Multi-robot active SLAM with relative entropy optimization. In: American Control Conference (2013)

    Google Scholar 

  14. Leung, C., Huang, S., Dissanayake, G.: Active SLAM using model predictive control and attractor based exploration. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 5026–5031 (2006)

    Google Scholar 

  15. Martinez-Cantin, R., De Freitas, N., Doucet, A., Castellanos, J.A.: Active policy learning for robot planning and exploration under uncertainty. In: Robotics: Science and Systems (RSS) (2007)

    Google Scholar 

  16. Martinez-Cantin, R., de Freitas, N., Brochu, E., Castellanos, J.A., Doucet, A.: A Bayesian exploration–exploitation approach for optimal online sensing and planning with a visually guided mobile robot. Auton. Robots 27(2), 93–103 (2009)

    Article  Google Scholar 

  17. Platt Jr, R., Tedrake, R., Kaelbling, L.P., Lozano-Pérez, T.: Belief space planning assuming maximum likelihood observations. In: Robotics: Science and Systems (RSS), pp. 587–593 (2010)

    Google Scholar 

  18. Potthast, C., Sukhatme, G.: Next best view estimation with eye in hand camera. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2011)

    Google Scholar 

  19. Sim, R., Roy, N.: Global a-optimal robot exploration in SLAM. pp. 661–666 (2005)

    Google Scholar 

  20. Singh, A., Krause, A., Guestrin, C., Kaiser, W.J.: Efficient informative sensing using multiple robots. J. Artif. Intell. Res. 34, 707–755 (2009)

    MathSciNet  MATH  Google Scholar 

  21. Stachniss, C., Haehnel, D., Burgard, W.: Exploration with active loop-closing for FastSLAM. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2004)

    Google Scholar 

  22. Stachniss, C., Grisetti, G., Burgard, W.: Information gain-based exploration using rao-blackwellized particle filters. In: Robotics: Science and Systems (RSS), pp. 65–72 (2005)

    Google Scholar 

  23. Valencia, R., Valls Miró, J., Dissanayake, G., Andrade-Cetto, J.: Active pose SLAM. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1885–1891 (2011)

    Google Scholar 

  24. Valencia, R., Morta, M., Andrade-Cetto, J., Porta, J.M.: Planning reliable paths with pose SLAM. IEEE Trans. Robot. 29, 1050–1059 (2013)

    Article  Google Scholar 

  25. Van Den Berg, J., Patil, S., Alterovitz, R.: Motion planning under uncertainty using iterative local optimization in belief space. Int. J. Robot. Res. 31(11), 1263–1278 (2012)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computing, Georgia Institute of Technology, Atlanta, GA, 30332, USA

    Vadim Indelman, Luca Carlone & Frank Dellaert

Authors
  1. Vadim Indelman
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Luca Carlone
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Frank Dellaert
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vadim Indelman .

Editor information

Editors and Affiliations

  1. Creative Informatics, The University of Tokyo, Tokyo, Japan

    Masayuki Inaba

  2. School of Electrical Engineering and Com, Queensland Univ of Technology, Brisbane, Queensland, Australia

    Peter Corke

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Indelman, V., Carlone, L., Dellaert, F. (2016). Towards Planning in Generalized Belief Space. In: Inaba, M., Corke, P. (eds) Robotics Research. Springer Tracts in Advanced Robotics, vol 114. Springer, Cham. https://doi.org/10.1007/978-3-319-28872-7_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28872-7_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28870-3

  • Online ISBN: 978-3-319-28872-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation