Towards Planning in Generalized Belief Space

Chapter
Part of the Springer Tracts in Advanced Robotics book series (STAR, volume 114)

Abstract

We investigate the problem of planning under uncertainty, which is of interest in several robotic applications, ranging from autonomous navigation to manipulation. Recent effort from the research community has been devoted to design planning approaches working in a continuous domain, relaxing the assumption that the controls belong to a finite set. In this case robot policy is computed from the current robot belief (planning in belief space), while the environment in which the robot moves is usually assumed to be known or partially known. We contribute to this branch of the literature by relaxing the assumption of known environment; for this purpose we introduce the concept of generalized belief space (GBS), in which the robot maintains a joint belief over its state and the state of the environment. We use GBS within a Model Predictive Control (MPC) scheme; our formulation is valid for general cost functions and incorporates a dual-layer optimization: the outer layer computes the best control action, while the inner layer computes the generalized belief given the action. The resulting approach does not require prior knowledge of the environment and does not assume maximum likelihood observations. We also present an application to a specific family of cost functions and we elucidate on the theoretical derivation with numerical examples.

References

  1. 1.
    Bai, H., David, H., Lee, W.S.: Integrated perception and planning in the continuous space: a POMDP approach. In: Robotics: Science and Systems (RSS) (2013)Google Scholar
  2. 2.
    Binney, J., Sukhatme, G.S.: Branch and bound for informative path planning. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2147–2154 (2012)Google Scholar
  3. 3.
    Blanco, J., Fernandez-Madrigal, J., Gonzalez, J.: A novel measure of uncertainty for mobile robot SLAM with rao-blackwellized particle filters. Int. J. Robot. Res. 27(1), 73–89 (2008)CrossRefGoogle Scholar
  4. 4.
    Bryson, M., Sukkarieh, S.: Observability analysis and active control for airborne SLAM. IEEE Trans. Aerosp. Electron. Syst. 44, 261–280 (2008)CrossRefGoogle Scholar
  5. 5.
    Carrillo, H., Reid, I., Castellanos, J.A.: On the comparison of uncertainty criteria for active SLAM. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2080–2087 (2012)Google Scholar
  6. 6.
    Du, J., Carlone, L., Kaouk Ng, M., Bona, B., Indri, M.: A comparative study on active SLAM and autonomous exploration with particle filters. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), pp. 916–923 (2011)Google Scholar
  7. 7.
    Hollinger, G., Sukhatme, G.: Stochastic motion planning for robotic information gathering. In: Robotics: Science and Systems (RSS) (2013)Google Scholar
  8. 8.
    Huang, S., Kwok, N., Dissanayake, G., Ha, Q., Fang, G.: Multi-step look-ahead trajectory planning in SLAM: possibility and necessity. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 1091–1096 (2005)Google Scholar
  9. 9.
    Kaelbling, L.P., Lozano-Pérez, T.: Pre-image backchaining in belief space for mobile manipulation. In: Proceedings of the International Symposium of Robotics Research (ISRR) (2011)Google Scholar
  10. 10.
    Kaelbling, L.P., Lozano-Pérez, T.: Unifying perception, estimation and action for mobile manipulation via belief space planning. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2952–2959 (2012)Google Scholar
  11. 11.
    Kaelbling, L.P., Lozano-Pérez, T.: Integrated task and motion planning in belief space. Int. J. Robot. Res. 32, 1194–1227 (2013)CrossRefGoogle Scholar
  12. 12.
    Kim, A., Eustice, R.M.: Perception-driven navigation: active visual SLAM for robotic area coverage. In: IEEE International Conference on Robotics and Automation (ICRA) (2012)Google Scholar
  13. 13.
    Kontitsis, M., Theodorou, E.A., Todorov, E.: Multi-robot active SLAM with relative entropy optimization. In: American Control Conference (2013)Google Scholar
  14. 14.
    Leung, C., Huang, S., Dissanayake, G.: Active SLAM using model predictive control and attractor based exploration. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 5026–5031 (2006)Google Scholar
  15. 15.
    Martinez-Cantin, R., De Freitas, N., Doucet, A., Castellanos, J.A.: Active policy learning for robot planning and exploration under uncertainty. In: Robotics: Science and Systems (RSS) (2007)Google Scholar
  16. 16.
    Martinez-Cantin, R., de Freitas, N., Brochu, E., Castellanos, J.A., Doucet, A.: A Bayesian exploration–exploitation approach for optimal online sensing and planning with a visually guided mobile robot. Auton. Robots 27(2), 93–103 (2009)CrossRefGoogle Scholar
  17. 17.
    Platt Jr, R., Tedrake, R., Kaelbling, L.P., Lozano-Pérez, T.: Belief space planning assuming maximum likelihood observations. In: Robotics: Science and Systems (RSS), pp. 587–593 (2010)Google Scholar
  18. 18.
    Potthast, C., Sukhatme, G.: Next best view estimation with eye in hand camera. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2011)Google Scholar
  19. 19.
    Sim, R., Roy, N.: Global a-optimal robot exploration in SLAM. pp. 661–666 (2005)Google Scholar
  20. 20.
    Singh, A., Krause, A., Guestrin, C., Kaiser, W.J.: Efficient informative sensing using multiple robots. J. Artif. Intell. Res. 34, 707–755 (2009)MathSciNetMATHGoogle Scholar
  21. 21.
    Stachniss, C., Haehnel, D., Burgard, W.: Exploration with active loop-closing for FastSLAM. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2004)Google Scholar
  22. 22.
    Stachniss, C., Grisetti, G., Burgard, W.: Information gain-based exploration using rao-blackwellized particle filters. In: Robotics: Science and Systems (RSS), pp. 65–72 (2005)Google Scholar
  23. 23.
    Valencia, R., Valls Miró, J., Dissanayake, G., Andrade-Cetto, J.: Active pose SLAM. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1885–1891 (2011)Google Scholar
  24. 24.
    Valencia, R., Morta, M., Andrade-Cetto, J., Porta, J.M.: Planning reliable paths with pose SLAM. IEEE Trans. Robot. 29, 1050–1059 (2013)CrossRefGoogle Scholar
  25. 25.
    Van Den Berg, J., Patil, S., Alterovitz, R.: Motion planning under uncertainty using iterative local optimization in belief space. Int. J. Robot. Res. 31(11), 1263–1278 (2012)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.College of ComputingGeorgia Institute of TechnologyAtlantaUSA

Personalised recommendations