Advertisement

Distributed Decision-Theoretic Active Perception for Multi-robot Active Information Gathering

  • Jennifer Renoux
  • Abdel-Illah Mouaddib
  • Simon LeGloannec
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8825)

Abstract

Multirobot systems have made tremendous progress in exploration and surveillance. In that kind of problem, agents are not required to perform a given task but should gather as much information as possible. However, information gathering tasks usually remain passive. In this paper, we present a multirobot model for active information gathering. In this model, robots explore, assess the relevance, update their beliefs and communicate the appropriate information to relevant robots. To do so, we propose a distributed decision process where a robot maintains a belief matrix representing its beliefs and beliefs about the beliefs of the other robots. This decision process uses entropy and Kullback-Leibler in a reward function to access the relevance of their beliefs and the divergence with each other. This model allows the derivation of a policy for gathering information to make the entropy low and a communication policy to reduce the divergence. An experimental scenario has been developed for an indoor information gathering mission.

Keywords

Multiagent System Markov Decision Process Information Gathering Belief State Reward Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Borlund, P.: The concept of relevance in IR. Journal of the American Society for information Science and Technology 54(10), 913–925 (2003)CrossRefGoogle Scholar
  2. 2.
    Baeza-Yates, R., Ribeiro-Neto, B., et al.: Modern information retrieval, p. 463. ACM Press, New York (1999)Google Scholar
  3. 3.
    Floridi, L.: Understanding epistemic relevance. Erkenntnis 69(1), 69–92 (2008)CrossRefzbMATHGoogle Scholar
  4. 4.
    Roussel, S., Cholvy, L.: Cooperative interpersonal communication and Relevant information. In: ESSLLI Workshop on Logical Methods for Social Concepts (2009)Google Scholar
  5. 5.
    Ponzoni Carvalho Chanel, C., Teichteil-Königsbuch, F., Lesire, C.: POMDP-based online target detection and recognition for autonomous UAVs. In: ECAI, pp. 955–960 (2012)Google Scholar
  6. 6.
    Araya, M., Buffet, O., Thomas, V., Charpillet, F.: A POMDP extension with belief-dependent rewards. In: Advances in Neural Information Processing System, pp. 64–72 (2010)Google Scholar
  7. 7.
    Seuken, S., Zilberstein, S.: Formal models and algorithms for decentralized decision making under uncertainty. Autonomous Agents and Multi-Agent Systems 17(2), 190–250 (2008)CrossRefGoogle Scholar
  8. 8.
    Bernstein, D., Givan, R., Immerman, N., Zilberstein, S.: The complexity of decentralized control of Markov decision processes. Mathematics of Operations Research 27(4), 819–840 (2002)MathSciNetCrossRefzbMATHGoogle Scholar
  9. 9.
    Roth, M., Simmons, R., Veloso, M.: Reasoning about joint beliefs for execution-time communication decisions. In: Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 786–793 (2005)Google Scholar
  10. 10.
    Cassandra, A., Kaelbling, L., Littman, M.: Acting optimally in partially observable stochastic domains. In: AAAI 1994, pp. 1023–1028 (1994)Google Scholar
  11. 11.
    Hansen, E., Feng, Z.: Dynamic Programming for POMDPs Using a Factored State Representation (2000)Google Scholar
  12. 12.
    Porta, J., Vlassis, N., Spaan, M., Poupart, P.: Point-based value iteration for continuous POMDPs. The Journal of Machine Learning Research 7, 2329–2367 (2006)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Hoey, J., Poupart, P.: Solving POMDPs with continuous or large discrete observation spaces. In: International Joint Conference on Artificial Intelligence, vol. 19, p. 1332 (2005)Google Scholar
  14. 14.
    Seuken, S., Zilberstein, S.: Memory-Bounded Dynamic Programming for DEC-POMDPs. In: IJCAI, pp. 2009–2015 (2007)Google Scholar
  15. 15.
    Spaan, M., Veiga, T., Lima, P.: Active cooperative perception in network robot systems using POMDPs. In: International Conference on Intelligent Robots and Systems, pp. 4800–4805 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Jennifer Renoux
    • 1
  • Abdel-Illah Mouaddib
    • 1
  • Simon LeGloannec
    • 2
  1. 1.University of CaenFrance
  2. 2.Airbus Defence and SpaceVal de ReuilFrance

Personalised recommendations