Abstract
Robots have a powerful means to drastically cut down the exploration space with imitation. However, as existing imitation approaches usually require repetitive demonstrations of the skill to learn in order to be useful, those are typically not applicable in groups of robots. In these settings usually each robot has its own task to accomplish and should not be disturbed by teaching others. As a result an imitating robot most of the time has only one observation of a specific skill from which it can learn.
We present an approach that allows an individually learning robot to make use of such cases of sporadic imitation which is the normal case in groups of robots. Thereby, a robot can use imitation in order to guide its exploration efforts towards more rewarding areas in the exploration space. This is inspired by imitation often found in nature where animals or humans try to map observations into their own capability space. We show the feasibility by realistic simulation of Pioneer robots.
Chapter PDF
References
E. Alpaydin. Introduction To Machine Learning. MIT Press, 2004.
R. Bellman. Dynamic Programming. Courier Dover Publications, 2003.
Y. Bengio. Markovian models for sequential data. Neural Computing Surveys, 2:129-162, 1999.
A. Billard, Y. Epars, S. Calinon, G. Cheng, and S. Schaal. Discovering optimal imitation strategies. Robotics and Autonomous Systems, 47(2-3):69-77, 2004.
Billard, A. Learning motor skills by imitation: a biologically inspired robotic model, 2000.
Borenstein, E. and Ruppin, E. Enhancing autonomous agents evolution with learning by imitation. In Second International Symposium on Imitation in Animals and Artifacts, 2003.
T. M. Cover and P. E. Hart. Nearest neighbor pattern classification. IEEE Transactions on Information Theory, 13:21-27, 1967.
Demiris, J. and Hayes, G. Imitation as a dual-route process featuring predictive and learning components: a biologically-plausible computational model. In K. Dautenhahn and C. Nehaniv, editors, Imitation in animals and artifacts, pages 327-361, Cambridge, MA, USA, 2002. MIT Press.
Y. Gatsoulis, G. Maistros, Y. Marom, and G. Hayes. Learning to forage through imitation. In Proceedings of the Second IASTED International Conference on Artificial Intelligence and Applications (AIA2002), pages 485-491, Sept. 2002.
A. Ijspeert, J. Nakanishi, and S. Schaal. Movement imitation with nonlinear dynamical systems in humanoid robots. In International Conference on Robotics and Automation (ICRA2002), 2002.
T. Inamura, Y. Nakamura, H. Ezaki, and I. Toshima. Imitation and primitive symbol acquisition of humanoids by the integrated mimesis loop. Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, 4, 2001.
T. Inamura, I. Toshima, Y. Nakamura, and J. Saitama. Acquiring Motion Elements for Bidi-rectional Computation of Motion Recognition and Generation. Experimental Robotics VIII, 2003.
M. J. Kochenderfer. Adaptive Modelling and Planning for Learning Intelligent Behaviour. PhD thesis, School of Informatics, University of Edinburgh, 2006.
W. Richert, O. L üke, B. Nordmeyer, and B. Kleinjohann. Increasing the autonomy of mobile robots by on-line learning simultaneously at different levels of abstraction. In IEEE International Conference on Autonomic and Autonomous Systems (ICAS’08), March 2008.
R. S. Sutton and A. G. Barto. Reinforcement Learning: An Introduction. MIT Press, Cambridge, 1998.
A. Viterbi. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. Information Theory, IEEE Transactions on, 13(2):260-269, 1967.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 International Federation for Information Processing
About this paper
Cite this paper
Richert, W., Niehörster, O., Klompmaker, F. (2008). Guiding Exploration by Combining Individual Learning and Imitation in Societies of Autonomous Robots. In: Hinchey, M., Pagnoni, A., Rammig, F.J., Schmeck, H. (eds) Biologically-Inspired Collaborative Computing. BICC 2008. IFIP – The International Federation for Information Processing, vol 268. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09655-1_21
Download citation
DOI: https://doi.org/10.1007/978-0-387-09655-1_21
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09654-4
Online ISBN: 978-0-387-09655-1
eBook Packages: Computer ScienceComputer Science (R0)