Tacit Learning for Emergence of Task-Related Behaviour through Signal Accumulation
Control of robotic joints movements requires the generation of appropriate torque and force patterns, coordinating the kinematically and dynamically complex multijoints systems. Control theory coupled with inverse and forward internal models are commonly used to map a desired endpoint trajectory into suitable force patterns. In this paper, we propose the use of tacit learning to successfully achieve similar tasks without using any kinematic model of the robotic system to be controlled. Our objective is to design a new control strategy that can achieve levels of adaptability similar to those observed in living organisms and be plausible from a neural control viewpoint. If the neural mechanisms used for mapping goals expressed in the task-space into control-space related command without using internal models remain largely unknown, many neural systems rely on data accumulation. The presented controller does not use any internal model and incorporates knowledge expressed in the task space using only the accumulation of data. Tested on a simulated two-link robot system, the controller showed flexibility by developing and updating its parameters through learning. This controller reduces the gap between reflexive motion based on simple accumulation of data and execution of voluntarily planned actions in a simple manner that does not require complex analysis of the dynamics of the system.
Unable to display preview. Download preview PDF.
- 1.Minsky, M.L., Papert, S.A.: Perceptron. MIT Press, Cambridge (1969)Google Scholar
- 6.Tedrake, R., Zhang, T.W., Seung, H.S.: Stochastic policy gradient reinforcement learning on a simple 3D biped. In: Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., pp. 2849–2854 (2004)Google Scholar
- 7.Astrom, K.J., Wittenmark, B.: Adaptive Control. Addison-Wesley, Reading (1989)Google Scholar
- 8.Slotin, J.E., Li, W.: Applied Nonlinear Control. Prentice-Hall, Englewood Cliffs (1991)Google Scholar
- 13.Hayashibe, M., Shimoda, S.: Emergence of Motor Synergy in Vertical Reaching Task via Tacit Learning. In: International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4985–4988 (2013)Google Scholar
- 16.Ozawa, R., Oobayashi, Y.: Adaptive task space PD control via implicit use of visual information. In: Int. Sym. Robot Control, pp. 209–214 (2009)Google Scholar
- 17.Smith, R.: Open Dynamics Engine, http://www.ode.org/
- 18.Shimoda, S., Yoshihara, Y., Fujimoto, K., Yamamoto, T., Maeda, I., Kimura, H.: Stability analysis of tacit learning based on environmental signal accumulation. In: 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 7-12 (2012)Google Scholar