Abstract
In this paper we demonstrate the coupling of an autonomous planning and control framework for whole-body humanoid motion, with a brain-computer interface (BCI) system in order to achieve online real-time biasing and correction of the offline planned motion. Using the contact-before-motion planning paradigm, the humanoid autonomously plans, in a first stage, its motion to reach a desired goal configuration or contact location. In the second stage of the approach, the humanoid executes the planned motion and the user can exert online some control on the motion being executed through an EEG decoding interface. The method is applied and demonstrated in a dynamics simulator with full collision-detection on a model of the humanoid robot HRP2.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bell, C.J., Shenoy, P., Chalodhorn, R., Rao, R.P.N.: Control of a humanoid robot by a noninvasive brain-computer interface in humans. Journal of Neural Engineering 5, 214–220 (2008)
Gergondet, P., Druon, S., Kheddar, A., Hintermuller, C., Guger, C., Slater, M.: Using Brain-Computer Interface to Steer a Humanoid Robot. In: IEEE International Conference on Robotics and Biomimetics, Phuket, Thailand, pp. 192–197 (2011)
Chung, M., Cheung, W., Scherer, R., Rao, R.P.N.: A Hierarchical Architecture for Adaptive Brain-Computer Interfacing. In: Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, vol. 2, pp. 1647–1652 (2011)
Bryan, M., Green, J., Chung, M., Chang, L., Scherery, R., Smith, J., Rao, R.P.N.: An Adaptive Brain-Computer Interface for Humanoid Robot Control. In: 11th IEEE-RAS International Conference on Humanoid Robots, Bled, Slovenia, pp. 199–204 (2011)
Bouyarmane, K., Kheddar, A.: Humanoid robot locomotion and manipulation step planning. Advanced Robotics 26(10), 1099–1126 (2012)
Noda, T., Sugimoto, N., Furukawa, J., Sato, M., Hyon, S., Morimoto, J.: Brain-controlled exoskeleton robot for bmi rehabilitation. In: 12th IEEE-RAS International Conference on Humanoid Robots, Osaka, Japan, pp. 21–27 (2012)
Wolpaw, J.R., McFarland, D.J.: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proceedings of the National Academy of Sciences 101(51), 17849–17854 (2004)
Miller, K.J., Schalk, G., Fetza, E.E., den Nijs, M., Ojemanne, J.G., Rao, R.P.N.: Cortical activity during motor execution, motor imagery, and imagery-based online feedback. Proceedings of the National Academy of Sciences (2010)
Kuffner, J.J., Nishiwaki, K., Kagami, S., Inaba, M., Inoue, H.: Footstep Planning Among Obstacles for Biped Robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Maui, HI, vol. 1, pp. 500–505 (2001)
Chestnutt, J., Kuffner, J., Nishiwaki, K., Kagami, S.: Planning Biped Navigation Strategies in Complex Environments. In: IEEE-RAS International Conference on Humanoid Robots, Munich, Germany (2003)
Chestnutt, J., Lau, M., Kuffner, J.J., Cheung, G., Hodgins, J., Kanade, T.: Footstep Planning for the ASIMO Humanoid Robot. In: IEEE International Conference on Robotics and Automation, Barcelona, Spain, pp. 629–634 (2005)
Kuffner, J.J., Kagami, S., Nishiwaki, K., Inaba, M., Inoue, H.: Dynamically-Stable Motion Planning for Humanoid Robots. Autonomous Robots 12, 105–118 (2002)
Yamane, K., Kuffner, J., Hodgins, J.K.: Synthesizing Animations of Human Manipulation Tasks. ACM Transactions on Graphics (Proc. SIGGRAPH 2004) 23(3) (August 2004)
Yoshida, E., Kanoun, O., Esteves, C., Laumond, J.P.: Task-driven Support Polygon Reshaping for Humanoids. In: 6th IEEE-RAS International Conference on Humanoid Robots, Genova, Italy, pp. 208–213 (2006)
Yoshida, E., Laumond, J.-P., Esteves, C., Kanoun, O., Sakaguchi, T., Yokoi, K.: Whole-body locomotion, manipulation and reaching for humanoids. In: Egges, A., Kamphuis, A., Overmars, M. (eds.) MIG 2008. LNCS, vol. 5277, pp. 210–221. Springer, Heidelberg (2008)
Hauser, K., Bretl, T., Latombe, J.-C., Harada, K., Wilcox, B.: Motion Planning for legged Robots on Varied Terrain. International Journal of Robotics Research 27(11-12), 1325–1349 (2008)
Bouyarmane, K., Kheddar, A.: Static multi-contact inverse problem for multiple humanoid robots and manipulated objects. In: 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN, pp. 8–13 (2010)
Bouyarmane, K., Kheddar, A.: Multi-contact stances planning for multiple agents. In: IEEE International Conference on Robotics and Automation, Shanghai, China, pp. 5546–5353 (2011)
Bouyarmane, K., Kheddar, A.: Using a multi-objective controller to synthesize simulated humanoid robot motion with changing contact configurations. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Fransisco, pp. 4414–4419 (2011)
Tomioka, R., Aihara, K.: Classifying matrices with a spectral regularization. In: 24th International Conference on Machine Learning, New York, pp. 895–902 (2007)
Tomioka, R., Muller, K.R.: A regularized discriminative framework for EEG analysis with application to brain-computer interface. NeuroImage 49, 415–432 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bouyarmane, K., Vaillant, J., Sugimoto, N., Keith, F., Furukawa, Ji., Morimoto, J. (2013). BCI Control of Whole-Body Simulated Humanoid by Combining Motor Imagery Detection and Autonomous Motion Planning. In: Lee, M., Hirose, A., Hou, ZG., Kil, R.M. (eds) Neural Information Processing. ICONIP 2013. Lecture Notes in Computer Science, vol 8226. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-42054-2_39
Download citation
DOI: https://doi.org/10.1007/978-3-642-42054-2_39
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-42053-5
Online ISBN: 978-3-642-42054-2
eBook Packages: Computer ScienceComputer Science (R0)