Use of See-Through Wearable Display as an Interface for a Humanoid Robot

  • Shu MatsuuraEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9738)


This paper describes the development of a monitoring system for the NAO humanoid robot for speaking presentations. The dialog between the human and the robot is based on both a dialog list stored by the robot and its dynamic retrieval of information from an external topic map server. The stereoscopic 3D capability of a see-through wearable binocular-type display, i.e., the EPSON MOVERIO BT-200, is used to allow simultaneous observation of the robot and the retrieved information, and the distance between the side-by-side images is controlled to create a converged image overlaid on the robot’s body. This image shift method is examined using simple line images with the see-through display, and the effect of pictorial cues of a real object on the generated images is discussed.


See-through wearable display Humanoid robot Stereoscopic 3D 



This study was funded in part by a Grant-in-Aid for Scientific Research (C) 15K00912 from the Ministry of Education, Culture, Sports, Science and Technology, Japan.


  1. 1.
    Vernon, D., von Hofsten, C., Fadiga, L.: A Roadmap for Cognitive Development in Humanoid Robots, Cognitive Systems Monographs, vol. 11. Springer-Verlag, Berlin Heidelberg (2010)Google Scholar
  2. 2.
    Chin, K-Y., Wu, C-H., Hong, Z-W.: A Humanoid Robot as a Teaching assistant for primary education. In: Fifth International Conference on Genetic and Evolutionary Computing, pp. 21–24 (2011)Google Scholar
  3. 3.
    Brown, L-V., Howard, A.M.: Engaging children in math education using a socially interactive humanoid robot. In: 13th IEEE-RAS International Conference on Humanoid Robots, pp. 183–188 (2013)Google Scholar
  4. 4.
    Yorita, A., Botzheim, J., Kubota, N.: Self-efficacy using fuzzy control for long-term communication in robot-assisted language learning. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5708–5715 (2013)Google Scholar
  5. 5.
    Chin, K.-Y., Hong, Z.-W., Chen, Y.-L.: Impact of using an educational robot-based learning system on students’ motivation in elementary education. IEEE Trans. Learn. Tech. 7(4), 333–345 (2014)CrossRefGoogle Scholar
  6. 6.
    Jo, D., Lee, J.-g., Lee, K.C.: Empirical analysis of changes in human creativity in people who work with humanoid robots and their avatars. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2014, Part I. LNCS, vol. 8523, pp. 273–281. Springer, Heidelberg (2014)Google Scholar
  7. 7.
    Miskam, M.A., Shamsuddin, S., Yussof, H., Omar, A.R., Muda, M.Z.: Programming platform for NAO robot in cognitive interaction applications. In: IEEE International Symposium on Robotics and Manufacturing Automation, pp. 141–146 (2014)Google Scholar
  8. 8.
    Diaz, M., Nuno, N., Saez-Pons, J., Pardo, D.E., Angulo, C.: Building up child-robot relationship for therapeutic purposes. In: From Initial Attraction Towards Long-term Social Engagement, pp. 927–932 (2011)Google Scholar
  9. 9.
    Miskam, M.A., Shamsuddin, S., Abdul Samat, M.R, Yussof, H., Ainudin, H.A., Omar, A.R.: Humanoid robot NAO as a teaching tool of emotion recognition for children with autism using the android app. In: International Symposium on Micro-Nano Mechatronics and Human Science, pp. 1–5 (2014)Google Scholar
  10. 10.
    Bingbing, L.L., Chen, I-M., Goh, T.J., Sung, M.: Interactive robots as social partner for communication care. In: IEEE International Conference on Robotics and Automation, pp. 2231–2236 (2014)Google Scholar
  11. 11.
    Addo, I.D., Ahamed, S.I.: Applying affective feedback to reinforcement learning in ZOEI, a comic humanoid robot. In: IEEE International Symposium on Robot and Human Interactive Communication, pp. 423–428 (2014)Google Scholar
  12. 12.
    Nijholt, A.: Humor techniques: from real world and game environments to smart environments. In: Streitz, N., Markopoulos, P. (eds.) DAPI 2015. LNCS, vol. 9189, pp. 659–670. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  13. 13.
    Hayashi, K., Kanda, T., Miyashita, T., Ishiguro, H., Hagita, N.: Robot Manzai–Robots’ conversation as a passive social medium. In: IEEE-RAS International Conference on Humanoid Robots, pp. 456–462 (2005)Google Scholar
  14. 14.
    Tsuchida, S., Yumoto, N., Matsuura, S.: Development of augmented reality teaching materials with projection mapping on real experimental settings. In: Stephanidis, C. (ed.) HCI 2014, Part II. CCIS, vol. 435, pp. 177–182. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  15. 15.
    ISO/IEC 13250:2002Google Scholar
  16. 16.
  17. 17.
    “Everyday Physics on Web”.
  18. 18.
    Matsuura, S., Naito, M.: Subject-centric Computing Fourth International Conference on Topic Maps Research and Applications, TMRA 2008, Leipziger Beiträge zur Informatik:Band XII pp. 247–260 (2008)Google Scholar
  19. 19.
  20. 20.
  21. 21.
    Yonemura, T.: A personal correspondence (2016)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.Faculty of EducationTokyo Gakugei UniversityKoganeiJapan

Personalised recommendations