Skip to main content

Mimic Recognition and Reproduction in Bilateral Human-Robot Speech Communication

  • Conference paper
  • First Online:
Interactive Collaborative Robotics (ICR 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9812))

Included in the following conference series:

Abstract

This paper describes the principles of mimic recognition and reproduction for robots with ability to simulate facial emotional states of a human face. A new method of describing and managing the emotional state from basic emotional states is proposed. The method introduces a more natural way to control facial states and can be combined with a proposed natural speech interface model. The research results were tested in real conditions on several events using robots with silicone human-like faces.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mazzei, D., Lazzeri, N., Hanson, D., De Rossi, D.: HEFES: a hybrid engine for facial expressions synthesis to like androids and avatars. In: 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 195–200 (2012)

    Google Scholar 

  2. Breazeal, C., Brooks, R.: Robot emotions: a functional perspective. In: Who Needs Emotions, 271–310 (2005)

    Google Scholar 

  3. Fominykh, I.: Techniques of solving creativity problems. In: Proceedings of 8th Artificial Intelligence National Conference “KII-2002” (2002)

    Google Scholar 

  4. Fominykh, I.: About an approach of emotion formalization. In: Proceedings of II International Scientifical and Practical Seminar “Integrated Models and Soft Calculations in Artificial Intelligence” (2003)

    Google Scholar 

  5. Sholtz, J.: Theory and evaluation of human robot interactions. In: Proceedings of 36th Hawaii International Conference on System Sciences (HICSS'03) (2003)

    Google Scholar 

  6. MacDorman, K.F., Ishiguro, H.: The uncanny advantage of using androids in cognitive and social science research. Interact. Stud. 7(3), 297–337 (2006)

    Article  Google Scholar 

  7. Ishiguro, H.: Design of Humanlikeness in HRI: from uncanny valley to minimal design. In: 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 433–434. IEEE (2013)

    Google Scholar 

  8. Ekman, P.: Facial expression and emotion. Am. Psychol. 48(4), 384 (1993)

    Article  Google Scholar 

  9. Ekman, P., Friesen, W.: Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press (2002)

    Google Scholar 

  10. Miura, J., Iwase, K., Shirai, Y.: Interactive teaching of a mobile robot. In: Proceedings of 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain, pp. 3389–3393 (2005)

    Google Scholar 

  11. Rogalla, O., Ehrenmann, M., Zöllner, R., Becher, R., Dillmann, R.: Using gesture and speech control for commanding a robot assistant. In: Proceedings of the 11th IEEE International Workshop on Robot and Human Interactive Communication (ROMAN), Berlin, pp. 454–459 (2002)

    Google Scholar 

  12. Kristensen, S., Horstmann, S., Klandt, J., Lohnert, F., Stopp, A.: Human-friendly interaction for learning and cooperation. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, Seoul, Korea, pp. 2590–2595 (2001)

    Google Scholar 

  13. Zhonin, A.A.: An algorithm of learning of dialogue manager for a dialogue speech control system of robot. In: Proceedings of International Conference Integrated Models and Soft Computing in Artificial Intelligence, pp. 395–406 (2011)

    Google Scholar 

  14. Konyshev, D., Vorotnokov, S., Vybornov, N.: Control of mimic apparatus of service robots for emotion synthesis. Caspian J.: Manag. High Technol. 3(27), 216–229 (2014)

    Google Scholar 

  15. Vorotnikov, S.A., Gorin, A.V., Konyshev, D.V.: Audio-visual sensor system for service robots. In: Proceeding of International Conference Extreme Robotics, pp. 246–252 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Dmitry Konyshev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Yuschenko, A., Vorotnikov, S., Konyshev, D., Zhonin, A. (2016). Mimic Recognition and Reproduction in Bilateral Human-Robot Speech Communication. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds) Interactive Collaborative Robotics. ICR 2016. Lecture Notes in Computer Science(), vol 9812. Springer, Cham. https://doi.org/10.1007/978-3-319-43955-6_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43955-6_17

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43954-9

  • Online ISBN: 978-3-319-43955-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics