Skip to main content
SpringerLink
Log in

Developing an Empirical Robotic Framework to Establish Bidirectional Eye Contact

  • Conference paper
  • First Online:
Intelligent Computing and Optimization (ICO 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1072))

Included in the following conference series:

  • 1118 Accesses

Abstract

Making eye contact is one of the most essential requirements to begin any interaction and to continue flow of a communication in human-robot and human-human communication. Simply face-to-face or eye-to-eye orientation (i.e., gaze crossing) seems enough to set up eye contact sometimes but displaying gaze awareness also a vital function to make an effective eye contact episode. This paper presents a robotic framework for bidirectional eye contact mechanism by considering two cases: human initiative and robot initiative. In order to verify the usefulness of the propose model, a robotic framework is developed which consists of four major modules: robot control, face detection, gaze awareness and gaze tracking respectively. The robot nods it’s head to show gaze awareness to the human which helps her/him to feel that s/he made eye contact. We present three methods to show the efficacy of the proposed framework. Experimental evaluation with 24 participants shows that the proposed framework is successful in establishing eye contact with 100% accuracy for human initiative case and 87.5% accuracy for robot initiative case respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Argyle, M.: Bodily Communication. Routledge, London (1988)

    Google Scholar 

  2. Farroni, T., Mansfield, E.M., Lai, C., Johnson, M.H.: Infants perceiving and acting on the eyes: tests of an evolutionary hypothesis. J. Exp. Child Psychol. 85(3), 199–212 (2003)

    Article  Google Scholar 

  3. Trevarthen, C., Aitken, K.J.: Infant intersubjectivity: research, theory, and clinical applications. J. Child Psychol. Psychiatry Allied Disciplines 42(1), 3–48 (2001)

    Article  Google Scholar 

  4. Fullwood, C., Doherty-Sneddon, G.: Effect of gazing at the camera during a video link on recall. Appl. Ergonomics 37(2), 167–175 (2006)

    Article  Google Scholar 

  5. Goffman, E.: Behaviour in Public Places: Notes on the Social Organization of Gatherings. The Free Press, New York (1963)

    Google Scholar 

  6. Hoque, M.M., Onuki, T., Das, D., Kobayashi, Y., Kuno, Y.: Attracting and controlling human attention through robot’s behaviors suited to the situation. In: International Conference on Human-Robot Interaction (HRI), pp. 149–150. ACM, Boston (2012)

    Google Scholar 

  7. Sharmin, S., Hoque, M.M.: Developing a bidirectional mutual gaze mechanism for human robot interaction. In: 2019 International Conference on Electrical, Computer and Communication Engineering (ECCE), pp. 1–6. IEEE, Cox’sBazar (2019)

    Google Scholar 

  8. Hoque, M.M., Onuki, T., Kobayashi, Y., Kuno, Y.: Controlling human attention through robot’s gaze behaviors. In: 4th International Conference on Human System Interactions, HSI, Yokohama, pp. 195–202 (2011)

    Google Scholar 

  9. Matsusaka, M., Tojo, T., Kubota, S., Multiperson conversation via multimodal interface—a robot who communicate with multiuser. In: Proceedings of the European Conference on Speech Communication and Technology, pp. 1723–1726 (2012)

    Google Scholar 

  10. Mutlu, B., Kanda, T., Forlizzi, J., Hodgins, J., Ishiguro, H.: Conversational gaze mechanisms for humanlike robots. ACM Trans. Int. Int. Sys. 1(2) (2012). Article 12

    Article  Google Scholar 

  11. Yonezawa, T., Yamazoe, H., Utsumi, A., Abe, S.: Gaze-communicative behavior of stuffed-toy robot with joint attention and eye contact based on ambient gaze-tracking. In: Proceedings of the 9th International Conference on Multimodal Interfaces, pp. 140–145) ACM (2007)

    Google Scholar 

  12. Das, D., Kobayashi, Y., Kuno, Y.: Attracting attention and establishing a communication channel based on the level of visual focus of attention. In: 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2194–2201. IEEE (2013)

    Google Scholar 

  13. Miyauchi, D., Nakamura, A., Yoshinori, K.: Bidirectional eye contact for human robot communication. IEICE Trans. Inf. Syst. 88(11), 2509–2516 (2005)

    Article  Google Scholar 

  14. Maurer, D.: Infant’s Perception of Facedness. Ablex, Norwood (1985)

    Google Scholar 

  15. Huang, C.M., Thomaz, A.L.: Effects of responding to, initiating and ensuring join attention in human-robot interaction. In: Proceedings of IEEE International Symposium on Roman, Allanta, GA, USA, pp. 65–71 (2011)

    Google Scholar 

  16. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition (2001)

    Google Scholar 

  17. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)

    Article  Google Scholar 

  18. Yuen, H.K., Princen, J., Illingworth, J., Kittler, J.: Comparative study of hough transform methods for circle finding. Image Vis. Comput. 8(1), 71–77 (1990)

    Article  Google Scholar 

  19. Hoque M.M., Das D., Onuki T., Kobayashi Y., Kuno Y.: Robotic system controlling target human’s attention. In: Huang, D.S., Ma, J., Jo, K.H., Gromiha, M.M. (eds.) Intelligent Computing Theories and Applications. ICIC 2012. Lecture Notes in Computer Science, vol. 7390. Springer, Berlin (2012)

    Google Scholar 

  20. Helokunnas, S.: Neural responses to observed eye blinks in normal and slow motion: an MEG study M.S. thesis, Cognitive Science, Institute of Behavioural Sciences, University of Helsinki, Finland (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Chittagong University of Engineering and Technology, Chattagram, 4349, Bangladesh

    Shayla Sharmin & Mohammad Moshiul Hoque

Authors
  1. Shayla Sharmin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammad Moshiul Hoque
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammad Moshiul Hoque .

Editor information

Editors and Affiliations

  1. Department of Fundamental and Applied Sciences, Universiti Teknologi Petronas, Tronoh, Perak, Malaysia

    Pandian Vasant

  2. Computer Science, FEI, VSB-TU Ostrava, Ostrava, Czech Republic

    Ivan Zelinka

  3. Faculty of Engineering Management, Poznan University of Technology, Poznan, Poland

    Gerhard-Wilhelm Weber

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sharmin, S., Hoque, M.M. (2020). Developing an Empirical Robotic Framework to Establish Bidirectional Eye Contact. In: Vasant, P., Zelinka, I., Weber, GW. (eds) Intelligent Computing and Optimization. ICO 2019. Advances in Intelligent Systems and Computing, vol 1072. Springer, Cham. https://doi.org/10.1007/978-3-030-33585-4_39

Download citation

Publish with us

Policies and ethics

Search

Navigation