The Visual Computer

, Volume 29, Issue 9, pp 871–881 | Cite as

Let’s keep in touch online: a Facebook aware virtual human interface

  • Gengdai LiuEmail author
  • Shantanu Choudhary
  • Juzheng Zhang
  • Nadia Magenenat-Thalmann
Original Article


A virtual human is an effective interface for interacting with users and plays an important role in carrying out certain tasks. As social networking sites are getting more and more popular, we propose a Facebook aware virtual human. The social networking sites are used to empower virtual humans for interpersonal conversational interaction in this paper. We combine Internet world, physical world and 3D virtual world together to create a new interface for users to interact with an autonomous virtual human which can behave like a real modern human. In order to take advantages of social networking sites, virtual human gathers information of a user from its profile, its likes, dislikes and gauge mood from most recent status update. In two user studies, we investigated whether and how this new interface can enhance human–virtual human interaction. Some positive results concluded from these studies will be guidelines on research and development of future virtual human interfaces.


Virtual humans Social networking sites Human-virtual human interaction Dialogue 



This research, which is carried out at BeingThere Centre, is supported by the Singapore National Research Foundation under its International Research Centre @ Singapore Funding Initiative and administered by the IDM Programme Office. The authors would like to thank all researchers and staffs in IMI-NTU for their efforts on development of the virtual human platform and discussions about this work. The first author is partially supported by National Natural Science Foundation of China (Grant No: 61003197).


  1. 1.
    Swartout, W., Gratch, J., Hill, R., Hovy, E., Marsella, R., Rickel, J., Traum, D.: Toward virtual humans. AI Mag. 27(1), 96–108 (2006) Google Scholar
  2. 2.
    Kasap, Z., Moussa, M.B., Chaudhuri, P., Magnenat-Thalmann, N.: Making them remember—emotional virtual characters with memory. IEEE Comput. Graph. Appl. 29(2), 20–29 (2009) CrossRefGoogle Scholar
  3. 3.
    Prendinger, H., Ullrich, S., Nakasone, A., Ishizuka, M.: MPML3D: scripting agents for the 3D Internet. IEEE Trans. Vis. Comput. Graph. 17(5), 655–668 (2011) CrossRefGoogle Scholar
  4. 4.
    Bailenson, J.N., Blascovich, J.: This is your mind online. IEEE Spectr. 48(6), 78–83 (2011) CrossRefGoogle Scholar
  5. 5.
    Toma, L.C.: Affirming the self through online profiles: beneficial effects of social networking sites. In: ACM CHI, pp. 1749–1752. ACM, New York (2010) Google Scholar
  6. 6.
    Mavridis, N., Datta, C., et al.: Facebots: social robots utilizing and publishing social information in Facebook. In: IEEE Human Robot Interaction, pp. 273–274 (2009) Google Scholar
  7. 7.
    Takahashi, T., Bartneck, C., Katagiri, Y., Arai, N.H.: TelMeA—expressive avatars in asynchronous communications. Int. J. Hum.-Comput. Stud. 62(2), 193–209 (2005) CrossRefGoogle Scholar
  8. 8.
    Zanbaka, C.A., Ulinski, A.C., Goolkasian, P., Hodges, L.F.: Social responses to virtual humans: implications for future interface design. In: ACM CHI, pp. 1561–1570 (2007) Google Scholar
  9. 9.
    Raij, A., Johnsen, K., Dickerson, R., Lok, B., Cohen, M., Stevens, A., Bernard, T., Oxendine, C., Wagner, P., Lind, D.S.: Comparing interpersonal interactions with a virtual human to those with a real human. IEEE Trans. Vis. Comput. Graph. 13, 443–457 (2007) Google Scholar
  10. 10.
    Babu, S., Grechkin, T., Ziemer, C., Chihak, B., Cremer, J., Kearney, J., Plumert, J.: An immersive virtual peer for studying social influences on child cyclists’ road-crossing behavior. IEEE Trans. Vis. Comput. Graph. 17(1), 14–25 (2011) CrossRefGoogle Scholar
  11. 11.
    Daugherty, B., Wallendael, L.V., Babu, S., Cutler, B., Hodges, L.F.: Virtual human versus human administration of photographic lineups. IEEE Comput. Graph. Appl. 28(6), 65–75 (2008) CrossRefGoogle Scholar
  12. 12.
    Kotranza, A., Johnsen, K.J., Cendan, B., Miller, B., Lind, D.S., Lok, B.: Virtual multi-tools for hand and tool-based interaction with life-size virtual human agents. In: Proceedings of IEEE Symposium on 3D User Interfaces, pp. 23–30 (2009) CrossRefGoogle Scholar
  13. 13.
    Neff, M., Kipp, M., Albrecht, I., Seidel, H.-P.: Gesture modeling and animation based on a probabilistic recreation of speaker style. ACM Trans. Graph. 27(1), 1–24 (2008) CrossRefGoogle Scholar
  14. 14.
    Wang, N., Gratch, J.: Don’t just stare at me. In: ACM CHI, pp. 1241–1249. ACM, New York (2010) Google Scholar
  15. 15.
    Garau, M., Slater, M., Vinayagamoorthy, B., Brogni, A., Steed, A., Sasse, M.A.: The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In: ACM CHI, pp. 529–536. ACM, New York (2003) Google Scholar
  16. 16.
    Yamazaki, A., Yamazaki, K., Kuno, Y., Burdelski, M., Kawashima, M., Kuzuoka, H.: Precision timing in human–robot interaction: coordination of head movement and utterance. In: ACM CHI, pp. 131–140. ACM, New York (2008) Google Scholar
  17. 17.
    Andrist, S., Pejsa, T., Mutlu, B., Gleicher, M.: Designing effective gaze mechanisms for virtual agents. In: ACM CHI, pp. 705–714. ACM, New York (2012) Google Scholar
  18. 18.
    Groenegress, C., Spanlang, B., Slater, M.: The physiological mirror—a system for unconscious control of a virtual environment through physiological activity. Vis. Comput. 26(6–8), 649–657 (2010) CrossRefGoogle Scholar
  19. 19.
    Szafir, D., Mutlu, B.: Pay attention!: designing adaptive agents that monitor and improve user engagement. In: ACM CHI, pp. 11–20. ACM, New York (2012) Google Scholar
  20. 20.
    de Melo, C., Carnevale, P., Gratch, J.: The influence of emotions in embodied agents on human decision-making. In: 10th International Conference on Intelligent Virtual Agents, Philadelphia, PA, pp. 257–370 (2010) Google Scholar
  21. 21.
    Kasap, Z., Magnenat-Thalmann, N.: Building long-term relationships with virtual and robotic characters: the role of remembering. Vis. Comput. 28(1), 87–97 (2012) CrossRefGoogle Scholar
  22. 22.
    Saerbeck, M., Schut, T., Bartneck, C., Janse, M.D.: Expressive robots in education: varying the degree of social supportive behaviour of a robotic tutor. In: ACM CHI, pp. 1613–1622. ACM, New York (2010) Google Scholar
  23. 23.
    Gilbert, E., Karahalios, K.: Predicting tie strength with social media. In: ACM CHI, pp. 211–220. ACM, New York (2009) Google Scholar
  24. 24.
    Zhao, X., Sosik, B.S., Cosley, D.: It’s complicated: how romantic partners use Facebook. In: ACM CHI, pp. 771–780. ACM, New York (2012) Google Scholar
  25. 25.
    Sim, D.J., Ma, X., Zhao, S., Khoo, J.T., Bay, S.L., Jiang, Z.: Farmer’s tale: a Facebook game to promote volunteerism. In: ACM CHI, pp. 581–584. ACM, New York (2011) Google Scholar
  26. 26.
    Kramer, A.D.I.: The spread of emotion via Facebook. In: ACM CHI 2012, pp. 767–770. ACM, New York (2012) Google Scholar
  27. 27.
    Emeli, V., Christensen, H.: Enhancing the robot service experience through social media. In: IEEE RO-MAN, pp. 288–295 (2010) Google Scholar
  28. 28.
    Ma, X., Yang, X., Zhao, S.D.: Robots in my contact list: using social media platforms for human-robot interaction in domestic environment. In: ACM APCHI, pp. 133–140. ACM, New York (2012) CrossRefGoogle Scholar
  29. 29.
    Yonezawa, K., Miyaki, T., Rekimoto, J.: Cat@Log: Sensing device attachable to pet cats for supporting human-pet interaction. In: International Conference on Advances in Computer Entertainment Technology (ACE2009), pp. 149–156 (2009) Google Scholar
  30. 30.
    Gobron, S., Ahn, J., Paltoglou, G., Thelwall, M., Thalmann, D.: From sentence to emotion: a real-time three-dimensional graphics metaphor of emotions extracted from text. Vis. Comput. 26(6–8), 505–519 (2010) CrossRefGoogle Scholar
  31. 31.
    Tang, J., Zhang, Y., Sun, J., Rao, J., Yu, W., Chen, Y.: Quantitative study of individual emotional states in social networks. IEEE Trans. Affect. Comput. 3(2), 132–144 (2012) CrossRefGoogle Scholar
  32. 32.
    Isla, D.: Halo 3—building a better battle. In: Game Developers Conference (2008) Google Scholar
  33. 33.
    Ahonen, T., Hadid, A., Pietikinen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006) CrossRefGoogle Scholar
  34. 34.
    Markowitz, D., Kider, J.T. Jr., Shoulson, J.T., Badler, N.I.: Intelligent camera control using behavior trees. In: 4th International Conference on Motion in Games, pp. 156–167 (2011) CrossRefGoogle Scholar
  35. 35.
    Aron, A., Aron, E.N., Smollan, D.: Inclusion of other in the self-scale and the structure of interpersonal closeness. J. Pers. Soc. Psychol. 63, 596–612 (1992) CrossRefGoogle Scholar
  36. 36.
    Krumhuber, E.: Temporal aspects of smiles influence employment decisions: a comparison of human and synthetic faces. In: 11th European Conference Facial Expressions: Measurement and Meaning, pp. 730–735 (2005) Google Scholar
  37. 37.
    Bickmore, T., Cassell, J.: Relational agents: a model and implementation of building user trust. In: ACM CHI, pp. 396–403. ACM, New York (2001) Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Gengdai Liu
    • 1
    • 2
    Email author
  • Shantanu Choudhary
    • 1
  • Juzheng Zhang
    • 1
  • Nadia Magenenat-Thalmann
    • 1
  1. 1.Institute for Media InnovationNanyang Technological UniversitySingaporeSingapore
  2. 2.Xidian UniversityXi’anChina

Personalised recommendations