Skip to main content
SpringerLink
Log in

Creative Applications of Human Behavior Understanding

  • Conference paper
Human Behavior Understanding (HBU 2013)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8212))

Included in the following conference series:

Abstract

The role of computer science in the creative industries is becoming recognised as an important way to bring forward progress in both domains. There is a need for smarter applications that sense and adapt to their users in arts, creativity, entertainment and edutainment domains. Understanding human behavior in this area is challenging because it forces practitioners to engage in both creative, and perhaps counterintuitively, analytic processes of understanding how people engage with creative phenomena. The systems constructed for this purpose promise to enhance and redefine the scope of creative industries significantly. This paper discusses scientific and technological factors that make this a challenging topic to address, provides a brief survey of related work in this area, and identifies active topics of research. Since arts, creativity, entertainment and edutainment all contribute to significant social and societal benefits, it is vital to tackle the problem of measuring and evaluating the success of automatic behavior analysis solutions as a social and human phenomenon.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Avci, U., Passerini, A.: A fully unsupervised approach to activity discovery. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 77–88. Springer, Heidelberg (2013)

    Google Scholar 

  2. Bachour, K., Kaplan, F., Dillenbourg, P.: An interactive table for supporting participation balance in face-to-face collaborative learning. IEEE Transactions on Learning Technologies 3(3), 203–213 (2010)

    Article  Google Scholar 

  3. Baumgartner, T., Esslen, M., Jäncke, L.: From emotion perception to emotion experience: Emotions evoked by pictures and classical music. International Journal of Psychophysiology 60(1), 34–43 (2006)

    Article  Google Scholar 

  4. Baur, T., Damian, I., Lingenfelser, F., Wagner, J., André, E.: NovA: Automated analysis of nonverbal signals in social interactions. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 160–171. Springer, Heidelberg (2013)

    Google Scholar 

  5. Beesley, P.: Hylozoic soil. Leonardo 42(4), 360–361 (2009)

    Article  Google Scholar 

  6. Benitti, F.B.V.: Exploring the educational potential of robotics in schools: A systematic review. Computers & Education 58(3), 978–988 (2012)

    Article  Google Scholar 

  7. Bloom, V., Makris, D., Argyriou, V.: Dynamic feature selection for online action recognition. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 64–76. Springer, Heidelberg (2013)

    Google Scholar 

  8. Boerman, H., Bergman, T., Pieters, J., Reitsma, L., van den Hoven, E.: Sissy: an interactive installation with a personality. In: OZCHI Workshop Proceedings - The Body In Design, pp. 1–4 (2011)

    Google Scholar 

  9. Conigliaro, D., Setti, F., Bassetti, C., Ferrario, R., Cristani, M.: ATTENTO: ATTENTion Observed for automated spectator crowd monitoring. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 102–111. Springer, Heidelberg (2013)

    Google Scholar 

  10. Dautenhahn, K., Werry, I.: Towards interactive robots in autism therapy: Background, motivation and challenges. Pragmatics & Cognition 12(1), 1–35 (2004)

    Article  Google Scholar 

  11. D’Errico, F., Leone, G., Poggi, I.: Types of help in the teacher”s multimodal behavior. In: Salah, A.A., Gevers, T., Sebe, N., Vinciarelli, A. (eds.) HBU 2010. LNCS, vol. 6219, pp. 125–139. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  12. Deweppe, A., Diniz, N., Coussement, P., Leman, M.: A methodological framework for the development and evaluation of user-centered art installations. Journal of Interdisciplinary Music Studies 5(1), 19–39 (2011)

    Google Scholar 

  13. Dillenbourg, P., Evans, M.: Interactive tabletops in education. International Journal of Computer-Supported Collaborative Learning 6(4), 491–514 (2011), http://dx.doi.org/10.1007/s11412-011-9127-7

    Article  Google Scholar 

  14. Dornaika, F., Bosgahzadeh, A., Raducanu, B.: Efficient graph construction for label propagation based multi-observation face recognition. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 124–135. Springer, Heidelberg (2013)

    Google Scholar 

  15. Drira, H., Amor, B.B., Daoudi, M., Berretti, S.: A dense deformation field for facial expression analysis in dynamic sequences of 3D scans. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 148–159. Springer, Heidelberg (2013)

    Google Scholar 

  16. Druin, A., Hendler, J.A.: Robots for kids: Exploring new technologies for learning experiences. Morgan Kaufmann (2000)

    Google Scholar 

  17. Eriksson, J., Mataric, M.J., Winstein, C.J.: Hands-off assistive robotics for post-stroke arm rehabilitation. In: 9th International Conference on Rehabilitation Robotics, ICORR 2005, pp. 21–24. IEEE (2005)

    Google Scholar 

  18. Fourati, N., Pelachaud, C.: Head, shoulders and hips behaviors during turning. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 223–234. Springer, Heidelberg (2013)

    Google Scholar 

  19. Gardair, C., Healey, P.G., Welton, M.: Performing places. In: Proceedings of the 8th ACM Conference on Creativity and Cognition, pp. 51–60. ACM, New York (2011), http://doi.acm.org/10.1145/2069618.2069629

    Chapter  Google Scholar 

  20. Glowinski, D., Coletta, P., Volpe, G., Camurri, A., Chiorri, C., Schenone, A.: Multi-scale entropy analysis of dominance in social creative activities. In: Proceedings of the International Conference on Multimedia, MM 2010, pp. 1035–1038. ACM, New York (2010), http://doi.acm.org/10.1145/1873951.1874143

    Google Scholar 

  21. Görer, B., Salah, A., Akın, H.: A robotic fitness coach for the elderly. In: Int. Joint Conf. on Ambient Intelligence (2013)

    Google Scholar 

  22. Hanjalic, A.: Adaptive extraction of highlights from a sport video based on excitement modeling. IEEE Transactions on Multimedia 7(6), 1114–1122 (2005)

    Article  Google Scholar 

  23. Hara, K., Takemura, N., Iwai, Y., Sato, K.: Table-Top Interface Using Fingernail Images and Real Object Recognition. In: Keyson, D.V., et al. (eds.) AmI 2011. LNCS, vol. 7040, pp. 21–30. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  24. Höök, K., Sengers, P., Andersson, G.: Sense and sensibility: evaluation and interactive art. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2003, pp. 241–248. ACM, New York (2003), http://doi.acm.org/10.1145/642611.642654

    Google Scholar 

  25. Jovanovic, M., Starcevic, D., Minovic, M., Stavljanin, V.: Motivation and multimodal interaction in model-driven educational game design. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 41(4), 817–824 (2011)

    Article  Google Scholar 

  26. Kannetis, T., Potamianos, A.: Towards adapting fantasy, curiosity and challenge in multimodal dialogue systems for preschoolers. In: Proceedings of the 2009 International Conference on Multimodal Interfaces, ICMI-MLMI 2009, pp. 39–46. ACM, New York (2009), http://doi.acm.org/10.1145/1647314.1647324

    Chapter  Google Scholar 

  27. Keskin, C., Kıraç, F., Kara, Y.E., Akarun, L.: Hand pose estimation and hand shape classification using multi-layered randomized decision forests. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 852–863. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  28. Labov, W.: Field Methods of the Project in Linguistic Change and Variation. In: Language in Use, pp. 28–53. Prentice-Hall (1984)

    Google Scholar 

  29. Lang, P.: The cognitive psychophysiology of Emotion: Anxiety and the anxiety disorders. Lawrence Erlbaum, Hillside (1985)

    Google Scholar 

  30. Lombardi, M., Pieracci, A., Santinelli, P., Vezzani, R., Cucchiara, R.: Human behavior understanding with wide area sensing floors. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 112–123. Springer, Heidelberg (2013)

    Google Scholar 

  31. Ma, K.-T., Sim, T., Kankanhalli, M.: VIP: An unifying formal framework for computational eye-gaze research. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 209–222. Springer, Heidelberg (2013)

    Google Scholar 

  32. Marchegiani, L., Fafoutis, X.: A behavioral study on the effects of rock music on auditory attention. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 15–26. Springer, Heidelberg (2013)

    Google Scholar 

  33. Matsumoto, D., Willingham, B.: The thrill of victory and the agony of defeat: spontaneous expressions of medal winners of the 2004 athens olympic games. Journal of Personality and Social Psychology 91(3), 568–581 (2006)

    Article  Google Scholar 

  34. Mihoub, A., Bailly, G., Wolf, C.: Social behavior modeling based on incremental discrete hidden Markov models. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 172–183. Springer, Heidelberg (2013)

    Google Scholar 

  35. Moreno, A., Reidsma, D., van Delden, R., Poppe, R.: Socially aware interactive playgrounds: Sensing and inducing social behavior. IEEE Pervasive Computing 12(3), 40–47 (2013)

    Article  Google Scholar 

  36. Morgan, E., Gunes, H.: Human nonverbal behaviour understanding in the wild for new media art. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 27–39. Springer, Heidelberg (2013)

    Google Scholar 

  37. Morgan, E., Gunes, H., Bryan-Kinns, N.: Measuring affect for the study and enhancement of co-present creative collaboration. In: Proc. of Int’l Conference on Affective Computing and Intelligent Interaction, ACII (2013)

    Google Scholar 

  38. Niewiadomski, R., Mancini, M., Baur, T., Varni, G., Griffin, H., Aung, M.S.H.: MMLI: Multimodal multiperson corpus of laughter in interaction. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 184–195. Springer, Heidelberg (2013)

    Google Scholar 

  39. Öhman, A., Flykt, A., Esteves, F.: Emotion drives attention: detecting the snake in the grass. Journal of Experimental Psychology: General 130(3), 466–478 (2001)

    Article  Google Scholar 

  40. Otsuka, Y., Inoue, T.: Designing a conversation support system in dining together based on the investigation of actual party. In: 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1467–1472 (2012)

    Google Scholar 

  41. Pfister, T., Robinson, P.: Real-time recognition of affective states from nonverbal features of speech and its application for public speaking skill analysis. IEEE Transactions on Affective Computing 2(2), 66–78 (2011)

    Article  Google Scholar 

  42. Rasheed, U., Tahir, Y., Dauwels, S., Dauwels, J., Thalmann, D., Thalmann, N.: Real-time comprehensive sociometrics for two-person dialogs. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 196–208. Springer, Heidelberg (2013)

    Google Scholar 

  43. Martínez, M.F.R., Medrano, C., Herrero, E., Orrite, C.: Transfer learning of human poses for action recognition. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 89–101. Springer, Heidelberg (2013)

    Google Scholar 

  44. Rogers, Y., Preece, J., Sharp, H.: Interaction Design. Wiley & Sons 2011 (2007)

    Google Scholar 

  45. Ros, R., Demiris, Y.: Creative dance: an approach for social interaction between robots and children. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 40–51. Springer, Heidelberg (2013)

    Google Scholar 

  46. Salah, A.A., Gevers, T., Sebe, N., Vinciarelli, A.: Challenges of human behavior understanding. In: Salah, A.A., Gevers, T., Sebe, N., Vinciarelli, A. (eds.) HBU 2010. LNCS, vol. 6219, pp. 1–12. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  47. Samadani, A.-A., Gorbet, R., Kulić, D.: Gender differences in the perception of affective movements. In: Salah, A.A., Ruiz-del-Solar, J., Meriçli, Ç., Oudeyer, P. (eds.) HBU 2012. LNCS, vol. 7559, pp. 65–76. Springer, Heidelberg (2012)

    Google Scholar 

  48. Schouten, B.A., Tieben, R., van de Ven, A., Schouten, D.W.: Human behavior analysis in ambient gaming and playful interaction. In: Salah, A.A., Gevers, T. (eds.) Computer Analysis of Human Behavior, pp. 387–403. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  49. Siegert, I., Hartmann, K., Philippou-Hübner, D., Wendemuth, A.: Human behaviour in HCI: Complex emotion detection through sparse speech features. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 246–257. Springer, Heidelberg (2013)

    Google Scholar 

  50. Smeaton, A.F., Rothwell, S.: Biometric responses to music-rich segments in films: The cdvplex. In: Seventh International Workshop on Content-Based Multimedia Indexing, CBMI 2009, pp. 162–168. IEEE (2009)

    Google Scholar 

  51. Snibbe, S.S., Raffle, H.S.: Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2009, pp. 1447–1456. ACM, New York (2009), http://doi.acm.org/10.1145/1518701.1518920

    Google Scholar 

  52. Tarvainen, J., Westman, S., Oittinen, P.: Stylistic features for affect-based movie recommendations. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 52–63. Springer, Heidelberg (2013)

    Google Scholar 

  53. Turk, M.: Multimodal interaction: A review. Pattern Recognition Letters (2013)

    Google Scholar 

  54. Varni, G., Volpe, G., Camurri, A.: A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media. IEEE Transactions on MultiMedia 12(6), 576–590 (2010)

    Article  Google Scholar 

  55. Varni, G., Mancini, M., Volpe, G., Camurri, A.: Sync’n’Move: Social Interaction Based on Music and Gesture. In: Daras, P., Ibarra, O.M. (eds.) UCMedia 2009. LNICST, vol. 40, pp. 31–38. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  56. Wang, W., Enescu, V., Sahli, H.: Towards real-time continuous emotion recognition from body movements. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 235–245. Springer, Heidelberg (2013)

    Google Scholar 

  57. Watanabe, E., Ozeki, T., Kohama, T.: Extraction of relations between behaviors by lecturer and students in lectures. In: 2011 IEEE International Conference on Automatic Face Gesture Recognition and Workshops (FG 2011), pp. 945–950 (2011)

    Google Scholar 

  58. Whyte, W.H.: The Social Life of Small Urban Spaces. Project for Public Spaces Inc. (2001)

    Google Scholar 

  59. Wolf, G.: The data-driven life. The New York Times 28 (2010)

    Google Scholar 

  60. Woolley, A.W., Chabris, C.F., Pentland, A., Hashmi, N., Malone, T.W.: Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science 330(6004), 686–688 (2010), http://dx.doi.org/10.1126/science.1193147

    Article  Google Scholar 

  61. Yüce, A., Arar, N.M., Thiran, J.P.: Multiple local curvature Gabor binary patterns for facial action recognition. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds.) HBU 2013. LNCS, vol. 8212, pp. 136–147. Springer, Heidelberg (2013)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Boğaziçi University, Istanbul, Turkey

    Albert Ali Salah

  2. Intelligent Systems, Delft University of Technology, 2628 CD, Delft, The Netherlands

    Hayley Hung

  3. Social Computing Group, Idiap Research Institute, Martigny, Switzerland

    Oya Aran

  4. School of Elect. Eng. & Computer Science, Queen Mary University of London, London, U.K.

    Hatice Gunes

Authors
  1. Albert Ali Salah
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hayley Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oya Aran
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hatice Gunes
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Engineering, Bogaziçi University, 34342, Bebek, Istanbul, Turkey

    Albert Ali Salah

  2. Delft University of Technology, Delft, The Netherlands

    Hayley Hung

  3. Idiap Research Institute, Martigny, Switzerland

    Oya Aran

  4. Queen Mary University of London, UK

    Hatice Gunes

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Salah, A.A., Hung, H., Aran, O., Gunes, H. (2013). Creative Applications of Human Behavior Understanding. In: Salah, A.A., Hung, H., Aran, O., Gunes, H. (eds) Human Behavior Understanding. HBU 2013. Lecture Notes in Computer Science, vol 8212. Springer, Cham. https://doi.org/10.1007/978-3-319-02714-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-02714-2_1

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-02713-5

  • Online ISBN: 978-3-319-02714-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation