Skip to main content

Using Body Signals and Facial Expressions to Study the Norms that Drive Creative Collaboration

  • Conference paper
  • First Online:
Digital Transformation of Collaboration (COINs 2019)

Abstract

Collaboration and creativity are consistently among the top-ranked values across societies, industries, and educational organizations. What makes collaboration possible is social norms. Group-based norms have played a key role in the evolution and maintenance of human ability to work and create together. We are not born collaborative-beings; it is the ability for social cognition and normativity that allows us to collaborate with others. Despite social norms ubiquity and pervasiveness—and being one of the most invoked concepts in social science—it remains unclear what are the underlying mechanisms to the extent to be one of the big unsolved problems in the field. To contribute to close this gap, the authors take an enactive-ecological approach, in which social norms are dynamic and context-dependent socio-material affordances for collaborative activity. Social norms offer the agent possibilities for collaborative action with others in the form of pragmatic social cues. The novelty of this research is the application of quantitative methods using computational models and computer vision to collect and analyze data on the pragmatic social cues of social norms in creative collaboration. Researchers will benefit from those methods by having fast and reliable data collection and analysis at a high level of granularity. In the present study, we analyzed the interpersonal synchrony of physiological signals and facial expressions between participants, together with the participant’s perceived team cohesion. Despite the small size of the experiment, we could find correlations between signals and patterns that provide confidence in the feasibility of the methods employed. We conclude that the methods employed can be a powerful tool to collect and analyze data from larger groups and, therefore, shed some light on the—still not fully understood—underlying mechanisms of social normativity. The findings from the preliminary study are by no means conclusive, but serve as a proof of concept of the applicability of body signals and facial expressions to study social norms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. M. Schmidt, H. Rakoczy, (eds.), On The Uniqueness of Human Normative Attitudes, ed. by K. Bayertz, N. Roughley. The Normative Animal? On the Anthropological Significance of Social, Moral and Linguistic Norms. (Oxford University Press, 2019)

    Google Scholar 

  2. R. Boyd, P.J. Richerson, Culture and the evolution of human cooperation. Philos. Trans. R. Soc. Lond. Series B, Biol. Sci. 364(1533), 3281–3288 (2009). https://doi.org/10.1098/rstb.2009.0134

  3. Michael Tomasello, Amrisha Vaish, Origins of human cooperation and morality. Annu. Rev. Psychol. 64, 231–255 (2013). https://doi.org/10.1146/annurev-psych-113011-143812

    Article  Google Scholar 

  4. E. Fehr, U. Fischbacher, Social norms and human cooperation. Trends Cogn. Sci. 8(4), 85–90 (2004)

    Article  Google Scholar 

  5. D. Hadfield-Menell, M.K. Andrus, G.K. Hadfield, Legible Normativity for AI Alignment: The Value of Silly Rules (2018). http://arxiv.org/pdf/1811.01267v1

  6. E. Wenger, Communities of Practice and Social Learning Systems: The Career of a Concept, ed. by C. Blackmore. Social Learning Systems and Communities of Practice, vol. 14. (Springer London Ltd, England, 2010), pp. 179–198

    Google Scholar 

  7. T. Iba, An autopoietic systems theory for creativity. Procedia Soc. Behav. Sci. 2 (2010). https://doi.org/10.1016/j.sbspro.2010.04.071

  8. Niklas Luhmann, The world society as a social system. Int. J. Gen Syst 8(3), 131–138 (1982). https://doi.org/10.1080/03081078208547442

    Article  MathSciNet  Google Scholar 

  9. H.R. Maturana, F.J. Varela, Autopoiesis and Cognition, vol. 42. (Dordrecht, Springer Netherlands, 1980)

    Google Scholar 

  10. Erik Rietveld, Situated normativity: the normative aspect of embodied cognition in unreflective action. Mind 117(468), 973–1001 (2008). https://doi.org/10.1093/mind/fzn050

    Article  Google Scholar 

  11. J.J. Gibson, The Ecological Approach to Visual Perception. (Boston, MT, 1979)

    Google Scholar 

  12. J. Clancey, Situated Cognition: On Human Knowledge and Computer Representations. (Cambridge, Cambridge University Press (Learning in doing), 1997). http://www.loc.gov/catdir/description/cam028/96035839.html

  13. Presti Lo Patrizio, An ecological approach to normativity. Adapt. Behav. 24(1), 3–17 (2016). https://doi.org/10.1177/1059712315622976

    Article  Google Scholar 

  14. Ludger van Dijk, Erik Rietveld, Foregrounding sociomaterial practice in our understanding of affordances: the skilled intentionality framework. Front. Psychol. 7, 1969 (2016). https://doi.org/10.3389/fpsyg.2016.01969

    Article  Google Scholar 

  15. L. Wittgenstein, Philosophical investigations. Philosophische Untersuchungen. (Original 1953). (New York: Macmillan, 1958)

    Google Scholar 

  16. Etienne Wenger, Communities of Practice (Cambridge University Press, Cambridge, 1998)

    Book  Google Scholar 

  17. Jeremy Roschelle, William J. Clancey, Learning as social and neural. Educ. Psychol. 27(4), 435–453 (1992). https://doi.org/10.1207/s15326985ep2704_3

    Article  Google Scholar 

  18. H. Lyre, Socially extended cognition and shared intentionality. Frontiers in Psych. 9, 831 (2018)

    Google Scholar 

  19. M. Garbarino, M. Lai, D. Bender, R. Picard, S. Tognetti, Empatica E3–A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition, in Proceedings of the International Conference on Wireless Mobile Communication and Healthcare (MobiHealth, 2014)

    Google Scholar 

  20. D. Mønster, D.D. Håkonsson, J.K. Eskildsen, S. Wallot, Physiological evidence of interpersonal dynamics in a cooperative production task. Physiol. behav.r 156, 24–34 (2016). https://doi.org/10.1016/j.physbeh.2016.01.004

  21. W. Boucsein, Electrodermal Activity (Springer Science and Business Media, LLC, 2012)

    Book  Google Scholar 

  22. S. Taylor, N. Jaques, W. Chen, S. Fedor, A. Sano, R. Picard, Automatic identification of artifacts in electrodermal activity data, in Engineering in Medicine and Biology Conference, (2015)

    Google Scholar 

  23. M. Benedek, C. Kaernbach, A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190, 80–91 (2010)

    Article  Google Scholar 

  24. M. Martelli, J.M. Majib, D.G. Pelli, Are faces processed like words? A diagnostic test for recognition by parts. J. Vis. 5, 58–70 (2005)

    Article  Google Scholar 

  25. Daniel N. McIntosh, Spontaneous facial mimicry, liking and emotional contagion. Pol. Psychol. Bull. 37(1), 31 (2006)

    MathSciNet  Google Scholar 

  26. T. Baltrušaitis, A. Zadeh, Y.C. Lim, L. Morency, OpenFace 2.0: Facial Behavior Analysis Toolkit, in IEEE International Conference on Automatic Face and Gesture Recognition, 2018

    Google Scholar 

  27. P. Chikersal, M. Tomprou, Y. Kim, W.A. Williams L. Dabbish, Deep structures of collaboration: physiological correlates of collective intelligence and group satisfaction, in Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW 2017), (2017)

    Google Scholar 

  28. J. Hernandez, I. Riobo, A. Rozga, G. Abowd, R. Picard, Using electrodermal activity to recognize ease of engagement in children during social interactions, in Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2014), (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Santuber .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Santuber, J., Owoyele, B., Mukherjee, R., Ghosh, S.K., Edelman, J.A. (2020). Using Body Signals and Facial Expressions to Study the Norms that Drive Creative Collaboration. In: Przegalinska, A., Grippa, F., Gloor, P. (eds) Digital Transformation of Collaboration. COINs 2019. Springer Proceedings in Complexity. Springer, Cham. https://doi.org/10.1007/978-3-030-48993-9_2

Download citation

Publish with us

Policies and ethics