Skip to main content

A Multi-theoretic Analysis of Collaborative Discourse: A Step Towards AI-Facilitated Student Collaborations

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2023)


Collaboration analytics are a necessary step toward implementing intelligent systems that can provide feedback for teaching and supporting collaborative skills. However, the wide variety of theoretical perspectives on collaboration emphasize assessment of different behaviors toward different goals. Our work demonstrates rigorous measurement of collaboration in small group discourse that combines coding schemes from three different theoretical backgrounds: Collaborative Problem Solving, Academically Productive Talk, and Team Cognition. Each scheme measured occurrence of unique collaborative behaviors. Correlations between schemes were low to moderate, indicating both some convergence and unique information surfaced by each approach. Factor analysis drives discussion of the dimensions of collaboration informed by all three. The two factors that explain the most variance point to how participants stay on task and ask for relevant information to find common ground. These results demonstrate that combining analytical tools from different perspectives offers researchers and intelligent systems a more complete understanding of the collaborative skills assessable in verbal communication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions


  1. Gedney, J.: Development of an instrument to measure collaboration and satisfaction about care decisions. J. Adv. Nurs. 20(1), 176–182 (1994)

    Article  Google Scholar 

  2. Stewart, A., D’Mello, S.K.: Connecting the dots towards collaborative AIED: linking group makeup to process to learning. In: Penstein Rosé, C., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 545–556. Springer, Cham (2018).

    Chapter  Google Scholar 

  3. Forsell, J., Forslund Frykedal, K., Hammar Chiriac, E.: Group work assessment: assessing social skills at group level. Small Group Res. 51(2), 87–124 (2020)

    Article  Google Scholar 

  4. Walters, S.J., Stern, C., Robertson-Malt, S.: The measurement of collaboration within healthcare settings: a systematic review of measurement properties of instruments. JBI Evid. Synth. 14(4), 128–197 (2016)

    Google Scholar 

  5. Fiore, S.M., Graesser, A., Greiff, S.: Collaborative problem-solving education for the twenty-first-century workforce. Nat. Hum. Behav. 2(6), 367–369 (2018)

    Article  Google Scholar 

  6. O’Connor, C., Michaels, S., Chapin, S., Harbaugh, A.G.: The silent and the vocal: participation and learning in whole-class discussion. Learn. Instr. 48, 5–13 (2017)

    Article  Google Scholar 

  7. Marlow, S.L., Lacerenza, C.N., Salas, E.: Communication in virtual teams: a conceptual framework and research agenda. Hum. Res. Manag. Rev. 27(4), 575–589 (2017)

    Google Scholar 

  8. Graesser, A.C., Fiore, S.M., Greiff, S., Andrews-Todd, J., Foltz, P.W., Hesse, F.W.: Advancing the science of collaborative problem solving. Psychol. Sci. Public Interest 19(2), 59–92 (2018)

    Article  Google Scholar 

  9. Fiore, S.M., Rosen, M.A., Smith-Jentsch, K.A., Salas, E., Letsky, M., Warner, N.: Toward an understanding of macrocognition in teams: predicting processes in complex collaborative contexts. Hum. Factors 52(2), 203–224 (2010)

    Article  Google Scholar 

  10. Sun, C., Shute, V.J., Stewart, A., Yonehiro, J., Duran, N., D’Mello, S.: Towards a generalized competency model of collaborative problem solving. Comput. Educ. 143, 103672 (2020)

    Article  Google Scholar 

  11. Andrews-Todd, J., Kerr, D.: Application of ontologies for assessing collaborative problem solving skills. Int. J. Test. 19(2), 172–187 (2019)

    Article  Google Scholar 

  12. Resnick, L.B., Asterhan, C.S.C., Clarke, S.N.: Accountable talk: instructional dialogue that builds the mind. In: Marope, M., Vosniadou, S. (eds.) Educational Practices Series 29, pp. 14–32. The International Academy of Education (IAE) and the International Bureau of Education (IBE) of the United Nations Educational, Scientific and Cultural Organization (UNESCO), Geneva (2018)

    Google Scholar 

  13. Webb, N.M., Franke, M.L., Ing, M., Turrou, A.C., Johnson, N.C., Zimmerman, J.: Teacher practices that promote productive dialogue and learning in mathematics classrooms. Int. J. Educ. Res. 97, 176–186 (2019)

    Article  Google Scholar 

  14. O’Connor, C., Michaels, S.: Supporting teachers in taking up productive talk moves: the long road to professional learning at scale. Int. J. Educ. Res. 97, 166–175 (2019)

    Article  Google Scholar 

  15. Cooke, N.J., Gorman, J.C., Myers, C.W., Duran, J.L.: Interactive team cognition. Cogn. Sci. 37(2), 255–285 (2013)

    Article  Google Scholar 

  16. González-Romá, V., Hernández, A.: Climate uniformity: its influence on team communication quality, task conflict, and team performance. J. Appl. Psychol. 99(6), 1042 (2014)

    Article  Google Scholar 

  17. Leidenfrost, B., Strassnig, B., Schabmann, A., Spiel, C., Carbon, C.-C.: Peer mentoring styles and their contribution to academic success among mentees: a person-oriented study in higher education. Mentoring Tutoring: Partnership Learn. 19(3), 347–364 (2011)

    Article  Google Scholar 

  18. Jordan, B., Henderson, A.: Interaction analysis: foundations and practice. J. Learn. Sci. 4(1), 39–103 (1995)

    Article  Google Scholar 

  19. Suthers, D.D., Lund, K., Rosé, C.P., Teplovs, C.: Achieving productive multivocality in the analysis of group interactions. In: Suthers, D.D., Lund, K., Rosé, C.P., Teplovs, C., Law, N. (eds.) Productive Multivocality in the Analysis of Group Interactions. CCLS, vol. 15, pp. 577–612. Springer, Boston, MA (2013).

    Chapter  MATH  Google Scholar 

  20. Rosé, C.P.: A Multivocal Analysis of the Emergence of Leadership in Chemistry Study Groups. In: Suthers, D.D., Lund, K., Rosé, C.P., Teplovs, C., Law, N. (eds.) Productive Multivocality in the Analysis of Group Interactions, pp. 243–254. Springer, New York. (2013).

    Chapter  MATH  Google Scholar 

  21. Suresh, A., et al.: Using transformers to provide teachers with personalized feedback on their classroom discourse: The TalkMoves application. Paper presented to the 2021 AAAI Conference on Artificial Intelligence in K-12 Education (2021)

    Google Scholar 

  22. Reitman, J. G.: Generalizable Communication Styles in Novice and Expert Team Performance. Doctoral Dissertation. UC Irvine, (2022)

    Google Scholar 

Download references


This research was supported by the NSF National AI Institute for Student-AI Teaming (iSAT) under grant DRL 2019805. The opinions expressed are those of the authors and do not represent views of the NSF.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Jason G. Reitman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Reitman, J.G. et al. (2023). A Multi-theoretic Analysis of Collaborative Discourse: A Step Towards AI-Facilitated Student Collaborations. In: Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O.C., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2023. Lecture Notes in Computer Science(), vol 13916. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-36271-2

  • Online ISBN: 978-3-031-36272-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics