Skip to main content

Surveying Teachers’ Preferences and Boundaries Regarding Human-AI Control in Dynamic Pairing of Students for Collaborative Learning

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12884)


Orchestration tools may support K-12 teachers in facilitating student learning, especially when designed to address classroom stakeholders’ needs. Our previous work revealed a need for human-AI shared control when dynamically pairing students for collaborative learning in the classroom, but offered limited guidance on the role each agent should take. In this study, we designed storyboards for scenarios where teachers, students and AI co-orchestrate dynamic pairing when using AI-based adaptive math software for individual and collaborative learning. We surveyed 54 math teachers on their co-orchestration preferences. We found that teachers would like to share control with the AI to lessen their orchestration load. As well, they would like to have the AI propose student pairs with explanations, and identify risky proposed pairings. However, teachers are hesitant to let the AI auto-pair students even if they are busy, and are less inclined to let AI override teacher-proposed pairing. Our study contributes to teachers’ needs, preference, and boundaries for how they want to share the task and control of student pairing with the AI and students, and design implications in human-AI co-orchestration tools.


  • Classroom
  • Human-AI collaboration
  • CSCL
  • HCI
  • Design orchestration tools

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-86436-1_20
  • Chapter length: 15 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-86436-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.


  1. 1.

    N refers to the number of teachers’ comments.


  1. Hämäläinen, R., Vähäsantanen, K.: Theoretical and pedagogical perspectives on orchestrating creativity and collaborative learning. Educ. Res. Rev. 6, 169–184 (2011).

    CrossRef  Google Scholar 

  2. van Leeuwen, A., Rummel, N.: Orchestration tools to support the teacher during student collaboration: a review. Unterrichtswissenschaft 47(2), 143–158 (2019).

    CrossRef  Google Scholar 

  3. Olsen, J.K., Rummel, N., Aleven, V.: Designing for the co-orchestration of social transitions between individual, small-group and whole-class learning in the classroom. Int. J. Artif. Intell. Educ. 31(1), 24–56 (2020).

    CrossRef  Google Scholar 

  4. Santos, L.P.P.: Supporting orchestration of blended CSCL scenarios in distributed learning environments (2012)

    Google Scholar 

  5. Holstein, K., Olsen, J.K.: Human–AI co-orchestration: the role of artificial intelligence in orchestration. In: Handbook of Artificial Intelligence in Education. Edward Elgar Publishing (2021)

    Google Scholar 

  6. Tissenbaum, M., Slotta, J.: Supporting classroom orchestration with real-time feedback: a role for teacher dashboards and real-time agents. Int. J. Comput.-Support. Collab. Learn. 14(3), 325–351 (2019).

    CrossRef  Google Scholar 

  7. Sharples, M.: Shared orchestration within and beyond the classroom. Comput. Educ. 69, 504–506 (2013).

    CrossRef  Google Scholar 

  8. Holstein, K., McLaren, B.M., Aleven, V.: Intelligent tutors as teachers’ aides: exploring teacher needs for real-time analytics in blended classrooms. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 257–266. Association for Computing Machinery, New York (2017)

    Google Scholar 

  9. Alavi, H.S., Dillenbourg, P., Kaplan, F.: Distributed awareness for class orchestration. In: Cress, U., Dimitrova, V., Specht, M. (eds.) Learning in the Synergy of Multiple Disciplines, pp. 211–225. Springer, Heidelberg (2009).

    CrossRef  Google Scholar 

  10. Martinez-Maldonado, R., Clayphan, A., Yacef, K., Kay, J.: MTFeedback: providing notifications to enhance teacher awareness of small group work in the classroom. IEEE Trans. Learn. Technol. 8, 187–200 (2015).

  11. Echeverria, V., Holstein, K., Huang, J., Sewall, J., Rummel, N., Aleven, V.: Exploring human–AI control over dynamic transitions between individual and collaborative learning. In: Alario-Hoyos, C., Rodríguez-Triana, M.J., Scheffel, M., Arnedillo-Sánchez, I., Dennerlein, S.M. (eds.) EC-TEL 2020. LNCS, vol. 12315, pp. 230–243. Springer, Cham (2020).

    CrossRef  Google Scholar 

  12. Holstein, K., McLaren, B.M., Aleven, V.: Designing for complementarity: teacher and student needs for orchestration support in AI-enhanced classrooms. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), vol. 11625, pp. 157–171. Springer, Cham (2019).

    CrossRef  Google Scholar 

  13. Holstein, K., McLaren, B., Aleven, V.: Student learning benefits of a mixed-reality teacher awareness tool in AI-enhanced classrooms. In: Rosé, C.P., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 154–168. Springer, Cham (2018).

    CrossRef  Google Scholar 

  14. Davidoff, S., Lee, M.K., Dey, A.K., Zimmerman, J.: Rapidly exploring application design through speed dating. In: Krumm, J., Abowd, G.D., Seneviratne, A., Strang, T. (eds.) UbiComp 2007. LNCS, vol. 4717, pp. 429–446. Springer, Heidelberg (2007).

    CrossRef  Google Scholar 

  15. Holstein, K., Aleven, V., Rummel, N.: A conceptual framework for human–AI hybrid adaptivity in education. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) AIED 2020. LNCS (LNAI), vol. 12163, pp. 240–254. Springer, Cham (2020).

    CrossRef  Google Scholar 

  16. van Leeuwen, A., et al.: Orchestration tools for teachers in the context of individual and collaborative learning: what information do teachers need and what do they do with it? In: Symposium at ICLS (2018)

    Google Scholar 

  17. Sankaranarayanan, S., et al.: Designing for learning during collaborative projects online: tools and takeaways. Inf. Learn. Sci. 121, 569–577 (2020).

    CrossRef  Google Scholar 

  18. Miles, M.B., Huberman, A.M., Saldana, J.: Qualitative Data Analysis: A Methods Sourcebook. Sage, Thousand Oaks (2013)

    Google Scholar 

  19. Olsen, J.: Orchestrating combined collaborative and individual learning in the classroom.

  20. Yang, K.B., et al.: Exploring policies for dynamically teaming up students through log data simulation. In: Educational Data Mining (2021)

    Google Scholar 

Download references


This work was supported in part by Grant #1822861 from the National Science Foundation (NSF). Any opinions presented in this article are those of the authors and do not represent the views of the NSF. We thank all participating teachers and the anonymous reviewers.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Kexin Bella Yang .

Editor information

Editors and Affiliations

1 Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 1136 kb)

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Yang, K.B., Lawrence, L., Echeverria, V., Guo, B., Rummel, N., Aleven, V. (2021). Surveying Teachers’ Preferences and Boundaries Regarding Human-AI Control in Dynamic Pairing of Students for Collaborative Learning. In: De Laet, T., Klemke, R., Alario-Hoyos, C., Hilliger, I., Ortega-Arranz, A. (eds) Technology-Enhanced Learning for a Free, Safe, and Sustainable World. EC-TEL 2021. Lecture Notes in Computer Science(), vol 12884. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86435-4

  • Online ISBN: 978-3-030-86436-1

  • eBook Packages: Computer ScienceComputer Science (R0)