Abstract
We are developing an intelligent orchestration system named FACT (Formative Assessment using Computational Technology). Orchestration refers the teacher’s management of a face-to-face classroom workflow that mixes small group, individual and whole class activities. FACT is composed of an unintelligent Media system and an intelligent Analysis system. Although the Analysis system, which is still being refined, is designed to increase collaboration, prior work suggests that the Media system could possibly harm collaboration. Thus, we conducted an evaluation of the FACT Media system in classrooms, comparing it against traditional classrooms. We coded videos of small groups in order to measure their collaboration. The FACT Media system did no harm: the distribution of collaboration codes in FACT classrooms is statistically similar to the distribution in traditional classrooms. This null result is welcome news and sets the stage for testing the benefits of the Analysis system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Viswanathan, S.A., VanLehn, K.: Using the tablet gestures and speech of pairs of students to classify their collaboration. IEEE Transactions on Learning Technologies (2017). in press
VanLehn, K., et al.: Some less obvious features of classroom orchestration systems. In: Lin, L., Atkinson, R.K. (eds.) Educational Technologies: Challenges. Applications and Learning Outcomes. Nova Science Publishers, Incorporated, Hauppauge (2016). in Press
VanLehn, K., et al.: How can FACT encourage collaboration and self-correction? In: Millis, K., et al., (Eds.) Multi-Disciplinary Approaches to Deep Learning. Routledge, New York (in press)
Wetzel, J., et al.: A preliminary evaluation of the usability of an AI-infused orchestration system. Artificial Intelligence in Education. Springer, London (2018)
Cheema, S., et al.: Electronic posters to support formative assessment. In: CHI EA Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 1159–1164. ACM (2016)
Looi, C.-K., Lin, C.-P., Liu, K.-P.: Group scribbles to support knowledge building in a jigsaw method. IEEE Trans. on Learn. Technol. 1(3), 157–164 (2008)
Scott, S.D., Mandryk, R.L., Inkpen, K.M.: Understanding children’s collaborative interactions in shared environments. J. of Comput. Assist. Learn. 19, 220–228 (2003)
Alcoholado, C., et al.: Comparing the use of the interpersonal computer, personal computer and pen-and-paper when solving arithmetic exercises. Br. J. Edu. Technol. 47(1), 91–105 (2016)
Nussbaum, M., Alcoholado, C., Buchi, T.: A comparative analysis of interactive arithmetic learning in the classroom and computer lab. Comput. Hum. Behav. 43, 183–188 (2015)
Mercier, E., Vourloumi, G., Higgens, S.: Student interactions and the development of ideas in multi-touch and paper-based collaborative mathematics problem solving. Br. J. Educ. Technol. 48(1), 162–175 (2015)
Higgins, S.E., et al.: Multi-touch tables and collaborative learning. Br. J. Educ. Technol. 43(6), 1041–1054 (2012)
Roschelle, J., Teasley, S.D.: The construction of shared knowledge in collaborative problem solving. In: O’Malley, C. (ed.) Computer-Supported Collaborative Learning. Springer, Heidelberg (1995)
Chi, M.T.H., Wylie, R.: ICAP: A hypothesis of differentiated learning effectiveness for four modes of engagement activities. Ed. Psychol. 49(4), 219–243 (2014)
Gweon, G., et al.: Measuring prevalence of other-oriented transactive contributions using an automated measure of speech style accommodation. Int. J. Comput.-Support. Collab. Learn. 8(2), 245–265 (2013)
Hausmann, R.G.M., Chi, M.T.H., Roy, M.: Learning from collaborative problem solving: An analysis of three hypothesized mechanisms. In: Cognitive Science Conference (2004)
Acknowledgements
This research was supported by the Bill and Melinda Gates Foundation under OPP1061281. We gratefully acknowledge the contributions of all the members of the FACT project, past and present.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
VanLehn, K. et al. (2018). The Effect of Digital Versus Traditional Orchestration on Collaboration in Small Groups. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10948. Springer, Cham. https://doi.org/10.1007/978-3-319-93846-2_69
Download citation
DOI: https://doi.org/10.1007/978-3-319-93846-2_69
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93845-5
Online ISBN: 978-3-319-93846-2
eBook Packages: Computer ScienceComputer Science (R0)