Abstract
This research aims to demonstrate that artificial intelligence (AI) can function not only as a tool for learning, but also as an intelligent agent with which humans can engage in collaborative learning (CL) to change epistemic practices in science classrooms. We adopted a design and development research approach, following the Analysis, Design, Development, Implementation and Evaluation (ADDIE) model, to prototype a tangible instructional system called Collaborative Learning with AI Speakers (CLAIS). The CLAIS system is designed to have 3–4 human learners join an AI speaker to form a small group, where humans and AI are considered peers participating in the Jigsaw learning process. The development was carried out using the NUGU AI speaker platform. The CLAIS system was successfully implemented in a Science Education course session with 15 pre-service elementary science teachers. The participants evaluated the CLAIS system through mixed methods surveys as teachers, learners, peers, and users. Quantitative data showed that the participants’ Intelligent-Technological, Pedagogical, and Content Knowledge was significantly increased after the CLAIS session, the perception of the CLAIS learning experience was positive, the peer assessment on AI speakers and human peers was different, and the user experience was ambivalent. Qualitative data showed that the participants came to anticipate future changes in the epistemic process in science classrooms, while acknowledging technical issues such as speech recognition and response latency. This study highlights the potential of human-AI collaboration for knowledge co-construction in authentic classroom settings and exemplifies how AI could shape the future landscape of epistemic practices in the classroom.
Similar content being viewed by others
Notes
https://www.springer.com/journal/11191/updates/23312040 (Retrieved January 5.th, 2023).
https://www.nugu.co.kr/ (Retrieved November 19th, 2023).
References
Aronson, E., Blaney, N., Sikes, J., Stephan, C., & Snapp, M. (1978). The jigsaw classroom. Sage.
Berg, G. A. (2000). Human-computer interaction (HCI) in educational environments: Implications of understanding computers as media. Journal of Educational Multimedia and Hypermedia, 9(4), 347–368.
Blosser, P. E. (1993). Using cooperative learning in science education. The Science Outlook. Columbus, OH: ERIC Clearinghouse on Science, Mathematics, and Environmental Education.
Bowen, C. W. (2000). A quantitative literature review of cooperative learning effects on high school and college chemistry achievement. Journal of Chemical Education, 77(1), 116–119.
Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. CRC Press.
Celik, I. (2023). Towards intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, 107468.
Chang, J. (2019). A study on the educational uses of smart speaker. Journal of the Korea Convergence Society, 10(11), 33–39. [in Korean].
Chen, X., Zou, D., Xie, H., & Cheng, G. (2021). Twenty years of personalized language learning. Educational Technology & Society, 24(1), 205–222.
Choi, M. J. (2022). Evaluation of cooperative learning using Jigsaw model combined with nursing lecture class: Effects on self-directed learning ability and academic self-efficacy for nursing college students, and process evaluation. Journal of Learner-Centered Curriculum and Instruction, 22(6), 563–582. [in Korean].
Chung, S., & Woo, B. K. (2020). Using consumer perceptions of a voice-activated speaker device as an educational tool. JMIR Medical Education, 6(1), e17336.
Damon, W., & Phelps, E. (1989). Critical distinctions among three approaches to peer education. International Journal of Educational Research, 13(1), 9–19.
Dillenbourg, P. (1999). Collaborative learning: Cognitive and computational approaches. Elsevier.
Divaharan, S., & Atputhasamy, L. (2002). An attempt to enhance the quality of cooperative learning through peer assessment. The Journal of Educational Enquiry, 3(2), 72–83.
Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research. Orienta-Konsultit Oy.
Ha, M., Lee, G. -G., Shin, S., Lee, J. K., Choi, S., Choo, J., ... & Park, J. (2019). Assessment as a learning-support tool and utilization of artificial intelligence: WA3I project case. School Science Journal, 13(3), 271–282.
Hakkarainen, K., Paavola, S., Kangas, K., & Seitamma-Hakkarainen, P. S. (2013). Sociocultural perspectives on collaborative learning: Toward collaborative knowledge creation. In C. E. Hmelo-Silver, C. A. Chinn, C. K. K. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 57–73). Routledge.
Harrison, R., Flood, D., & Duce, D. (2013). Usability of mobile applications: Literature review and rationale for a new usability model. Journal of Interaction Science, 1(1), 1–16.
Haudek, K. C., Prevost, L. B., Moscarella, R. A., Merrill, J., & Urban-Lurain, M. (2012). What are they thinking? Automated analysis of student writing about acid–base chemistry in introductory biology. CBE-Life Sciences Education, 11(3), 283–293.
Hemmer, P., Schemmer, M., Vössing, M., & Kühl, N. (2021). Human-AI complementarity in hybrid intelligence systems: A structured literature review. In Proceedings of Twenty-fifth Pacific Asia Conference on Information Systems (pp. 78–91)
Hiltz, S. R. (1998). Collaborative learning in asynchronous learning networks: Building learning communities. In Paper presented at the WebNet 98 world conference of the WWW, Internet, and Intranet (ERIC Document Reproduction Service No. ED 427 705 IR 019 256).
Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. The Center for Curriculum Redesign.
Hu, X., Ng, J. T., & Chu, S. K. (2022). Implementing learning analytics in wiki-supported collaborative learning in secondary education: A framework-motivated empirical study. International Journal of Computer-Supported Collaborative Learning, 17(3), 427–455.
Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100001.
Jeong, S.-K., & Park, N.-S. (2022). Analysis of class satisfaction with peer evaluation in collaborative learning-based classes. Journal of Convergence for Information Technology, 12(3), 158–170. [in Korean].
Johnson, R. T., & Johnson, D. W. (2002). Learning together and alone: Overview and meta-analysis. Asia Pacific Journal of Education, 22(1), 95–105.
Kim, J., Lee, H., & Cho, Y. H. (2022). Learning design to support student-AI collaboration: Perspectives of leading teachers for AI in education. Education and Information Technologies, 27, 6069–6104.
Kim, J., Shin, E., Han, K., Park, S., Youn, J. H., Jin, G., & Lee, J. Y. (2021). Efficacy of smart speaker–based metamemory training in older adults: Case-control cohort study. Journal of Medical Internet Research, 23(2), e20177.
Kim, W. J. (2022). AI-integrated science teaching through facilitating epistemic discourse in the classroom. Asia-Pacific Science Education, 8, 9–42.
Kim, Y., Soyata, T., & Behnagh, R. F. (2018). Towards emotionally aware AI smart classroom: Current issues and directions for engineering and education. IEEE Access, 6, 5308–5331.
Kinzie, M. B., Sullivan, H. J., & Berdel, R. L. (1988). Learner control and achievement in science computer-assisted instruction. Journal of Educational Psychology, 80(3), 299–303.
Krange, I., & Ludvigsen, S. (2008). What does it mean? Students’ procedural and conceptual problem solving in a CSCL environment designed within the field of science education. International Journal of Computer-Supported Collaborative Learning, 3(1), 25–51.
Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018.
Kyndt, E., Raes, E., Lismont, B., Timmers, F., Cascallar, E., & Dochy, F. (2013). Ameta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educational Research Review, 10, 133–149.
Lai, V., Chen, C., Liao, Q. V., Smith-Renner, A., & Tan, C. (2021). Towards a science of human-AI decision making: A survey of empirical studies. arXiv preprint arXiv:2112.11471.
Latour, B. (2007). Reassembling the social: An introduction to actor-network-theory. Oup Oxford.
Lee, J., Lee, G. -G., & Hong, H. G. (2023a). Automated assessment of student hand drawings in free-response items on the particulate nature of matter. Journal of Science Education and Technology, 32(4), 549–566.
Lee, G. -G., Choi, M., An, T., Mun, S., & Hong, H. G. (2023b). Development of the hands-free AI speaker system supporting hands-on science laboratory class: A rapid prototyping. International Journal of Emerging Technologies in Learning, 18(1), 115–136.
Lee, G. -G., & Ha, M. (2020). The present and future of AI-based automated evaluation: A literature review on descriptive assessment and other side. Journal of Educational Technology, 36(2), 353–382.
Lee, G. -G., Jeon, Y. E., & Hong, H. G. (2021). The effects of cooperative flipped learning on science achievement and motivation in high school students. International Journal of Science Education, 43(9), 1381–1407.
Li, T., Reigh, E., He, P., & Adah Miller, E. (2023). Can we and should we use artificial intelligence for formative assessment in science? Journal of Research in Science Teaching, 1–5. https://doi.org/10.1002/tea.21867
Lovato, S. B. (2019). Hey Google, do unicorns exist?: Children finding answers through conversational agents. Doctoral dissertation, Northwestern University.
Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson.
Mills, B. J., & Cottell, P. G., Jr. (1998). Cooperative learning for higher education faculty. Oryx Press.
National Academies of Sciences, Engineering, and Medicine [NASEM]. (2022). Human-AI teaming: State-of-the-art and research needs. Washington, DC: The National Academies Press. https://doi.org/10.17226/26355
Nehm, R. H., & Ha, M. (2011). Item feature effects in evolution assessment. Journal of Research in Science Teaching, 48(3), 237–256.
Norvig, P., & Russell, S. (2021). Artificial intelligence: A modern approach (Global 4th edition). Pearson.
O’Donnell, A. M., & Hmelo-Silver, C. E. (2013). Introduction: What is collaborative learning? An overview. In C. E. Hmelo-Silver, C. A. Chinn, C. K. K. Chan, & A. O’Donnell (Eds.), The International Handbook of Collaborative Learning (pp. 1–40). Routledge.
Okolo, C. M., Bahr, C. M., & Rieth, H. J. (1993). A retrospective view of computer-based instruction. Journal of Special Education Technology, 12(1), 1–27.
Organisation for Economic Co-operation and Development [OECD]. (2019). OECD future of education and skills 2030: OECD learning compass 2030 – A series of concept notes. OECD.
Park, J., Lee, J.-K., Shin, S., & Ha, M. (2021). Analysis of high school students’ pereception on instructional feedback from humans and non-human subject: Focused on feedback from teachers, peers, and artificial intelligence. Journal of Learner-Centered Curriculum and Instruction, 21(5), 733–745.
Renzella, J., Cain, A., & Schneider, J. G. (2022). Verifying student identity in oral assessments with deep speaker. Computers and Education: Artificial Intelligence, 3, 100044.
Richey, R. C., & Klein, J. D. (2007). Design and development research: Methods, strategies, and issues. Routledge.
Richey, R. C., Klein, J., & Nelson, W. (2004). Developmental research: Studies of instructional design and development. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (2nd ed., pp. 1099–1130). Lawrence Erlbaum Associates Inc.
Roth, W. M., & McGinn, M. K. (1997). Science in schools and everywhere else: What science educators should know about science and technology studies. Studies in Science Education, 29(1), 1–43.
Schaeffer, R. S., & Cates, W. M. (1996). Cooperative software for the Internet. In M. R. Simonson, M. Hays, & S. Hall (Eds.), Proceedings of selected research and development presentations at the 1996 National Convention of the Association for Educational Communications and Technology (pp. 674–682). Ames: Iowa State University.
Şerban, C., & Todericiu, I. A. (2020). Alexa, What classes do I have today? The use of Artificial Intelligence via Smart Speakers in Education. Procedia Computer Science, 176, 2849–2857.
Shaikh, A. (2020). An interactive design using human computer interaction for autonomous vehicles. International Journal of Engineering Trends and Technology, 10(1), 160–172.
Shin, D., & Shim, J. (2021). A systematic review on data mining for mathematics and science education. International Journal of Science and Mathematics Education, 19, 639–659.
Slavin, R. E. (1978). Student teams and comparison among equals: Effects on academic performance and student attitudes. Journal of Educational Psychology, 70(4), 532–538.
Srinivasan, V. (2022). AI & learning: A preferred future. Computers and Education: Artificial Intelligence, 3, 100062.
Stahl, G. (2015). A decade of CSCL. International Journal of Computer-Supported Collaborative Learning, 10(4), 337–344.
Tan, S.-C. (2019). Learning with computers: Generating insights into the development of cognitive tools using cultural historical activity theory. Australasian Journal of Educational Technology, 35(2), 25–38.
Terzopoulos, G., & Satratzemi, M. (2020). Voice assistants and smart speakers in everyday life and in education. Informatics in Education, 19(3), 473–490.
Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes (14th ed.). Harvard University Press.
Weidman, R., & Bishop, M. J. (2009). Using the jigsaw model to facilitate cooperative learning in an online course. Quarterly Review of Distance Education, 10(1), 51–64.
Xiao, T., Tabashum, T., Metwally, B., Albert, M., Du, A., Jebamalaidass, R., ... & Oliviera, E. (2020, February). Conversation moderator: A mobile app for tracking individual speaking in group conversations. In 2020 IEEE 14th International Conference on Semantic Computing (pp. 430–433). IEEE.
Zhai, X. (2023). ChatGPT for next generation science learning. XRDS: Crossroads, The ACM Magazine for Students, 29(3), 42–46.
Zhai, X., & Nehm, R. H. (2023). AI and formative assessment: The train has left the station. Journal of Research in Science Teaching, 60(6), 1390–1398.
Zhu, M., Lee, H. S., Wang, T., Liu, O. L., Belur, V., & Pallant, A. (2017). Investigating the impact of automated feedback on students’ scientific argumentation. International Journal of Science Education, 39(12), 1648–1668.
Zhu, M., Liu, O. L., & Lee, H. S. (2020). The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing. Computers & Education, 143, 103668.
Funding
This research is supported by Seoul National University Department of AI-Integrated Education.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1. Course syllabus
Appendix 2. English version of handout with learning content and problem set (Fig. 5)
(a): A handout page on Driver’s alternative conceptual framework [(Bold): The content students have to fill in].
(b): Peer evaluation rubric and problem set.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lee, GG., Mun, S., Shin, MK. et al. Collaborative Learning with Artificial Intelligence Speakers. Sci & Educ (2024). https://doi.org/10.1007/s11191-024-00526-y
Accepted:
Published:
DOI: https://doi.org/10.1007/s11191-024-00526-y