Skip to main content
Log in

Collaborative Learning with Artificial Intelligence Speakers

Pre-service Elementary Science Teachers’ Responses to the Prototype

  • SI: Epistemic Insight & Artificial Intelligence
  • Published:
Science & Education Aims and scope Submit manuscript

Abstract

This research aims to demonstrate that artificial intelligence (AI) can function not only as a tool for learning, but also as an intelligent agent with which humans can engage in collaborative learning (CL) to change epistemic practices in science classrooms. We adopted a design and development research approach, following the Analysis, Design, Development, Implementation and Evaluation (ADDIE) model, to prototype a tangible instructional system called Collaborative Learning with AI Speakers (CLAIS). The CLAIS system is designed to have 3–4 human learners join an AI speaker to form a small group, where humans and AI are considered peers participating in the Jigsaw learning process. The development was carried out using the NUGU AI speaker platform. The CLAIS system was successfully implemented in a Science Education course session with 15 pre-service elementary science teachers. The participants evaluated the CLAIS system through mixed methods surveys as teachers, learners, peers, and users. Quantitative data showed that the participants’ Intelligent-Technological, Pedagogical, and Content Knowledge was significantly increased after the CLAIS session, the perception of the CLAIS learning experience was positive, the peer assessment on AI speakers and human peers was different, and the user experience was ambivalent. Qualitative data showed that the participants came to anticipate future changes in the epistemic process in science classrooms, while acknowledging technical issues such as speech recognition and response latency. This study highlights the potential of human-AI collaboration for knowledge co-construction in authentic classroom settings and exemplifies how AI could shape the future landscape of epistemic practices in the classroom.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. https://www.springer.com/journal/11191/updates/23312040 (Retrieved January 5.th, 2023).

  2. https://www.nugu.co.kr/ (Retrieved November 19th, 2023).

References

  • Aronson, E., Blaney, N., Sikes, J., Stephan, C., & Snapp, M. (1978). The jigsaw classroom. Sage.

    Google Scholar 

  • Berg, G. A. (2000). Human-computer interaction (HCI) in educational environments: Implications of understanding computers as media. Journal of Educational Multimedia and Hypermedia, 9(4), 347–368.

    Google Scholar 

  • Blosser, P. E. (1993). Using cooperative learning in science education. The Science Outlook. Columbus, OH: ERIC Clearinghouse on Science, Mathematics, and Environmental Education.

    Google Scholar 

  • Bowen, C. W. (2000). A quantitative literature review of cooperative learning effects on high school and college chemistry achievement. Journal of Chemical Education, 77(1), 116–119.

    Article  Google Scholar 

  • Card, S. K., Moran, T. P., & Newell, A. (1983). The psychology of human-computer interaction. CRC Press.

    Google Scholar 

  • Celik, I. (2023). Towards intelligent-TPACK: An empirical study on teachers’ professional knowledge to ethically integrate artificial intelligence (AI)-based tools into education. Computers in Human Behavior, 138, 107468.

    Article  Google Scholar 

  • Chang, J. (2019). A study on the educational uses of smart speaker. Journal of the Korea Convergence Society, 10(11), 33–39. [in Korean].

    Google Scholar 

  • Chen, X., Zou, D., Xie, H., & Cheng, G. (2021). Twenty years of personalized language learning. Educational Technology & Society, 24(1), 205–222.

    Google Scholar 

  • Choi, M. J. (2022). Evaluation of cooperative learning using Jigsaw model combined with nursing lecture class: Effects on self-directed learning ability and academic self-efficacy for nursing college students, and process evaluation. Journal of Learner-Centered Curriculum and Instruction, 22(6), 563–582. [in Korean].

    Google Scholar 

  • Chung, S., & Woo, B. K. (2020). Using consumer perceptions of a voice-activated speaker device as an educational tool. JMIR Medical Education, 6(1), e17336.

    Article  Google Scholar 

  • Damon, W., & Phelps, E. (1989). Critical distinctions among three approaches to peer education. International Journal of Educational Research, 13(1), 9–19.

    Article  Google Scholar 

  • Dillenbourg, P. (1999). Collaborative learning: Cognitive and computational approaches. Elsevier.

    Google Scholar 

  • Divaharan, S., & Atputhasamy, L. (2002). An attempt to enhance the quality of cooperative learning through peer assessment. The Journal of Educational Enquiry, 3(2), 72–83.

    Google Scholar 

  • Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research. Orienta-Konsultit Oy.

    Google Scholar 

  • Ha, M., Lee, G. -G., Shin, S., Lee, J. K., Choi, S., Choo, J., ... & Park, J. (2019). Assessment as a learning-support tool and utilization of artificial intelligence: WA3I project case. School Science Journal, 13(3), 271–282.

    Google Scholar 

  • Hakkarainen, K., Paavola, S., Kangas, K., & Seitamma-Hakkarainen, P. S. (2013). Sociocultural perspectives on collaborative learning: Toward collaborative knowledge creation. In C. E. Hmelo-Silver, C. A. Chinn, C. K. K. Chan, & A. O’Donnell (Eds.), The international handbook of collaborative learning (pp. 57–73). Routledge.

    Google Scholar 

  • Harrison, R., Flood, D., & Duce, D. (2013). Usability of mobile applications: Literature review and rationale for a new usability model. Journal of Interaction Science, 1(1), 1–16.

    Article  Google Scholar 

  • Haudek, K. C., Prevost, L. B., Moscarella, R. A., Merrill, J., & Urban-Lurain, M. (2012). What are they thinking? Automated analysis of student writing about acid–base chemistry in introductory biology. CBE-Life Sciences Education, 11(3), 283–293.

    Article  Google Scholar 

  • Hemmer, P., Schemmer, M., Vössing, M., & Kühl, N. (2021). Human-AI complementarity in hybrid intelligence systems: A structured literature review. In Proceedings of Twenty-fifth Pacific Asia Conference on Information Systems (pp. 78–91)

  • Hiltz, S. R. (1998). Collaborative learning in asynchronous learning networks: Building learning communities. In Paper presented at the WebNet 98 world conference of the WWW, Internet, and Intranet (ERIC Document Reproduction Service No. ED 427 705 IR 019 256).

    Google Scholar 

  • Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. The Center for Curriculum Redesign.

    Google Scholar 

  • Hu, X., Ng, J. T., & Chu, S. K. (2022). Implementing learning analytics in wiki-supported collaborative learning in secondary education: A framework-motivated empirical study. International Journal of Computer-Supported Collaborative Learning, 17(3), 427–455.

    Article  Google Scholar 

  • Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100001.

    Google Scholar 

  • Jeong, S.-K., & Park, N.-S. (2022). Analysis of class satisfaction with peer evaluation in collaborative learning-based classes. Journal of Convergence for Information Technology, 12(3), 158–170. [in Korean].

    Google Scholar 

  • Johnson, R. T., & Johnson, D. W. (2002). Learning together and alone: Overview and meta-analysis. Asia Pacific Journal of Education, 22(1), 95–105.

    Article  Google Scholar 

  • Kim, J., Lee, H., & Cho, Y. H. (2022). Learning design to support student-AI collaboration: Perspectives of leading teachers for AI in education. Education and Information Technologies, 27, 6069–6104.

    Article  Google Scholar 

  • Kim, J., Shin, E., Han, K., Park, S., Youn, J. H., Jin, G., & Lee, J. Y. (2021). Efficacy of smart speaker–based metamemory training in older adults: Case-control cohort study. Journal of Medical Internet Research, 23(2), e20177.

    Article  Google Scholar 

  • Kim, W. J. (2022). AI-integrated science teaching through facilitating epistemic discourse in the classroom. Asia-Pacific Science Education, 8, 9–42.

    Article  Google Scholar 

  • Kim, Y., Soyata, T., & Behnagh, R. F. (2018). Towards emotionally aware AI smart classroom: Current issues and directions for engineering and education. IEEE Access, 6, 5308–5331.

    Article  Google Scholar 

  • Kinzie, M. B., Sullivan, H. J., & Berdel, R. L. (1988). Learner control and achievement in science computer-assisted instruction. Journal of Educational Psychology, 80(3), 299–303.

    Article  Google Scholar 

  • Krange, I., & Ludvigsen, S. (2008). What does it mean? Students’ procedural and conceptual problem solving in a CSCL environment designed within the field of science education. International Journal of Computer-Supported Collaborative Learning, 3(1), 25–51.

    Article  Google Scholar 

  • Kuhail, M. A., Alturki, N., Alramlawi, S., & Alhejori, K. (2023). Interacting with educational chatbots: A systematic review. Education and Information Technologies, 28(1), 973–1018.

    Article  Google Scholar 

  • Kyndt, E., Raes, E., Lismont, B., Timmers, F., Cascallar, E., & Dochy, F. (2013). Ameta-analysis of the effects of face-to-face cooperative learning. Do recent studies falsify or verify earlier findings? Educational Research Review, 10, 133–149.

    Article  Google Scholar 

  • Lai, V., Chen, C., Liao, Q. V., Smith-Renner, A., & Tan, C. (2021). Towards a science of human-AI decision making: A survey of empirical studies. arXiv preprint arXiv:2112.11471.

  • Latour, B. (2007). Reassembling the social: An introduction to actor-network-theory. Oup Oxford.

    Google Scholar 

  • Lee, J., Lee, G. -G., & Hong, H. G. (2023a). Automated assessment of student hand drawings in free-response items on the particulate nature of matter. Journal of Science Education and Technology, 32(4), 549–566.

    Article  Google Scholar 

  • Lee, G. -G., Choi, M., An, T., Mun, S., & Hong, H. G. (2023b). Development of the hands-free AI speaker system supporting hands-on science laboratory class: A rapid prototyping. International Journal of Emerging Technologies in Learning, 18(1), 115–136.

    Article  Google Scholar 

  • Lee, G. -G., & Ha, M. (2020). The present and future of AI-based automated evaluation: A literature review on descriptive assessment and other side. Journal of Educational Technology, 36(2), 353–382.

    Article  Google Scholar 

  • Lee, G. -G., Jeon, Y. E., & Hong, H. G. (2021). The effects of cooperative flipped learning on science achievement and motivation in high school students. International Journal of Science Education, 43(9), 1381–1407.

    Article  Google Scholar 

  • Li, T., Reigh, E., He, P., & Adah Miller, E. (2023). Can we and should we use artificial intelligence for formative assessment in science? Journal of Research in Science Teaching, 1–5. https://doi.org/10.1002/tea.21867

  • Lovato, S. B. (2019). Hey Google, do unicorns exist?: Children finding answers through conversational agents. Doctoral dissertation, Northwestern University.

    Book  Google Scholar 

  • Luckin, R., Holmes, W., Griffiths, M., & Forcier, L. B. (2016). Intelligence unleashed: An argument for AI in education. Pearson.

    Google Scholar 

  • Mills, B. J., & Cottell, P. G., Jr. (1998). Cooperative learning for higher education faculty. Oryx Press.

    Google Scholar 

  • National Academies of Sciences, Engineering, and Medicine [NASEM]. (2022). Human-AI teaming: State-of-the-art and research needs. Washington, DC: The National Academies Press. https://doi.org/10.17226/26355

    Book  Google Scholar 

  • Nehm, R. H., & Ha, M. (2011). Item feature effects in evolution assessment. Journal of Research in Science Teaching, 48(3), 237–256.

    Article  Google Scholar 

  • Norvig, P., & Russell, S. (2021). Artificial intelligence: A modern approach (Global 4th edition). Pearson.

    Google Scholar 

  • O’Donnell, A. M., & Hmelo-Silver, C. E. (2013). Introduction: What is collaborative learning? An overview. In C. E. Hmelo-Silver, C. A. Chinn, C. K. K. Chan, & A. O’Donnell (Eds.), The International Handbook of Collaborative Learning (pp. 1–40). Routledge.

    Google Scholar 

  • Okolo, C. M., Bahr, C. M., & Rieth, H. J. (1993). A retrospective view of computer-based instruction. Journal of Special Education Technology, 12(1), 1–27.

    Article  Google Scholar 

  • Organisation for Economic Co-operation and Development [OECD]. (2019). OECD future of education and skills 2030: OECD learning compass 2030 – A series of concept notes. OECD.

    Google Scholar 

  • Park, J., Lee, J.-K., Shin, S., & Ha, M. (2021). Analysis of high school students’ pereception on instructional feedback from humans and non-human subject: Focused on feedback from teachers, peers, and artificial intelligence. Journal of Learner-Centered Curriculum and Instruction, 21(5), 733–745.

    Google Scholar 

  • Renzella, J., Cain, A., & Schneider, J. G. (2022). Verifying student identity in oral assessments with deep speaker. Computers and Education: Artificial Intelligence, 3, 100044.

    Google Scholar 

  • Richey, R. C., & Klein, J. D. (2007). Design and development research: Methods, strategies, and issues. Routledge.

    Google Scholar 

  • Richey, R. C., Klein, J., & Nelson, W. (2004). Developmental research: Studies of instructional design and development. In D. Jonassen (Ed.), Handbook of research for educational communications and technology (2nd ed., pp. 1099–1130). Lawrence Erlbaum Associates Inc.

    Google Scholar 

  • Roth, W. M., & McGinn, M. K. (1997). Science in schools and everywhere else: What science educators should know about science and technology studies. Studies in Science Education, 29(1), 1–43.

    Article  Google Scholar 

  • Schaeffer, R. S., & Cates, W. M. (1996). Cooperative software for the Internet. In M. R. Simonson, M. Hays, & S. Hall (Eds.), Proceedings of selected research and development presentations at the 1996 National Convention of the Association for Educational Communications and Technology (pp. 674–682). Ames: Iowa State University.

  • Şerban, C., & Todericiu, I. A. (2020). Alexa, What classes do I have today? The use of Artificial Intelligence via Smart Speakers in Education. Procedia Computer Science, 176, 2849–2857.

    Article  Google Scholar 

  • Shaikh, A. (2020). An interactive design using human computer interaction for autonomous vehicles. International Journal of Engineering Trends and Technology, 10(1), 160–172.

    Article  Google Scholar 

  • Shin, D., & Shim, J. (2021). A systematic review on data mining for mathematics and science education. International Journal of Science and Mathematics Education, 19, 639–659.

    Article  Google Scholar 

  • Slavin, R. E. (1978). Student teams and comparison among equals: Effects on academic performance and student attitudes. Journal of Educational Psychology, 70(4), 532–538.

    Article  Google Scholar 

  • Srinivasan, V. (2022). AI & learning: A preferred future. Computers and Education: Artificial Intelligence, 3, 100062.

    Google Scholar 

  • Stahl, G. (2015). A decade of CSCL. International Journal of Computer-Supported Collaborative Learning, 10(4), 337–344.

    Article  Google Scholar 

  • Tan, S.-C. (2019). Learning with computers: Generating insights into the development of cognitive tools using cultural historical activity theory. Australasian Journal of Educational Technology, 35(2), 25–38.

    Article  Google Scholar 

  • Terzopoulos, G., & Satratzemi, M. (2020). Voice assistants and smart speakers in everyday life and in education. Informatics in Education, 19(3), 473–490.

    Article  Google Scholar 

  • Vygotsky, L. S. (1978). Mind in society: Development of higher psychological processes (14th ed.). Harvard University Press.

    Google Scholar 

  • Weidman, R., & Bishop, M. J. (2009). Using the jigsaw model to facilitate cooperative learning in an online course. Quarterly Review of Distance Education, 10(1), 51–64.

    Google Scholar 

  • Xiao, T., Tabashum, T., Metwally, B., Albert, M., Du, A., Jebamalaidass, R., ... & Oliviera, E. (2020, February). Conversation moderator: A mobile app for tracking individual speaking in group conversations. In 2020 IEEE 14th International Conference on Semantic Computing (pp. 430–433). IEEE.

  • Zhai, X. (2023). ChatGPT for next generation science learning. XRDS: Crossroads, The ACM Magazine for Students, 29(3), 42–46.

    Article  Google Scholar 

  • Zhai, X., & Nehm, R. H. (2023). AI and formative assessment: The train has left the station. Journal of Research in Science Teaching, 60(6), 1390–1398.

    Article  Google Scholar 

  • Zhu, M., Lee, H. S., Wang, T., Liu, O. L., Belur, V., & Pallant, A. (2017). Investigating the impact of automated feedback on students’ scientific argumentation. International Journal of Science Education, 39(12), 1648–1668.

    Article  Google Scholar 

  • Zhu, M., Liu, O. L., & Lee, H. S. (2020). The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing. Computers & Education, 143, 103668.

    Article  Google Scholar 

Download references

Funding

This research is supported by Seoul National University Department of AI-Integrated Education.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Gyeong-Geon Lee or Seonyeong Mun.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1. Course syllabus

figure a

Appendix 2. English version of handout with learning content and problem set (Fig. 5)

(a): A handout page on Driver’s alternative conceptual framework [(Bold): The content students have to fill in].

figure b

(b): Peer evaluation rubric and problem set.

figure c

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lee, GG., Mun, S., Shin, MK. et al. Collaborative Learning with Artificial Intelligence Speakers. Sci & Educ (2024). https://doi.org/10.1007/s11191-024-00526-y

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11191-024-00526-y

Navigation