Massive Open Online Courses (MOOCs) introduce a way of transcending formal education by realizing technology-enhanced formats of learning and instruction and by granting access to an audience way beyond higher education. However, although MOOCs have been reported as an efficient and important educational tool, there is a number of issues and problems related to their educational impact. More specifically, there is an important number of dropouts during a course, little participation, and lack of students’ motivation and engagement overall. This paper updates the progress of the European project called “colMOOC” that aims to enhance the MOOCs experience by integrating collaborative settings based on conversational pedagogical agents to support both students and teachers during a MOOC course. Conversational pedagogical agents guide and support student dialogue using natural language both in individual and collaborative settings. Integrating this type of conversational agents into MOOCs to trigger peer interaction in discussion groups can considerably increase the engagement and the commitment of online students and, consequently, reduce MOOCs dropout rate. The paper reports on the first evaluation experience of incorporating synchronous collaborative activities mediated by conversational pedagogical agents into a real MOOC with a massive international participation. Evaluation results are statistically described in terms of participation, performance and satisfaction. The research reported in this paper is currently undertaken within the project colMOOC funded by the European Commission.
This is a preview of subscription content, access via your institution.
Tax calculation will be finalised at checkout
Purchases are for personal use onlyLearn about institutional subscriptions
Miríadax is the world's leading non-English speaking MOOC platform. It currently has more than 6.3 million registered students, more than 800 courses from 113 universities and institutions and more than 3000 instructors in its teaching community. https://miriadax.net/.
The MOOC is found following this URL: https://miriadax.net/web/tecnologia-educativa-para-apoyar-la-colaboracion-y-evaluacion-en-entornos-de-aprendizaje-virtual_.
Siemens, G.: Massive open online courses: innovation in education. Open educational resources: innovation, research and practice (2013)
Daradoumis, T., Bassi, R., Xhafa, F., Caballé, S.: A review on massive e-learning (MOOC) design, delivery and assessment. In: Proceedings of the Eighth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, pp. 208–213. IEEE Computer Society (2013)
Demetriadis, S., Karakostas, A., Tsiatsos, T., Caballé, S., Dimitriadis, Y., Weinberger, A., Papadopoulos, P.M., Palaigeorgiou, G., Tsimpanis, C., Hodges, M.: Towards integrating conversational agents and learning analytics in MOOCs. In: Proceedings of the 6th International Conference on Emerging Intelligent Data and Web Technologies. Lecture Notes on Data Engineering and Communications Technologies, vol. 17, PP. 1061–1072 (2018)
Demetriadis, S., Tegos, S., Psathas, G., Tsiatsos, T., Weinberger, A., Caballé, S., Dimitriadis, Y., Sánchez, G.E., Papadopoulos, M., Karakostas, A.: Conversational agents as group-teacher interaction mediators in MOOCs. In: Proceedings of 2018 Learning With MOOCS (LWMOOCS), pp. 43–46. IEEE Education Society (2018)
Tegos, S., Demetriadis, S., Karakostas, A.: Promoting academically productive talk with conversational agent interventions in collaborative learning settings. Comput. Educ. 87, 309–325 (2015)
Bassi, R., Daradoumis, T., Xhafa, F., Caballé, S., Sula, A.: Software agents in large scale open e-learning: a critical component for the future of massive online courses (MOOCs). In: Proceedings of the Sixth IEEE International Conference on Intelligent Networking and Collaborative Systems, pp. 184–188. IEEE Computer Society (2014)
Barak, M., Watted, A., Haick, H.: Motivation to learn in massive open online courses: examining aspects of language and social engagement. Comput. Educ. 94, 49–60 (2016)
Schuwer, R., Jaurena, I.G., Aydin, C.H., Costello, E., Dalsgaard, C., Brown, M., Teixeira, A.: Opportunities and threats of the MOOC movement for higher education: the European perspective. Int. Rev. Res. Open Distrib. Learn. 16(6), 20–38 (2015)
Kumar, R., Rose, C.P.: Architecture for building conversational agents that support collaborative learning. IEEE Trans. Learn. Technol. 4(1), 21–34 (2011)
Tegos, S., Demetriadis, S., Tsiatsos, T.: A configurable conversational agent to trigger students’ productive dialogue: a pilot study in the CALL domain. Int. J. Artif. Intell. Educ. 24(1), 62–91 (2013). https://doi.org/10.1007/s40593-013-0007-3
Tegos, S., Demetriadis, S.: Conversational agents improve peer learning through building on prior knowledge. Educ. Technol. Soc. 20(1), 99–111 (2017)
Michaels, S., O’Connor, M.C., Hall, M.W., Resnick, L.B.: Accountable talk sourcebook: for classroom that works (v.3.1). University of Pittsburgh Institute for Learning. Retrieved March 1, 2017, from. https://www.ortingschools.org/cms/lib/WA01919463/Centricity/domain/326/purpose/research/accountable%20sourcebook.pdf (2010)
Noroozi, O., Weinberger, A., Biemans, H.J.A., Mulder, M., Chizari, M.: Facilitating argumentative knowledge construction through a transactive discussion script in CSCL. Comput. Educ. 61(2), 59–76 (2013)
Caballé, S.: A computer science methodology for online education research. Int. J. Eng. Educ. 35(2), 548–562 (2019)
Tegos, S., Demetriadis, S., Psathas, G., Tsiatsos, T.: A configurable agent to advance peers’ productive dialogue in MOOCs. In: Proceedings of CONVERSATIONS 2019. Lecture Notes in Computer Science, 11970, pp. 245–259 (2019)
Reich, J., Ruipérez-Valiente, J.A.: The MOOC pivot. Science 363(6423), 130–131 (2019)
This research was funded by the European Commission through the project “colMOOC: Integrating Conversational Agents and Learning Analytics in MOOCs” (588438-EPP-1-2017-1-EL-EPPKA2-KA).
Editors and Affiliations
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Caballé, S., Conesa, J., Gañán, D. (2021). Evaluation on Using Conversational Pedagogical Agents to Support Collaborative Learning in MOOCs. In: Barolli, L., Takizawa, M., Yoshihisa, T., Amato, F., Ikeda, M. (eds) Advances on P2P, Parallel, Grid, Cloud and Internet Computing. 3PGCIC 2020. Lecture Notes in Networks and Systems, vol 158. Springer, Cham. https://doi.org/10.1007/978-3-030-61105-7_20
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61104-0
Online ISBN: 978-3-030-61105-7