Abstract
Intelligent Tutoring Systems (ITS) possess significant potential to enhance learning outcomes. However, deploying ITSs in global south countries presents challenges due to their frequent lack of essential technological resources, such as computers and internet access. The concept of AIED Unplugged has emerged to bridge this digital divide, supporting the creation of theoretical frameworks for developing ITS unplugged. Nevertheless, prior research has not evaluated ITS unplugged with teachers, diminishing the importance of aligning technological solutions with their target users’ practical requirements and viewpoints. This article addresses this gap by presenting the design and evaluation of an ITS unplugged for numeracy education. Through face-to-face usability tests and interviews with Brazilian primary education teachers, the study employs thematic analysis to understand teachers’ perceptions profoundly. Results reveal that teachers value ITS unplugged for optimizing lesson planning, offering real-time error-specific feedback, providing learning analytics, and enabling personalized group learning within classrooms. Additionally, concerns about application size and internet dependency underscore important considerations for underserved regions. Such empirical evidence on teachers’ perceptions bridges the gap between theoretical frameworks and real-world user perspectives, demonstrating that ITS unplugged can address educational disparities, provided it aligns with teachers’ needs, technological limitations, and contextual factors. As educational technology evolves, comprehending the viewpoints of primary users becomes pivotal for equitable implementation. Therefore, this article represents a significant stride toward deploying AIED in the global south and other underserved regions. By combining theoretical concepts with practical user insights, ITS unplugged can be a transformative solution for education.
Similar content being viewed by others
Availability of data and materials
Data can be me available upon reasonable request to the corresponding author.
Notes
This is one example of specific information that was purposefully defined to facilitate interacting with the prototype.
References
Blandford, A., Furniss, D., & Makri, S. (2016). Qualitative HCI research: Going behind the scenes. Synthesis lectures on human-centered informatics 911–115,
Braun, V., & Clarke, V. (2012). Thematic analysis. Thematic analysis: American Psychological Association.
Cohn, M. (2004). User stories applied: For agile software development. Addison-Wesley Professional.
Davis, S.R., DeCapito, C., Nelson, E., Sharma, K., & Hand, E.M. (2020). Homework helper: Providing valuable feedback on math mistakes. Advances in Visual Computing: 15th International Symposium, ISVC 2020, San Diego, CA, USA, October 5–7, 2020, Proceedings, Part II 15 (pp. 533–544).
Dermeval, D., Albuquerque, J., Bittencourt, I.I., Vassileva, J., Lemos, W., da Silva, A.P., & Paiva, R. (2018). Amplifying teachers intelligence in the design of gamified intelligent tutoring systems. Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II 19 (pp. 68–73).
dos Reis Braga, N. C., & de Morais, M. B. (2020). Desafios da Prática Docente no Ensino de Matemática nos Anos Iniciais: um estudo a partir de três narrativas,
Fang, Y., Ren, Z., Hu, X., & Graesser, A. C. (2019). A meta-analysis of the effectiveness of ALEKS on learning. Educational Psychology, 39(10), 1278–1292.
Freitas, E., Batista, H. H., Barbosa, G. A., Wenceslau, M., Portela, C., & Isotani, S., et al. (2022). Learning Analytics Desconectada: Um Estudo de Caso em Análise de Produçoes Textuais. Anais do I Workshop de Aplicações Práticas de Learning Analytics em Instituições de Ensino no Brasil, 40–49.
Gaftandzhieva, S., Docheva, M., & Doneva, R. (2020). A comprehensive approach to learning analytics in Bulgarian school education. Education and Information Technologies,https://doi.org/10.1007/s10639-020-10261-w
Ganimian, A.J., & Djaker, S. (2022). How can developing countries address heterogeneity in students’ preparation for school? A review of the challenge and potential solutions. Unpublished manuscript. Steinhardt School of Culture, Education, and Human Development, New York University. New York, NY,
Gasevic, D., Paul, P., Chen, B., Fan, Y., Rodrigo, M.M., Cobo, C., & Cecilia, A. (2018). Learning Analytics for the Global South Learning analytics for the global south. In C.P. Lim, & V.L. Tinio (eds.), Philippines Foundation for Information Technology Education and Development, Quezon City
Giacomini, A. & Lüdke, E. (2018). A Desvalorização Profissional do Professor: Um Problema Crônico Apontado No Programa Pacto na Região Central Do Rio Grande Do Sul. Vivências.
Hillmayr, D., Ziernwald, L., Reinhold, F., Hofer, S. I., & Reiss, K. M. (2020). The potential of digital tools to enhance mathematics and science learning in secondary schools: A context-specific meta-analysis. Computers & Education, 153, 103897.
Ijtihadie, R.M., Chisaki, Y., Usagawa, T., Cahyo, H.B., & Affandi, A. (2010). Offline web application and quiz synchronization for e-learning activity for mobile browser. TENCON 2010-2010 IEEE Region 10 Conference 2402–2405.
Isotani, S., Bittencourt, I.I., Challco, G.C., Dermeval, D., & Mello, R.F. (2023). AIED Unplugged: Leapfrogging the Digital Divide to Reach the Underserved. In N. Wang, G. Rebolledo-Mendez, V. Dimitrova, N. Matsuda & O.C. Santos (eds.), Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky (pp. 772–779). Cham Springer Nature Switzerland.
Jagadish, R., Aradhana, D. (2021). A Secured Framework for Offline File Synchronization using ANN and Storage Optimization Schemes. In 2021 IEEE International Conference on Mobile Networks and Wireless Communications (ICMNWC) (pp. 1–6).
Jaiswal, A., Sonawane, R., Oswal, S., Shejy, G. (2015). Offline and Online Bank Data Synchronization System. International Journal of Computational Engineering Research [IJCER] 5 1316,
Jivet, I., Scheffel, M., Specht, M., Drachsler, H. (2018). License to evaluate: Preparing learning analytics dashboards for educational practice. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge (pp. 31–40).
Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research methods in human-computer interaction Research methods in human-computer interaction. Morgan Kaufmann.
Lewis, J. R. (2012). Usability testing Usability testing. Handbook of Human Factors and Ergonomics, 1267–1312.
Lim, C. P., Ra, S., Chin, B., & Wang, T. (2020). Information and communication technologies (ICT) for access to quality education in the global south: A case study of Sri Lanka. Education and Information Technologies, 25(4), 2447–2462.
Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901.
Matias, T. P., Imperador, A. M., Botezelli, L., Riondet-Costa, D. R. T., de Oliveira Costa, V. A., & de Alcântara Moreira, L. (2022). Vulnerable populations in South America and facing the pandemic: what can our experiences reveal to the world? Research, Society and Development, 11(4), e59511427924.
Miles, D.A. (2017). A taxonomy of research gaps: Identifying and defining the seven research gaps. Doctoral student workshop: finding research gaps-research methods and strategies, Dallas, Texas (pp. 1–15).
Modén, M.U., Tallvid, M., Lundin, J., Lindström, B. (2021). Intelligent Tutoring Systems: Why Teachers Abandoned a Technology Aimed at Automating Teaching Processes. Hawaii International Conference on System Sciences. https://api.semanticscholar.org/CorpusID:232413039
Moreira, V., Jesus, C.F., Pinheiro, V. (2013). A valorização do professor: o desafio do reconhecimento. Enciclopédia biosfera916,
Mousavinasab E, Zarifsanaiey N, R. Niakan Kalhori S, Rakhshan M, Keikha L, Ghazi Saeedi M(2021). Intelligent tutoring systems: a systematic review of characteristics, applications, and evaluation methods. Interactive Learning Environments, 29(1), 142–163.
Mussi, Ad. A. (2017). Profissionalidade Docente: um Olhar sobre a Formação e Condição de Trabalho do Professor da Escola Pública Baiana. Colóquio do Museu Pedagógico-ISSN 2175-5493, 12(1), 104–110.
Nkambou, R., Mizoguchi, R., Bourdeau, J. (2010). Advances in intelligent tutoring systems308. Springer Science & Business Media.
Nye, B. D. (2015). Intelligent tutoring systems by and for the developing world: A review of trends and approaches for educational technology in a global context. International Journal of Artificial Intelligence in Education, 25, 177–203.
Oyelere, S.S. et al. (2022). Artificial Intelligence in African Schools: Towards a Contextualized Approach. In 2022 IEEE Global Engineering Education Conference (EDUCON) (pp. 1577-1582).
Patel, N., Thakkar, M., Rabadiya, B., Patel, D., Malvi, S., Sharma, A., Lomas, D. (2022). Equitable access to intelligent tutoring systems through paper-digital integration. In Proceedings Intelligent Tutoring Systems: 18th International Conference, ITS 2022, Bucharest, Romania, June 29–July 1, 2022, (pp. 255–263).
Portela, C., Lisbôa, R., Yasojima, K., Cordeiro, T., Silva, A., Dermeval, D. et al. (2023).A Case Study on AIED Unplugged Applied to Public Policy for Learning Recovery Post-pandemic in Brazil. International Conference on Artificial Intelligence in Education (pp. 788–796).
Rambe, P., & Moeti, M. (2017). Disrupting and democratising higher education provision or entrenching academic elitism: towards a model of MOOCs adoption at African universities. Educational Technology Research and Development, 65(3), 631–651.
Rodríguez, M.R.B., Cobo, C. (2022). COVID-19 and education in the global South: Emergency remote learning solutions with long-term implications. https://www.oecd-ilibrary.org/content/component/897cd0d8-en
Santos, L. A. M., & Vidal, V. M. (2017). O estresse do professor: estudo acerca da corporeidade em profissionais da educação básica. InterEspaço: Revista De Geografia E Inter disciplinaridade.
Sharma, A., Jayagopi, D.B. (2018). Automated grading of handwritten essays. In 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR) (pp. 279–284).
Soares, J.R., Araújo, D.S.d., Pinto, R.D.d.C. (2020). Aprendizagem escolar: desafios do professor na atividade docente Aprendizagem escolar: desafios do professor na atividade docente. Psicologia da Educação 5172–84,
Soofi, A.A., Ahmed, M.U. (2019). A systematic review of domains, techniques, delivery modes and validation methods for intelligent tutoring systems. International Journal of Advanced Computer Science and Applications103
Steenbergen-Hu, S., & Cooper, H. (2013). A meta-analysis of the effectiveness of intelligent tutoring systems on K-12 students’ mathematical learning. Journal of Educational Psychology, 105(4), 970.
Thompson, G. (2020). Two thirds of the world’s school-age children have no internet access at home, new UNICEF-ITU report says. https://www.unicef.org/press-releases/two-thirds-worlds-school-age-children-have-no-internet-/access-home-new-unicef-itu. UNICEF.
VanLehn, K. (2006). The behavior of tutoring systems. International Journal of Artificial Intelligence in Education, 16(3), 227–265.
Varanasi, M.R., Fischetti, J.C., Smith, M.W. (2018). Analytics Framework for K-12 School Systems. Data Leadership for K-12 Schools in a Time of Accountability 206–233. IGI Global.
Veloso, T.E., Chalco Challco, G., Rogrigues, L., Versuti, F.M., Sena da Penha, R., Silva Oliveira, L., Isotani, S. (2023). ITS Unplugged: Leapfrogging the Digital Divide for Teaching Numeracy Skills in Underserved Populations. In Towards the Future of AI-augmented Human Tutoring in Math Learning 2023 - Proceedings of the Workshop on International Conference of Artificial Intelligence in Education co-located with The 24th International Conference on Artificial Intelligence in Education (AIED 2023).
Vinuesa, R., Azizpour, H., Leite, I., Balaam, M., Dignum, V., Domisch, S., & Fuso Nerini, F. (2020). The role of artificial intelligence in achieving the Sustainable Development Goals. Nature communications, 11(1), 233.
Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A. (2012). Experimentation in software engineering. Springer Science & Business Media.
Xia, Q., Chiu, T.K., Zhou, X., Chai, C.S., Cheng, M. (2022). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Computers and Education: Artificial Intelligence 100118,
Xu, Z., Wijekumar, K., Ramirez, G., Hu, X., & Irey, R. (2019). The effectiveness of intelligent tutoring systems on K-12 students’ reading comprehension: A meta-analysis. British Journal of Educational Technology, 50(6), 3119–3137.
Zanibbi, R., & Blostein, D. (2012). Recognition and retrieval of mathematical expressions. International Journal on Document Analysis and Recognition (IJDAR), 15(4), 331–357.
Acknowledgements
We wish to express our gratitude to everyone involved in this national project, including researchers, policymakers, and teachers. This work was supported by the Brazilian Ministry of Education (MEC) - TED 11476.
Funding
This research was funded by the Brazilian Ministry of Education (MEC), TED 11476.
Author information
Authors and Affiliations
Contributions
All authors contributed equally to this research.
Corresponding author
Ethics declarations
Conflicts of interest
Nothing to declare.
Ethical approval
The study protocol followed ethical best practices, was reviewed and revised by a panel of experts, and approved by the school board and the city’s secretary of education.
Consent to participate
All participants provided written consent to participate in this research.
Consent for publication
All participants provided written consent to have their anonimized data presented in this research.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Rodrigues, L., Guerino, G., Silva, T.E.V. et al. MathAIde: A Qualitative Study of Teachers’ Perceptions of an ITS Unplugged for Underserved Regions. Int J Artif Intell Educ (2024). https://doi.org/10.1007/s40593-024-00397-y
Accepted:
Published:
DOI: https://doi.org/10.1007/s40593-024-00397-y