Technology is increasingly applied in education to enhance educators’ teaching and students’ learning experiences. Its application has been accelerated as a result of the COVID-19 (coronavirus) pandemic. The pandemic caused many schools to close; teachers used digital technology to teach and connect with their students, while policymakers increasingly observed that unequal digital opportunities excluded some young people from education and social networks (Williamson et al., 2020). The pandemic also provides opportunities for online learning experiments (Zimmerman, 2020), and initiates global educational technology changes: platformization, datafication, privatization, and commercialization (Kerssens & van Dijck, 2021; Selwyn, 2020; UNESCO, 2020; Williamson & Hogan, 2020). Currently, there are several famous online teaching platforms, such as ALEKS, Knewton, Smart Sparrow, and Whatfix, among others (Das, 2018); each of them has distinct features and effects on teaching methods. Meanwhile, education is influenced by datafication, which not only shapes teaching and learning but also increases transparency, accountability, and participation, while posing challenges related to privacy, control, and inequality (Jarke & Breiter, 2019; Williamson et al., 2020). Therefore, if the government can provide free learning platforms, this might offer more easy access and reduce inequality concerns. In 2018, the Ministry of Education of Taiwan (MET) supported the establishment of an online teaching platform called the Taiwan adaptive learning platform (TALP). MET also launched “the technology assisted self-regulated learning (SRL) project” (TASRLP) in 2020 to integrate digital technology, especially TALP, to support SRL in middle and elementary schools. MET provides funding to provision digital devices, such as laptops and tablet computers. The Taiwan government has also improved the digital environment in recent years so that schools can access the Internet easily. There were over 300 schools participating in TASRLP in 2020; it encourages in-class group cooperative learning by incorporating the use of digital technology to eventually achieve SRL. Even with low technological infrastructure and teachers who are willing but underprepared, a blended learning environment can positively change students’ classroom learning engagements and encourage teachers (Kundu et al., 2021). TALP brings together teachers with expertise in different fields (subjects) to systematically develop course materials on the platform according to the national curriculum’s standard syllabus. It uses artificial intelligence (AI) to make the whole system more interactive and support learning activities. An important aspect for consideration by TALP is AI-supported Education (AIED), which mainly focuses on knowledge representation, reasoning, and learning (Barnes et al., 2017; Self, 2016). Meanwhile, “the implementation of innovative learning tools” and “the approaches to apply these tools in real educational practices” are two challenges for AIED in computer science (Barnes et al., 2017). This case study tries to respond to these two challenges.

A characteristic of TALP is the knowledge structure it applies to individual fields, which are designed and constructed on the platform in a systematic manner according to the syllabus. TALP provides free knowledge texts, videos, quizzes, and interactive learning, making it easier for teachers to prepare lessons and for learners to learn independently. Simultaneously, a diagnosis system and knowledge star map for each unit, cross-unit, and cross-grade are provided, helping teachers and students understand their learning paths. Such an individual diagnosis system provides immediate feedback, helps teachers to grasp students’ learning status, and helps students to reflect on their learning situation. TALP tends to offer an adaptive learning platform for students. This can support precision education (PE) because it can identify at-risk students in the early learning stage and provide information for teachers to offer interventions to assist learning. PE can provide early intervention to improve learning engagement and strategy (Yang, 2019). If teachers can promptly identify students who are at-risk learners, they may assist students to overcome learning challenges in their later learning process. Therefore, PE shows great potential to benefit both teachers and students. PE can intervene in students’ learning at an early stage, before they are left behind in learning or encounter challenges which may lead them to give up on learning. However, there are limited studies on PE. This case study can help fill this gap. It illustrates the ways in which PE works in the real world and how it can be improved. Moreover, critical perspectives on AI and PE in education are also included.

Meanwhile, science, technology, engineering and mathematics (STEM) education is important but faces various challenges. This study can also help address some of these issues. Teachers believe that STEM education can positively impact students’ learning process and outcomes (Margot & Kettler, 2019; Park et al., 2016), and teachers have responded that they feel rewarded when they utilize STEM education to effect student and community changes (Goodpaster, et al. 2012; Hsu et al., 2011; Margot & Kettler, 2019; Wang et al., 2011). STEM education can influence national competition capacity because STEM human resources can affect economic development. However, STEM education is being challenged, as students may learn insufficiently or leave due to difficulties in the learning process. This is because STEM pedagogy needs a fundamental transformation from teacher-led to student-centered instruction (Lesseig et al., 2016; Margot & Kettler, 2019; Park et al., 2017). To enable a transformation of this nature would involve changing pedagogy and curriculum design. Thus, teachers need to learn how to become facilitators of knowledge and how to support students learning STEM, taking academic risks such as the transformation to student-centered and student-led instruction (Margot & Kettler, 2019). Teachers can learn and practice this through professional development before implementing it in classrooms (Margot & Kettler, 2019).

Further, teachers self-report that they do not have enough instructional resources, which is an obstacle in offering students STEM learning opportunities (Margot & Kettler, 2019; Park et al., 2017), including PE. This is especially urgent when a teacher has to manage a class of 20 or more students with diverse social and economic backgrounds. Teachers are worried about how to meet the diverse needs of different learners in STEM pedagogy, especially for students with disabilities and various cognitive abilities (Herro & Quigley, 2017; Margot & Kettler, 2019; Park et al., 2017). This leads to another challenge: how to effectively identify each student’s learning difficulties and outcomes? Previous studies show that over 40% of teachers responded that they lacked assessments for STEM programs (Margot & Kettler, 2019; Nadelson & Seifert, 2013) and did not have enough formative assessments (insufficient standardized classroom assessments) to identify aspects of student learning (Asghar et al., 2012; Dare et al., 2014; Margot & Kettler, 2019). PE may provide teachers with the information needed to assess STEM education. Therefore, this case study may also contribute to STEM education. A literature review on digital game-based learning suggested the need for further research on how different learning dynamics influence students’ mathematical achievements (Hussein et al., 2021). A well designed educational-based digital games can foster students’ creativity and focus on learning (Behnamnia, Kamsin, Ismail, & Hayati, 2020).

This study focuses on how TALP can support PE and enhance students’ learning outcomes. The main standpoint was from teachers’ perspectives on TALP and PE influences on students’ academic development. Based on the challenges of STEM education and the adoption of TALP in some schools in Taiwan, this case study attempts to answer the following research questions:

  1. (1)

    How does TALP assist teachers to conduct PE?

  2. (2)

    How does TALP influence students’ learning outcomes in math?

  3. (3)

    Base on this case study, what can be improved to support PE?

1 Background: Taiwan Adaptive Learning Platform and Case Setting

1.1 TALP Content

TALP is a practical platform for PE that identifies, predicts, diagnoses, and assists learning (treatment). TALP’s curriculum of Chinese, English, math, and science has been constructed for elementary to middle school students. TALP uses Information and communication technology (ICT) and AI to assist teaching and learning to conduct an adaptive learning platform that provides personalized learning for each student. TALP can identify students’ learning deficits, create assessments, and offer various learning resources; its ultimate aim is to support students’ self-regulated learning to fulfill their goal of becoming life-long learners. Figure 1 shows the main elements of TALP.

Fig. 1
figure 1

TALP’s main components (2019 version). Resource: https://school.cy.edu.tw/uploads/1582258824792Xj5JNdEY.pdf

A characteristic of TALP is its knowledge structure for individual fields, which are designed and constructed on the platform in a systematic manner according to the official Taiwanese syllabus. TALP provides free knowledge texts, videos, quizzes, and interactive learning, making it easier for teachers to prepare lessons or for learners to learn independently. AIED is mainly focused on knowledge representation, reasoning, and learning (Barnes et al., 2017; Self, 2016), and TALP can use AI to support knowledge learning.

TALP includes six main sections. First, the learning 2.0 section provides resources for teachers to design their curriculum and by which students can conduct online learning and tests. The knowledge structure section provides a learning curriculum structure map that systematically shows the logical learning path of certain subjects. The knowledge structure is set by subject experts (both professors and experienced teachers) and offers the respective learning paths. Teachers and students can learn step by step according to the knowledge structure and learning paths. An intelligent diagnosis can analyze if the students learn in each node on their learning path (representing each small learning content). The intelligent diagnosis section can inform the teachers and students about the aspects that students did not understand and trace their past learning conditions. The TALP can provide information to help students fill their learning gap based on the intelligent diagnosis. This is one of the functions that may be used to conduct PE. The interactive learning section provides digital personal tutors that interact with students to help them learn. The subject literacy and computational thinking section provides additional learning resources to help students acquire knowledge and digital capacities, such as coding skills or computational thinking. The twenty-first-century core competencies section includes collaborative problem-solving and global competence emphasized by the Program for International Student Assessment (PISA). It offers some curricula for teachers to use in their classes.

TALP can also analyze individual students’ learning paths. For example, if two students have problems learning the same topic, the reasons for this may vary. Figure 2 shows that both student A and student B got knowledge node “5-n-12″ wrong. However, after conducting the TALP analysis, student A can trace how she/he did not understand “2-n-06″ or had misconceptions. Therefore, the teacher needs to either instruct student A on how to fill the learning gap or use TALP to provide learning materials for remediation. Meanwhile, student B also made a mistake on “5-n-12.” The analysis reveals that “5-n-02,” “5-n-03,” and “5-n-01″ are problems that student B needs to learn again to solve their initial misconceptions. Therefore, the teacher or TALP can offer different kinds of teaching topics and learning materials to student B compared to student A.

Fig. 2
figure 2

Example of identifying personal learning paths; Resource: https://srl.ntue.edu.tw/download/研習資源/數位學習工作坊(一)_1100929.pdf

1.2 Classroom Teachers and Contextual Elements

This school participates in TASRLP and is located in mid-Taiwan in an urban area. Three elementary fifth-grade classes were chosen for this study. Class B used TAPL in the first semester, while classes A and C started to use it in the second semester, with implementation in class C two months earlier than class A. According to teachers, most students in class C had lower academic performance and more family problems compared to students in the other two classes.

Two experienced schoolteachers, Max and Alan (pseudonyms), participated in this research. Classroom teachers have a core role in making curriculum decisions and affecting students’ learning (Box et al., 2015). Teachers can orchestrate learning opportunities based on their choice of classroom-based interventions (Fishman & Davis, 2006). Evidence confirms that teachers affect students’ learning more than class size or socioeconomic background (Wiliam & Leahy, 2006). Max and Alan used TALP (as well as some other online or digital resources) so that students could watch clips, practice tests, and analyze learning situations, in addition to regular lectures. They used TALP mainly to conduct PE and understand students’ preparation and situation so that they could offer more adaptive learning supports. Four tests (exams) were designed by different schoolteachers as learning assessments. The first two tests were taken in the first semester while the third and fourth tests were taken in the second semester of the 2019–2020 academic year (which runs from August to July). These tests included midterm and final exams each semester. They were not standardized tests that designed by school teachers to understand how students were progressing in learning.

2 Literature Reviews

2.1 Precision Education and Technology Critiques

PE enhances personal learning and has been created based on previous digital technology development. AI includes problem-solving, representation and reasoning of knowledge, machine learning, and intelligent agents design and development (Barnes et al., 2017; Russell & Norvig, 2016). For example, an AI-driven decision support system helps doctors make better decisions when performing diagnoses, predictions, or treatments by inputting patients’ data and information into an AI system for analysis (Braun et al., 2020). Prediction models that underlie “early warning systems” should be improved; thus, the introduction of digital learning support to those students who were expected to perform poorly can improve their achievements (Bernacki et al., 2020). Likewise, PE also effectively enables the identification, prediction, and treatment of students’ learning difficulties.

ICT development can certainly support PE. With the growing use of innovative digital education, collecting students’ digital footprints can enrich new pedagogies (Fischer et al., 2020). By using teaching and learning experiences, PE aims to identify at-risk students as early as possible to offer timely intervention (Lu et al., 2018). Teachers can also use PE to understand students’ learning situations, including the extent of their learning from previous courses and elements that they did not fully understand previously. Teachers play the most important role in the implementation of STEM programs (Margot & Kettler, 2019; McMullin & Reeve, 2014), and can, therefore, identify students’ learning deficits and provide additional instruction to overcome students’ learning gaps. Students can also understand and identify their learning situations to discover the specific part of their learning that is not fully understood. Based on identifying each student’s difficulties in learning, teachers can offer interventions or students can self-regulate to improve their learning outcomes.

The COVID-19 breakout has pushed schools to use digital tools and online systems for teaching activities. However, using an online learning platform may also encounter some challenges and critiques. The networked society includes not only technology, but new economy, hierarchies, and changing values (Castells, 2011). Commercial companies or other actors (government, organizations, or think tanks) may influence learning platforms that shape education systems (Chang, 2019; Ideland, 2021; Williamson et al., 2019).

TALP provides PE to assist teachers in conducting innovative and personalized teaching. If teachers start to use innovative teaching methods or technology, students’ learning may be enhanced, and thus could improve the learning process and outcomes of STEM education. Students may develop adaptive reasoning strategies if they view the classroom as task goals structured to develop conceptual understanding rather than memorizing (Young, 1997), which would ideally lead to enhanced student understanding of content knowledge and procedures (Sherwin, 2020). Therefore, teachers should support students with more in-depth instruction. Planning and implementation should be continuously offered alongside pedagogical tools for teachers to improve students’ learning outcomes (Lesseig et al., 2016; Margot & Kettler, 2019). TALP may offer innovative tools to teach students knowledge concepts and procedures.

2.2 STEM Education

There are six principles for K–12 STEM education: (1) math and science content, (2) student-centered teaching model, (3) lessons set in an engaging and motivating context, (4) involvement of engineering design or redesign challenges, (5) learning from making mistakes, and (6) emphasizing teamwork (Margot & Kettler, 2019; Moore et al., 2014). These principles provide knowledge on how to conduct STEM education. Students may need substantial practice related to being involved in group work and hands-on activities to successfully learn STEM (El-Deghaidy et al., 2017; Herro & Quigley, 2017; Margot & Kettler, 2019). Hands-on and application activities are basic elements of STEM education that allow teachers to evaluate and understand the ways in which these elements can motivate their students (Bruce-Davis et al., 2014; Dare et al., 2014; Goodpaster et al., 2012; Huang & Lin, 2014; Margot & Kettler, 2019; van Haneghan et al., 2015).

Secondary teachers feel that engineering-based hands-on activities are especially helpful when students are learning math concepts (Asghar et al., 2012; Margot & Kettler, 2019). However, teachers with math anxiety often adopt traditional delivery methods because of their comfort levels in such approaches (Finlayson, 2014). Some elementary school teachers with math anxiety are concerned that this may limit their students’ performance in class (Ramirez et al., 2018). Thus, teachers must understand and adopt innovative teaching methods, which differ from traditional methods such as direct instruction. Moreover, programs focusing on knowledge, ability, motivation, and feelings of belonging may lead to increased interest and continuous STEM education (van den Hurk et al., 2019). Therefore, students can be motivated and may continue with STEM education if teachers use various forms of pedagogy to encourage students either inside or outside of the classroom.

This case study focused on math education, as one part of STEM. Math is an important subject in school that may influence future learning, but many students feel that learning math is difficult (Gafoor & Kurukkan, 2015). Students may experience tension, anxiety, or fear of math-related events (Beilock & Willingham, 2014). This math anxiety can restrict students’ learning processes and outcomes. Therefore, schools and teachers need to find ways to reduce math anxiety and motivate students’ learning. Technology can be important for improving mathematics proficiency (Shafique & Irwin-Robinson, 2015). Innovative pedagogy and digital and other tools can be used to assist math learning.

In Taiwan, one of the primary concerns that teachers have raised is the lack of time for STEM education (Bagiati & Evangelou, 2015; Goodpaster et al., 2012; Hsu et al., 2011; Margot & Kettler, 2019; Park et al., 2016). Therefore, it is important to develop effective and efficient teaching in STEM. Some interventions may improve STEM pedagogy, such as value perception (Gaspard et al., 2015), adoption of ICT (Kara and Yeşilyurt, 2008), or increased hands-on experiences (Prokop et al., 2007).

Many ICT platforms supporting education or AIED show the potential utility of integrating technology to enhance education (Berendt et al., 2020; Martin et al., 2020; van Alten et al., 2020). However, previous studies on PE are limited, as it is a relatively new idea. The early diagnosis of students’ learning conditions may offer a great advantage for teachers to assist students at an early stage. STEM education, on the other hand, is important but also challenging for many students. Studies show the potential of using ICT to support STEM education learning. Therefore, this study will further examine if TALP can truly enhance students’ math learning. Some recommendations can be provided to improve STEM education.

2.3 Self-Regulated Learning

The significance of SRL is that a student shows conscious and active learning behaviors that involve metacognition, intrinsic motivation, and strategic action. Autonomous learning helps students to construct meaningful learning by themselves (Lin, 2018; Perry, 2002; Zimmerman, 1990). Zimmerman (1990), following Bandura’s (1986) social cognition theory, first proposed the SRL cycle model. There are three stages in the cycle. The first is the “foresight stage,” which focuses on motivations such as self-efficacy, goal orientation, result expectations, and task interest/value. The model emphasizes the use of task analysis to determine goal setting and planning for this stage. The second is the “performance/control stage,” which emphasizes performance or control of the task execution process and examines the gradual achievement of goals. The third is the “self-reflection stage,” which mainly emphasizes the process of self-assessment and interpretation (Efklides, 2011; Lin, 2018; Pintrich, 2000; Zimmerman, 1988, 2008; Zimmerman & Kitsantas, 1997). SRL-related theories include the self-determination theory (Deci & Ryan, 2008), which assumes that people are inherently self-driven because they succeed in obtaining personal satisfaction and self-motivation, but often become alienated due to acquired factors and lose the ability to learn independently. Lin (2018) collated Pintrich’s (2000) viewpoints and proposed that autonomous learning is an active and constructive process. In SLR, students will first determine their own learning goals and subsequently monitor, adjust, and control them, which will then motivate them to continue learning. Motivation, cognition, and goal achievement will lead to continuous improvement. If teachers can provide students with the opportunity to control challenges and provide self-assessment, support, and resources by using non-threatening assessment and mastery-oriented teaching strategies, it will help them to learn independently (Perry et al., 2002). Meanwhile, co-regulated learning (CoRL) and social shared regulated learning (SSRL) also support collaborative learning based on SRL. Järvelä and Hadwin’s (2013) model involves SRL, CoRL, and SSRL. SSRL extends SRL to include external sources such as peers and teachers, social influences, and group members, to conduct collaborative learning that requires participants to commit to sharing and interacting with others (Hadwin et al., 2017; Panadero, 2017). However, students’ autonomous learning in science education requires a long training period before they can apply SRL to learning (Eilam & Reiter, 2014).

Huang and Lin (2014) studied the knowledge integration behavior of pre-employment STEM teachers and pointed out that effective teaching strategies should be adopted to improve cooperation and support among peers, guide students to self-adjust their learning, and gradually enhance students’ abilities and confidence. It is important for students to cultivate autonomous learning. If they are able to learn autonomously, they will be motivated and will continue to learn new knowledge by themselves. Autonomous learning has become an integral subject in school education, for improving the current low learning motivation of students and enabling life-long learning. Therefore, TALP attempts to cultivate students’ abilities and motivations in autonomous learning through technological assistance from teachers via teacher feedback.

3 Research Methods

This study examined an elementary school located in an urban area in mid-Taiwan. This school utilizes the Ministry of Education’s “technology assist self-regulated learning program” (TASRLP) and started using TALP in 2019. Two teachers participated by using TALP in their curriculum, and three fifth-grade classes (A, B, and C) were selected to analyze how TALP influenced their math performance as measured by teacher-administered math assessments. Class A and C started using TALP from 2020, whereas class B started around 2019. However, class A did not use it as often as classes B and C. There were 24, 23, and 26 students in classes A, B, and C, respectively.

This study used mixed methods to conduct data analysis and interviews. This is a program in the TASRLP and the researcher had gained the necessary ethical training qualifications. All participants’ names were anonymized and replaced by different names. They joined this research voluntarily. The observation was also conducted publicly and teachers and students were informed about the observation in advance. As a small-scale case study, it was considered appropriate to use nonparametric statistics to analyze test outcomes. This study used the SPSS 20.0 version, with the nonparametric Kruskal–Wallis Test and nonparametric Median Test. These tests were used to analyze whether the class’s test scores had significant differences. Meanwhile, due to the COVID-19 situation, qualitative information was provided through online semi-structured interviews and emails using open-ended questions with teachers. Teachers also shared their observation data. Teachers and the researcher interacted and confirmed data validity. Qualitative data can provide insight into the personal experiences and judgments of the participants, offering relevant empirical data to answer the research questions. The observation method can help gain insights and gather information from the field, in this case, how teachers used TALP in their classrooms. It can provide information beyond quantitative data. I observed both teachers’ course teaching approaches, integrating TAPL and face-to-face teaching. By using observation in this case study, teacher–student interaction can be included for further analysis. Interviews also allow researchers to gain perceptions from stakeholders, helping them learn more about the reality and various perspectives of this case study. However, due to COVID-19, to avoid potential risk to young students, further observations and interviews were cancelled.

4 Research Results

This study compared test scores across classes A, B, and C. The outcomes are displayed in Tables 1, 2, and 3 and Fig. 2. These show the comparative statistical analysis of test results among classes. The descriptive statistics in Table 1 show that the three classes had different average scores: both classes A and B had higher math averages compared to class C. The Kruskal–Wallis Test and the Median Test showed no significant differences. In the case study, the time spent using TALP was still quite short (less than a year), the number of participants was quite small, and tests were designed by different teachers, which are possible reasons for why the Kruskal–Wallis Test in Table 2 and the Median Test in Fig. 3 were not significant.

Table 1 Descriptive Statistics
Table 2 Ranks
Table 3 Test Statisticsb
Fig. 3
figure 3

Hypothesis Test Summary

Observations showed that students were interested in participating in class activities. Even students who were less involved in math class (identified by the teachers) showed interest in group discussions. They seemed to be more motivated to participate in class activities of a different kind from before. The interview also confirmed, as reported by the teachers, that TALP and PE can provide important information and assist their teaching activities. Moreover, students are more motivated. The teachers confirmed that using TALP could assist them in identifying students’ learning deficits so that they could provide teaching assistance to help overcome students’ learning challenges.

For example, consider class C (fifth-grade). When taking a practice test in the first semester, the test mainly focused on fourth-grade content. The test outcome was bad. Even after teaching them, children still did not understand…In the second semester, the use of TALP led to establish that some students had problems with third grade content. Therefore, third-grade content should be taught. It is positive to find out early about learning challenges to provide treatment on time. This year, in the academic exam (Nationwide), the average math score of our fifth-grade students is above the whole country. The (TALP) effect is great (Alan).

TALP or PE might be very helpful to students whose learning falls behind that of others. The analysis and identification of students’ learning problems can support and influence students’ learning.

TALP is very useful for learning assistance (especially for low academic performing students) because teachers can design tests (using TALP) to assign different (learning) tasks and examine students’ learning conditions from TALP. By using tokens (TALP) and prizes given from the school, these can encourage (and motivate) students’ learning. (Max).

The gap among students’ math scores is shortened when using TALP (Alan)

The qualitative data outcomes indicated that TALP can positively increase students’ motivation and assist teachers’ teaching. PE can be conducted with TALP. Further discussions will be displayed in the next section.

5 Discussions

In answering research question 1—“How does TALP assist teachers to conduct PE?”—the qualitative data confirmed that TALP could assist teachers in teaching math. Both teachers from this case study stated that TALP could identify students’ learning paths and problems. Based on the analysis, TALP offers learning material and adaptive testing, and teachers can assign students to learn or take tests to personalize learning. This can also be used in future analysis to continuously offer feedback to teachers and students. TALP fulfills PE by offering identification, diagnosis, prediction, and treatment for teaching and learning. The teachers indicated that TALP could not only teach students but could also increase their motivation. Students are interested in learning math using digital technology; therefore, it is important to motivate students and help them via STEM education (van den Hurk et al., 2019).

This case study indicates that TALP assisted teachers to conduct PE. The function of prediction and diagnosis of TALP offers PE. TALP can help teachers to identify individual student learning conditions in an easier manner. In this case study, fifth-grade students may have misconceptions or learning gaps from the third grade. TALP showed students’ learning problems and teachers could further assist students’ learning to overcome the learning gaps. AIED can be used to conduct PE.

Educational technologies should include those facilitating more adaptive learning systems and PE. This case study confirmed that adaptive learning and PE may enhance teaching and learning, similar to a previous study conducted by Lu et al. (2018). This case study also showed that AIED and PE can provide important information for teachers, who can adjust their teaching based on PE feedback. PE can identify individual students’ learning difficulties, so that teachers can provide personal assistance to different students. AIED can use PE to assist teachers to conduct more personalized teaching based on students’ needs. Teachers confirmed that TALP acted as AIED and provided PE that highly assisted their teaching.

In answering research question 2—“How does TALP influence students’ learning outcomes in math?”—the qualitative data confirmed that TALP exerted a positive influence. This case study shows that although TALP provides AIED and PE for learning in Taiwan, more follow-up research and curriculum designs are needed to gain the most benefit from TALP. There is controversy over the influence of educational technology. Some studies argue that computer or digital technologies may positively assist math learning (de Witte et al., 2015; Haelermans & Ghysels, 2017; Machin et al., 2007; Pilli & Aksu, 2013), while others showed digital technologies had no or negative influence on learning (Campuzano et al., 2009; Leuven et al., 2007). This case study showed the potential benefit of using TALP and PE to enhance the teaching and learning experience.

If more time was invested using TALP and more students had been included, the difference resulting from its application may have been wider. Meanwhile, each test was designed by a different teacher as a particular learning assessment, so different tests may have different difficulty levels and cover different material. The variance among tests and classes can also influence statistical analysis outcomes, especially since these were not standardized tests but midterm and final exams designed by different teachers. Therefore, qualitative methods of data collection can assist our understanding of whether TALP can influence students’ math learning outcomes.

TALP showed that PE can help teachers and students to improve their learning and identify their learning problems at an early stage. Moreover, teachers’ positive attitude also contributes to the success of use of digital tools (de Witte et al., 2015). Max and Alan both held positive attitudes toward teaching with educational technology in the interview. From the open-ended question data, the two teachers responded that when they used TALP in their teaching, the students improved. Some at-risk students may also have been more motivated and started to improve their learning outcomes. Max indicated that by using TALP, students could take pre-class tests to identify their learning problems. Further, Max could use the analysis outcomes and explain the misconceived ideas in class. Max used TALP and other digital learning resources in his courses, and he also assigned additional materials through TALP and used TALP to monitor students’ learning progress. Alan also suggested that TALP could improve students’ learning outcomes. Alan claimed that many students in class C had family issues (including at-risk students) and were accustomed to lower academic performance. Alan stated that using TALP motivated students to improve their learning outcomes.

From observation, students in both class B and C demonstrated interest in learning and participating in the class activities. Both classes used group cooperative learning strategies to group students together and guide them to use TALP by discussing answers to questions. They also shared their answers in front of the class. Although class C had more students who had lower academic performance levels, using TALP, students in class C remained motivated throughout the course. In Class C, notably, Alan conducted more lectures compared to using group strategies as the students were less experienced in using TALP and with group activities.

The students can access TALP before the class to conduct SRL. In the class group cooperative learning, students can also conduct CoRL and SSRL such that students can learn with peers. Through class observation, most students were highly motivated in the peer cooperative learning activities. Students could share and discuss to solve task challenges. Alan and Max also confirmed that students increased motivation. However, not all students can achieve the ideal of SRL. Both teachers think that some students are starting to conduct SRL and that more time invested in teaching students the skills can improve their SRL.

Therefore, educational technologies, such as AIED or PE in this case study, may be designed to support SRL. This case study also showed that AIED or PE may support SRL, CoRL, and SSRL. The TASRLP encourages design group learning with digital learning to conduct SRL. From teachers’ responses, they confirmed that the students had higher motivation and became SRL learners. Students engaged in productive and interactive ways, which can lead to effective collaboration; thus, computer-supported collaborative learning needs to be developed (Dillenbourg et al., 2009). From in-class observation, students in group activities using TALP started to conduct CoRL and SSRL via group discussions, class presentations, and peer interactions. This observation showed a similar conclusion: students may utilize technology to self-regulate their learning (Romero et al., 2019). However, more inquiry is also needed to further confirm the relationship among SRL, CoRL, SSRL, and using educational technologies.

In response to research question 3—“Based on this case study, what can be improved to support PE?”—qualitative data and literature may provide some insights. Additionally, teacher education programs can help to equip teachers with the knowledge and skills to use PE to help their students. Both Max and Alan had participated in some professional workshops about SRL and integrating digital technology in teaching. Professional development or on-job education should offer teachers opportunities to explore how to integrate STEM in their curriculum and emphasize the increase of content knowledge and experience (Margot & Kettler, 2019). This can impact both the teaching and the students’ abilities to learn directly (Nadelson et al., 2013; van Haneghan et al., 2015). Therefore, more professional development programs should be provided to assist teachers in using PE in their classrooms.

The study showed that prediction systems with digital tools can help students to improve their learning performance, especially for low achieving students (Bernacki et al., 2020). This case study confirms such research outcomes within a Taiwan elementary school context. Moreover, this case study can respond to the challenges related to innovation in AIED and pedagogy of digital learning (Barnes et al., 2017), suggesting that TALP can use AI systems to conduct PE and integrate it into daily teaching as a way of digital pedagogy. Max and Alan used TALP in their math teaching and analyzed their students’ learning situations. Analyzing and predicting students’ learning challenges in TALP show not only PE but also AIED, which supports knowledge learning.

This case study revealed that students’ grades may improve and their motivation may increase. However, there are some limitations and challenges ahead. First, this was the first year of the TASRLP, so teachers and students lacked experience. This case study also indicated that teachers may need to teach students skills to conduct SRL. Teachers may also need more professional training. Second, this is a small-sample case study limiting its generalization. The MET provides professional workshops to assist teachers to use digital platforms in their teaching. The long-term influences can be further studied and larger-scale research mounted, including initiatives based on learning analytics using national curriculum data. Policymakers can consider the role of the government to support digital learning and AIED compared with private firms offering the similar AIED. The MET has dedicated another two years to extending the TASRLP and conducted an official SRL survey. MET will also provide about $700 million (USD) dollars to support digital learning from 2022 to 2025. The continuous study of AIED and PE along with the supporting digital learning policy is also important for future researches. Lastly, a more in-depth study of AIED and PE influences on students’ SRL would be valuable future research endeavors.

6 Conclusions

This study used TALP in an elementary school in a case study on practical PE. Although the quantitative data showed no significant differences among the classes using TALP for several reasons, such as time limitations, non-standardized tests, and small sample size, they did show that PE can assist in teaching and learning. The teachers observed and responded that students who used TALP were more motivated and improved their learning outcomes. Teachers could also identify students’ learning gaps and problems in the early stages by using TALP with its PE system, and they could use TALP and other materials to assist students in their learning. This case study confirms previous studies (Berendt et al., 2020; Martin et al., 2020; van Alten et al., 2020) that technology can enhance student learning. Moreover, this case study also supported that TALP and PE can assist in teaching and learning math and at some points, even support students’ SRL.

The case study also indicated the positive potential effect of using PE in classrooms. The teachers responded that TALP could help them enhance their teaching effectiveness and learning experience. Extending or innovating the use of digital technology to conduct PE should be further explored. Teachers should be provided with professional development so that they are capable of using digital technology or PE to improve their teaching in STEM. A longitudinal study could be applied to track the influence of TALP or other PE applications, and interviewing students and observing classroom teaching is also suggested for future studies. Some standardized tests can be used for future quasi-experimental studies.