Abstract
Much research has been done on the benefits of video games in a physical education context (Camunas-Vega & Alcaide-Risoto, 2020; Fang et al., 2020). However, little attention has so far been paid to the effectiveness of commercial video games combined with actual basketball practice in helping students improve their reasoning skills (Chuang et al., 2021; Rogers et al., 2020). The study presents a quasi-experimental pre-post design with a control group in order to evaluate the impact of a specific training program in reasoning with the video game NBA 2K16. A convenience sample of 215 high school students participated in the study. Three reasoning subscales of the Evalua-9 psycho-pedagogical test (inductive α = 0.88; deductive α = 0.85; spatial α = 0.89) were used for data collection. Our findings show a significant moderate effect in the students who participated in the training program. An additional outcome was that sex differences in spatial and deductive reasoning in the pre-test disappeared in the post-test. We discuss the educational implications of the use of the video game as the main learning tool to enhance the reasoning process of Secondary Education students in Physical Education.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Since their creation, video games have been considered leisure tools for the amusement and entertainment of players. During the last decades, video games have been introduced into teaching practice as tools to support knowledge acquisition. Various reviews of research on these practices provide considerable significant evidence of the potential of video games for the improvement of students’ performance in physical activity (Fang et al., 2020; Ogawa et al., 2016); and not only for knowledge acquisition (Baradaran Rahimi & Kim, 2019; McLean & Griffiths, 2013) or to improve academic achievement (Camunas-Vega & Alcaide-Risoto, 2020). Acquiring knowledge and improving skills are basic aspects of the development of gameplay in video games, while video game-based learning seeks students to be active in their learning.
Nevertheless, Ferguson (2007) indicates that the uncontrolled and untrained use of video games can cause different types of harm to players. From the commercialization of the first video games to the present day, there has been concern about the time spent playing video games (Antar, 2022; Dorval & Pépin, 1986). In addition, excessive time spent in front of the television screen is a problem that affects the physical well-being of young people (Kracht et al., 2020). Consistent with this idea, excessive time spent playing video games has been associated with higher rates of attention problems in students (Swing et al., 2010), decreased sleep efficiency (Hisler et al., 2020), and reduced study time at home, and thus reduced academic performance (Abbasi et al., 2021).
To avoid all these problems, our research group believes that appropriate instructional techniques and strategies are essential. We carry out interventions and research projects in primary and secondary schools in which commercial video games are used as educational resources to work on curricular content, as well as to enhance the development of cognitive skills and abilities in students. As noted, video games have many benefits in both the educational and health fields. Commercial video games have been proven to be useful in the prevention, treatment, and rehabilitation of mental health problems such as depression and anxiety (Griffiths et al., 2013; Kowal et al., 2021). To this end, further research and dissemination of the results obtained are essential.
In this study, we assess if there is an improvement in the reasoning of high school students by combining the real game of basketball and the virtual game. The innovative nature of this research lies in the fact that it is one of the first programs made for adolescents to assess whether reasoning skills (deductive, inductive, and spatial) can be improved following sports training activities with commercial video games.
2 Theoretical framework: video games and reasoning
There are two major issues to address from a theoretical perspective in relation to this research: to show a model that allows us to adequately justify the learning processes that underlie the use of video games in the classroom; and to justify the potential of video games as a tool for learning and development of cognitive skills.
Regarding the learning processes, we would first like to highlight the versatility and adaptability of the use of video games to different pedagogical models and strategies (Squire & Jenkins, 2003).
Ëngestrom (1987, 2010) presents a model on the activity system concept and the expansive learning theory, useful to understand the learning processes that take place through the use of the video game. Ëngestrom and Sannino (2010) develop the relationships between subject, object, and instruments, where the object becomes learning outcomes with the help of the instruments (in this case, video games). Figure 1 shows an adaptation of this theory to our research.
An example item from the Vandenberg-Kuse Mental Rotation Test (Vandenberg & Kuse, 1978)
According to the “expansive learning” approach, students engage in the construction and application of a new, broader, and more complex object and concept to perform their activity and they do so by activating and developing cognitive skills during the game. In our case, students had three main sources of information: the play experience, their informal knowledge and prior ideas about the content, and the objective knowledge provided in their classes. Once they had played in the classroom, these different sources of information were merged through the different activities proposed in the intervention. In this way, the students, supported by the video game, the teacher and their peers, can convert their previous concepts into learning outcomes and develop cognitive skills associated with the practices they are performing.
This development of cognitive skills and their potential as learning tools has been highlighted by authors such as Squire (2003), Squire and Jenkins (2003), Gee (2003; 2008), Salen and Zimmerman (2004), Jenkins (2006), Jenkins et al. (2006) or Prensky (2001; 2002). Beyond the ability of the video games to promote motivation (Prensky, 2001) and greater student involvement (Jenkins et al., 2006), authors such as Gee (2003) also emphasize their value as a digital literacy tool.
Regarding the development of thinking, video games add to the contents a structure of rules and dynamics that allows the development of inductive discovery skills, typical of the type of scientific thinking. This perspective involves encouraging the student’s curiosity about his or her own environment, the formulation of questions or the ability to test hypotheses; in short, it is a matter of orienting and guiding towards exploration and understanding (Prensky, 2001). Video games encourage associative thinking through an iconic language, but, above all, they favour intuition and hypothetical thinking, since the player learns while playing, practicing, and deducing, activating his reasoning skills (Laniado and Pietra, 2005).
The benefits in the development of cognitive skills are also supported by Muras and Hernanz (2011) who show how the video game is useful in the classroom because its use can contribute to the development of (a) cognitive skills such as concentration, problem solving, analytical, strategic and planning capacity, development of logical and systematic thinking, deduction capacity, induction, memory development and linguistic ability; and (b) personal skills, such as self-esteem, personal autonomy, self-control and creativity.
In every video game, learning through reasoning is essential to advance and progress (Díez-Somavilla, 2016). However, before focusing on learning through reasoning, it is important to briefly address the different types of reasoning. In the following section, some research studies that examine the benefits of video games in the development of psychological processes will be presented, focusing on their incidence in the improvement of reasoning and physical education training.
2.1 Deductive reasoning
In logic, deductive reasoning represents an argument in which the conclusion is necessarily inferred from the premises (Sternberg et al., 2021). In its formal definition, a deduction obtains a finite sequence of formulas, of which the previous one is designated at the conclusion (the conclusion of the deduction). All the formulas in the sequence are either axioms, assumptions, or direct inferences from previous formulas using rules of inference. In short, it is to comprehend something based on an argument (Hillig & Müller, 2021).
According to Sternberg et al. (2021), deductive reasoning is carried out by following a series of logical steps. This logic allows us to refer to objects or phenomena and the laws that govern them; in the same way, it permits us to discover an unknown consequence, starting from a recognized principle (Cramer-Petersen et al., 2019). These principles are considered assumptions. An example is given below:
-
(1)
All mammals have lungs.
-
(2)
The dolphin is a mammal.
-
(3)
The dolphin has lungs.
2.2 Inductive reasoning
Inductive reasoning involves concluding unknowns based on what we already know (Hayes & Heit, 2018). It is a type of reasoning in which the truthfulness of the premises just suggests the conclusion but does not guarantee it (Csapó, 2020). Inductive logic examines the methods for calculating the likelihood that a conclusion is accurate as well as the guidelines for creating strong inductive arguments. Inductive reasoning differs from deductive reasoning in that the former does not provide a conclusion as to when to accept an argument as true. Thus, the idea of “inductive force” is used, which describes the likelihood that a conclusion is unquestionably true when its underlying premises are true. Therefore, the term “inductive force” refers to the likelihood that a statement is true when all of its presumptions are true (Waschl & Burns, 2020).
A classic example of inductive reasoning is The Raven Paradox (Hempel & Oppenheim, 1945). To show the extent to which inductive logic can be counterintuitive, the paradox is as follows:
-
(1)
All ravens are black. In the form of an implication, this can be expressed as: If something is a raven, then it is black.
By contrast, this statement is equivalent to:
-
(2)
If something is not black, then it is not a raven.
The assertion “All crows are black” is validated any time we see a crow and confirm that it is black. Every black raven is an argument in favor of the proposition. Now, this proposition, according to Aristotelian logic, is equivalent to this other one: “All things not black are not crows”, so confirming the second one means confirming the first one (Huemer, 2018).
Deductive reasoning differs from inductive reasoning in that the latter has the benefit of being ampliative, meaning that the conclusion contains more information than the premises do. Because it is ampliative, inductive reasoning is frequently used in science and daily life (Huemer, 2018). However, given its fallacious nature, its justification is controversial. So, the following questions arise. Can inductive reasoning be used to conclude a limited sample? What differentiates an acceptable inductive argument from an unacceptable one? This causes problems in its validity and importance that have been maintained for centuries (Weber et al., 2020).
2.3 Spatial reasoning
The ability to envision and differentiate between various two-dimensional or three-dimensional objects is a component of spatial reasoning (Liao, 2017). It also includes the capacity to understand, control, and modify complex data and translate abstract ideas into specific thoughts (Shi et al., 2022).
According to Harris et al. (2021), spatial reasoning is crucial for solving everyday issues like using a map and compass, merging into heavy traffic, and navigating your surroundings. Determining the size of a box and the number of objects that will fit inside it are two further examples of tasks that need visual-spatial aptitude (Chen et al., 2019).
An illustration of a spatial reasoning test is shown in Fig. 2. The three comparison objects are on the right, while the target object is located far to the left. The comparison objects are the same shape as the target object but are given in several angular orientations, as indicated by the ticked box beneath one of them.
![figure 2](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs10639-023-11691-y/MediaObjects/10639_2023_11691_Fig2_HTML.png)
Source: Herrero and del Castillo (2013: 960)
Conceptual relation between elements present in the workshop and the learning outcomes.
2.4 Psychological processes, video games, and physical education
Video games can be an ideal tool to enhance different cognitive aspects. Their use can improve self-confidence, as they provide mastery and control of learning. This is attractive to players because there are visual rewards when progressing through the game (Ahn et al., 2019). Similarly, video games generate self-esteem, since challenges must be overcome to progress in the game, something that requires accepting the mistakes that are made in the progress (Díez-Somavilla, 2016). For their part, Merino-Campos and del Castillo (2016) explain that active video games are an equally effective or even more appropriate learning tool than traditional learning instruments. Their success is based on the motivation that video games awaken among students (Barreto et al., 2017; Breien & Wasson, 2021; Kao, 2021). Video games rely on constant learning and can have alternatives to adapt to the learning capabilities of different players (Contreras et al., 2011). Besides, the difficulty of the game will be an important factor too. The greater the difficulty, the greater the challenge and reward for overcoming it. Therefore, this difficulty component will affect cognitive processes, as can be observed by oxygenated hemoglobin concentration signals in different regions of the brain (Yu et al., 2022).
Some studies show a better performance in reasoning using a video game as an educational instrument (Chuang et al., 2021; Iten et al., 2018; Mansor et al., 2020; Öztürk & Sarikaya, 2021). Similarly, research has confirmed the efficiency of video games in improving the reasoning of students (Alves Fernandes et al., 2016; Tan, 2021; Weger et al., 2015), considering that to progress in a video game, the development of reasoning is necessary to learn the game mechanics (Mansor et al., 2020).
This improvement in reasoning has an impact not only on the development of other cognitive skills but also on physical skills. When an athlete performs a basic skill, the body and mind work in coordination to achieve a positive result. To execute a technical action of a sport with precision, psychomotor skills are necessary. In addition, it has been proven that attention, information, working-memory capacity, information processing, and working-memory control are important aspects of sports performance (Vaughan & Laborde, 2021; Singh & Agashe, 2015) also concluded that reasoning ability influences the shooting skills of basketball players. Since field goal shooting speed in basketball requires a certain degree of motor coordination, basketball players with superior reasoning ability excel in field goal shooting speed as compared to players with inferior reasoning ability. Along the same line, Jukola (2019) also observed similar results in athletes. Furthermore, in the study by Hoyos et al. (2022), evidence was observed that there is a higher level of physical activity, metabolic equivalents (METs), oxygen consumption, motivation, and enjoyment when training while playing active video games. Similarly, Duman et al. (2016) elaborated an intervention proposal in which the basic material was a video game that required youth participation. At the end of the intervention, it was concluded that there were several benefits linked to the educational use of active video games, such as reduced obesity, increased self-concept, self-esteem, and social status in both sexes.
According to Lauer et al. (2019), Nazareth et al. (2019), and Newcombe (2020), there is considerable individual variation in the results of reasoning tests across a variety of experimental paradigms. One of the causes of such individual variation is the sex of the participants, which may be an important factor to be taken into account (Jansson et al., 2021; Preece & Bullingham, 2020). Numerous evidence suggests that boys have advantages over girls in spatial reasoning (Ahmadpoor & Shahab, 2019; Castro-Alonso & Jansen, 2019; Gagnon et al., 2018), deductive reasoning (Gelb et al., 2021), and inductive reasoning (Waschl & Burns, 2020). However, some studies show that there are no differences between deductive reasoning and inductive reasoning concerning sex (Burigat & Chittaro, 2007; Feng et al., 2007; Sokolowski et al., 2019).
From a similar perspective, the main aim of this study is to show the potential benefits of a program that includes the use of a video game as the main learning tool for students’ reasoning in three of its dimensions: deductive, inductive, and spatial. In addition, it aims to investigate whether there are aspects of reasoning that differ between students who were exposed to the intervention and those who were not, and to analyze possible differences by gender.
3 Materials and Methods
3.1 Participants
The methodology of this research is based in a quasi-experimental design. Convenience sampling was the sampling method. Units are selected for inclusion in the sample due to geographical proximity and willingness to participate in the research of the school managers, families, and students.
The sample of students (n = 215) belonged to 3º Grade of a a secondary school in Alcalá de Henares, at the Community of Madrid (Spain). They have an average age of 15 years, with 110 girls (51.16%) and 105 boys (48.84%). The sample is composed of eight class groups of students, of which five were assigned to the experimental condition and the other three to the control condition. 141 participants (65.58%) were assigned to the experimental group, and 74 participants (34.42%) to the control group (Table 1).
The experimental group performed a specific training program for nine weeks, once a week, 60 min per session. During the first 30 min, the students played the NBA 2K16 video game. Subsequently, in the other 30 min of the session, active basketball exercises were performed about what they had practiced in the video game.
The students in the control group did not receive any structured video game program during the intervention. They performed the basketball activities as part of their standard curriculum in the 60-minute physical activity sessions of the Physical Education subject.
3.2 Instruments
3.2.1 Reasoning test
The results before and after the intervention were measured with the reasoning subtest of the Batería psicopedagógica Evalúa-9 (García-Vidal et al., 2000). The reasoning scale consists of three independent tests, aimed at inductive, deductive, and spatial reasoning. The application was made by a single researcher, trained in the use of this instrument, and the application time was 40 min for each student.
The inductive reasoning test assesses the ability to operate with concepts and consists of six tasks: identifying a set of elements that do not meet a characteristic; recognition of a severer category that includes the elements of a given set; completing verbal analogies; continuing symbolic series; completing figurative analogies and continuing figurative series. Figure 3 shows some exercises of inductive reasoning. The English translation of the task instruction is the following: 4th Task. Mark with an X the element that follows in the series. Look at the example.
Example inductive reasoning exercises from Batería psicopedagógica Evalúa-9 (García-Vidal et al., 2000)
The spatial reasoning test assesses the student’s ability to operate with spatial models, identifying elements that are part of a global structure, and consists of two tasks: to identify, in a set of Kohs cubes, the elements that are not part of an overall spatial structure and to identify the solid figure that is formed from an unfolded spatial structure. Figure 4 shows some exercises of spatial reasoning. The English translation of the task instruction is the following: 1st Task. Now the task to be performed requires you to point out the TWO SQUARES that are left over after forming the large square as in the example, bearing in mind that it cannot be rotated.
Example spatial reasoning exercises from Batería psicopedagógica Evalúa-9 (García-Vidal et al., 2000)
Finally, the deductive reasoning test assesses the ability to operate with categories and consists of two tasks: to identify a diagram that represents a given proposition and to identify categories that appear related in a Venn diagram. Figure 5 shows some exercises of deductive reasoning. The English translation of the task instruction is the following: 1st Task. You have to mark with an X the diagram that is correct about the statement made in each question. Let’s see the example. “All Santiaguiños (S) are Latin Americans (L)” Here we have marked 2 because it is the only diagram that fulfills the statement. Any doubts? When you finish the first task, you can move on to the second one. Go ahead.
Example deductive reasoning exercises from Batería psicopedagógica Evalúa-9 (García-Vidal et al., 2000)
The instrument facilitates the construction of a centile score for each of the subscales. In addition, the instrument has been positively evaluated by the General Council of Official Colleges of Psychologists both for its content and construct validity, and for its reliability (Romero Tarazona, 2017). The instrument underwent pilot testing and index correlation to demonstrate validity and reliability. The internal consistency of the Batería psicopedagógica Evalúa-9 is excellent in the three inductive (α = 0.88) spatial (α = 0.89) and deductive subscales (α = 0.85).
3.2.2 NBA 2K16
To execute the training program, the video game NBA 2K16 was introduced into the classroom. It is a basketball video game for the PlayStation 3, PlayStation 4, Xbox 360, Xbox One, Microsoft Windows, Android, and iOS that was created by Visual Concepts and distributed by 2 K Sports. It was released on 29 September 2015.
This video game allows you to have the experience of becoming a professional basketball player in the NBA and perform all the individual technical actions. The students were equally able to experience being the coach, setting up the tactical moves that the team will later make during the game. Therefore, this experience allows players to experience, in a virtual environment, an action that can be brought to reality thanks to the model visualized and internalized by the students (Rogers et al., 2020). Also, this video game included women’s teams and athlete avatars to increase diversity and representation (Darvin et al., 2021). In addition, to improve in the game, they must use their reasoning skills (Contreras et al., 2011).
The choice of the video game used in the experimental group was appropriate for the age of the students. The age rating used in Europe (Pan European Game Information, PEGI) helps to know if the video game is suitable for the age of the child who will use it (Felini, 2015). In this case, the NBA 2K16 video game has a PEGI 3 rating, which means that it is suitable for players over the age of 3. Also, for the Entertainment Software Rating Board (ESRB), which is used in the three major countries of North America - Canada, Mexico, and the United States, NBA 2K16 has an E. This means everyone can play it. Another reason was the motivation it generates in students. Sport-based video games, such as FIFA 17 or Madden NFL, or NBA 2 K are the favorite games without violence for adolescents (Funk et al., 2018). This motivation generates a greater predisposition to use them (Breien & Wasson, 2021; Kao, 2021).
3.3 Procedure
The study used a quasi-experimental approach with repeated pretest/posttest measurements with a control group. It agreed to the moral standards necessary for conducting human subjects research (informed consent, right to information, protection of personal data, guarantees of confidentiality, non-discrimination, free of charge, and the possibility of abandoning the study in any of its phases).
The study was conducted in three phases. The first was the planning phase. Then, the gaming phase included a training program that took place from February to April in the following nine weeks. Finally, the analysis phase, where the training program results were evaluated.
3.3.1 Planning phase
The beginning of this phase was conducted by the researchers before going to school. After analyzing previous studies on reasoning, two hypotheses were proposed for this study:
-
1.
Students in the experimental group will achieve better results in reasoning after completing the video game intervention than those in the control group.
-
2.
Within the experimental group, boys will outperform girls in improving spatial reasoning after the intervention.
Once the two hypotheses had been put forward, to conclude this initial phase an interview was held with the director and the teachers of the school. In this interview, the project and the work scheme were explained; also, we requested the teachers’ collaboration. Parental permission forms and student assent forms regarding participation in the study were collected before gathering data.
3.3.2 Gaming phase
Pretests were conducted one week before the first session of the gaming phase. All students were provided uniform instructions, and all questions were read aloud by a research assistant.
After performing the test, the experimental group performed a specific training program for nine weeks, as detailed in the participants’ section. The objective of each session can be seen in Fig. 6. The control group performed the traditional basketball classes.
After the intervention, in the post-test phase, the aforesaid instruments were administered to the experimental and control groups as in the pretest. All data collection was videotaped and analyzed by trained researchers by the aforementioned procedures.
3.3.3 Analysis phase
The data were analyzed with SPSS statistical software, v. 25.0. A confidence level of 5% was established for all tests (p < .05). As a first step, the sample was subjected to the Kolmogorov-Smirnov test as part of the “goodness of fit” procedure. This gauges how closely our data set’s distribution resembles that of a normal distribution.
Once the test was carried out, its effectiveness was evaluated by Levene’s test (Levene, 1961), which was used to determine if our sample was normal for each of the dependent variables and if there were equal variances in the samples under study, both tests were conducted on the experimental group and the control group, in the pre-test and the post-test, for all the dependent variables. Statistical analysis of the data was conducted by applying the parametric Student’s t-test.
4 Results
In order to determine the effects of the program, first of all, the following analyses were conducted: (a) descriptive analysis for both the pre-test and post-test periods are presented for the experimental group and the control group: inductive reasoning, deductive reasoning, and spatial reasoning, as well as for the researched dependent variables, the means, and the standard deviation; (b) the differences between the means of the two groups (experimental and control) in the findings obtained; (c) sex differences between groups.
The descriptive analysis shows a positive increase between the pre and post-test in the experimental group (Table 2). In inductive reasoning, the experimental group experiences a positive change of 0.857, in deductive reasoning, the change is 0.998 and in spatial reasoning, we found the highest variation (1.557).
Considering the results from the application of the Kolmogorov-Smirnov test (Kolmogorov, 1933), the six variables analyzed are distributed normally (p > .05), so all of them will be considered when checking the difference in means (Table 3).
For this sample, all the variables that had previously met the normality assumption had equal variances (Table 4).
To analyze the inter-group and intra-group differences T-Test for independent and related samples were calculated. These analyses allowed us to validate (a) that there were no statistically significant differences between the mean scores of the groups between the results of the pretest by determining whether there were differences between the means of the two groups (experimental and control) in the findings obtained, and (b) to confirm statistically significant differences (and effect size) between the subject’s scores in the reasoning variables (dependent variables) in each group considering the administration of the tests before the intervention (pretest) and afterward (post-test).
As shown in Table 5, the starting situation of the control group is remarkably similar to the experimental group in the three variables studied (p > .05).
Regarding intra-group differences, the findings demonstrate that the experimental group’s outcomes are statistically significant for the three variables examined (Table 6). The mean difference for the variable Spatial reasoning is higher (1.557, p = .001) than for the variables inductive (0.875, p = .024) and deductive (0.998, p = .012) reasoning. When the control group was examined, the results did not show statistically significant differences between the pre and post-test in the variables studied (Table 6).
The effect size is finally determined for the three variables within the experimental group following Hunter and Schmidt (2004) (Table 7). Quantifying the success of a specific intervention about comparison is a particularly useful application of spatial reasoning. The intervention had a greater influence than the other factors in this sample because of the intervention’s effect size of 0.474.
Analyzing these dimensions in Table 8 according to sex, our findings show statistically significant differences in spatial reasoning in both sexes with moderate effect sizes (Girls p = .017; Boys p = .001) and deductive reasoning in the case of girls (p = .046), but with a lower effect size (p = .204).
5 Discussion
As stated above, recent research has suggested a relationship between playing sports video games, even for brief periods, and improvements in a variety of cognitive skills (Baradaran Rahimi & Kim, 2019; McLean & Griffiths, 2013). In addition to replicating and extending these results, this research examined the effects of video game practice on reasoning skills tasks and has been done specifically for activities related to basketball practice.
The objective of improvement that was proposed at the beginning has been demonstrated with the results obtained, both comparing the group itself before and after the intervention and comparing the experimental group with the control group. It is equally relevant that, as seen in previous research, our findings show how a brief period of immersive play with video games leads to an improvement in the reasoning of individuals in line with what previous research indicates (Chuang et al., 2021; Iten et al., 2018; Mansor et al., 2020; Öztürk & Sarikaya, 2021).
In numerous tasks, the experimental group has achieved benefits in deductive and spatial reasoning, when their results are compared with those of the control group. In particular, the students of the experimental group showed significant improvements in tasks measuring spatial skills and operating with categories. When the intragroup data of the experimental group are analyzed, comparing the pretest and post-test results, it is verified that there is an improvement in deductive and spatial reasoning. This validates the theory that the efficient use of video games is beneficial for the reasoning of the players (Alves Fernandes et al., 2016; Tan, 2021; Weger et al., 2015).
Concerning the sex variable, the results obtained contradict the hypothesis formulated in the planning phase (Ahmadpoor & Shahab, 2019; Castro-Alonso & Jansen, 2019; Gagnon et al., 2018). This hypothesis was based on recent meta-analyses on the development of sex differences in mental rotation by Lauer et al. (2019), navigation skills by Nazareth et al. (2019), and spatial puzzle solving by Newcombe (2020) that indicated a small to moderate boys’ advantage. However, our program has achieved an extremely positive aspect which is to obtain a more considerable improvement in the spatial reasoning of girls compared to their boys’ peers, despite what the previously cited recent meta-analyses on the development of sex differences indicate and other research on reasoning and sex difference previously mentioned (Ahmadpoor & Shahab, 2019; Castro-Alonso & Jansen, 2019; Gagnon et al., 2018; Gelb et al., 2021; Waschl & Burns, 2020). These positive results are the minority, but they have been obtained in other studies such as the research on navigation in 3D virtual environments by Burigat and Chittaro (2007) or Feng et al. (2007) and mental rotation training by Rodán et al. (2016). These studies indicated that playing action video games reduced the sex difference in spatial cognition, but girls did not outperform boys, as was the case in this research. This could be explained due to the motivation generated in the girls by playing video games (Barreto et al., 2017; Breien & Wasson, 2021; Kao, 2021). This makes them more interested in the game, the sport, and the rules, which helps them to perform better than when they do physical activity.
Some educational implications emerge from this study. Much of the literature on sex differences in the field of educational sciences has focused on differences in the rates of children who prefer teaching paths leading to science, technology, engineering, and mathematics (STEM) disciplines (Rodán et al., 2016). Spatial reasoning is critical to success in, among others, STEM disciplines (Vossen et al., 2020). Since spatial skills are positively correlated with standardized test scores, motivation for learning, STEM major declaration, and several science courses taken (Gold et al., 2018; Mouronte-López et al., 2021). This study suggests that training these skills in secondary education could increase the potential pool of students who successfully enter STEM careers. Consequently, it is becoming increasingly necessary to investigate the use of sports video games to see if there is a process of reasoning from what is learned in the video game to the actual practice of the sport.
6 Conclusion
This research has focused on proving the benefits of the proper use of video games to achieve an improvement in the student’s reasoning. As already mentioned in the previous section, the objective of improvement has been demonstrated by the results obtained both by comparing the group itself before and after the intervention and comparing the experimental group with the control group.
In addition, satisfactory results have been obtained in the improvement of spatial and deductive reasoning in girls compared to boys. Sex differences in the spatial and deductive reasoning on the pretest disappeared on the post-test. The reason for this improvement could be due to the use of the video game as a pedagogical instrument because it helps to a better understanding of spatial reasoning than traditional learning and increases girls’ motivation.
It is important to emphasize that this study is one of the first investigations in adolescents that analyzes the degree of improvement offered by sports training with commercial sports video games in various types of reasoning (deductive, inductive, and spatial). The results presented demonstrate that reasoning ability could be improved with this alternative instrument.
Future studies in this field can be guided by these findings, but it is vital to keep in mind that, because of their quasi-experimental design, they cannot be used to draw causal inferences. The results should also be regarded as preliminary due to the small sample size and hence weak statistical power. As a result, our findings are meant to encourage empirical analysis in subsequent studies. This study adds to the body of knowledge by pointing out the advantages of exercise for cognitive abilities.
Data Availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Abbasi, G. A., Jagaveeran, M., Goh, Y. N., & Tariq, B. (2021). The impact of type of content use on smartphone addiction and academic performance: physical activity as moderator. Technology in Society, 64, 101521. https://doi.org/10.1016/j.techsoc.2020.101521.
Ahmadpoor, N., & Shahab, S. (2019). Spatial knowledge acquisition in the process of navigation: a review. Current Urban Studies, 7(1), 1–19. https://doi.org/10.4236/cus.2019.71001.
Ahn, S. J., Johnsen, K., & Ball, C. (2019). Points-based reward systems in gamification impact children’s physical activity strategies and psychological needs. Health Education & Behavior, 46(3), 417–425. https://doi.org/10.1177/1090198118818241.
Alves Fernandes, L. M., Matos, C., Azevedo, G., Rodrigues Nunes, D., Paredes, R., Morgado, H., L., …, & Cardoso, B. (2016). Exploring educational immersive videogames: an empirical study with a 3D multimodal interaction prototype. Behaviour & Information Technology, 35(11), 907–918. https://doi.org/10.1080/0144929X.2016.1232754.
Antar, R. (2022). Video games, the brain and magical thinking: a 21st century controversy. E-Learning and Digital Media. https://doi.org/10.1177/20427530221107779.
Baradaran Rahimi, F., & Kim, B. (2019). The role of interest-driven participatory game design: considering design literacy within a technology classroom. International Journal of Technology and Design Education, 29(2), 387–404. https://doi.org/10.1007/s10798-018-9451-6.
Barreto, D., Vasconcelos, L., & Orey, M. (2017). Motivation and learning engagement through playing math video games. Malaysian Journal of Learning and Instruction, 14(2), 1–21. https://doi.org/10.32890/mjli2017.14.2.1.
Breien, F. S., & Wasson, B. (2021). Narrative categorization in digital game-based learning: Engagement, motivation & learning. British Journal of Educational Technology, 52(1), 91–111. https://doi.org/10.1111/bjet.13004.
Burigat, S., & Chittaro, L. (2007). Navigation in 3D virtual environments: Effects of user experience and location-pointing navigation aids. International Journal of Human-Computer Studies, 65(11), 945–958. https://doi.org/10.1016/j.ijhcs.2007.07.003.
Camunas-Vega, D., & Alcaide-Risoto, M. (2020). La influencia de la práctica deportiva en el autoconcepto y rendimiento académico en alumnos de secundaria. Revista Española de Educación Física y Deportes, 431, 55–67. https://doi.org/10.55166/reefd.vi431.942.
Castro-Alonso, J. C., & Jansen, P. (2019). Sex differences in visuospatial processing. Visuospatial Processing for Education in Health and Natural Sciences (pp. 81–110). Cham: Springer. https://doi.org/10.1007/978-3-030-20969-8_4.
Chen, H., Suhr, A., Misra, D., Snavely, N., & Artzi, Y. (2019). Touchdown: Natural language navigation and spatial reasoning in visual street environments. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 12538–12547).
Chuang, T. Y., Yeh, M. K. C., & Lin, Y. L. (2021). The impact of game playing on students’ reasoning ability, varying according to their cognitive style. Educational Technology & Society, 24(3), 29–43. https://www.jstor.org/stable/27032854.
Contreras, R. S., Eguia, J. L., & Solano, L. (2011). Videojuegos como un entorno de aprendizaje. El caso de Monturiol el joc. Icono14, 9(2), 249–261. http://hdl.handle.net/10854/1932
Cramer-Petersen, C. L., Christensen, B. T., & Ahmed-Kristensen, S. (2019). Empirically analyzing design reasoning patterns: Abductive-deductive reasoning patterns dominate design idea generation. Design Studies, 60, 39–70. https://doi.org/10.1016/j.destud.2018.10.001.
Csapó, B. (2020). Development of inductive reasoning in students across school grade levels. Thinking Skills and Creativity, 37, 100699. https://doi.org/10.1016/j.tsc.2020.100699.
Darvin, L., Mumcu, C., & Pegoraro, A. (2021). When virtual spaces meet the limitations of traditional sport: gender stereotyping in NBA2K. Computers in Human Behavior, 122, 106844. https://doi.org/10.1016/j.chb.2021.106844.
Díez-Somavilla, R. (2016). Los valores educativos y las competencias en los videojuegos de la TDT infantil española. Valencia: Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/68484
Dorval, M., & Pépin, M. (1986). Effect of playing a video game on a measure of spatial visualization. Perceptual and Motor Skills, 62(1), 159–162. https://doi.org/10.2466/pms.1986.62.1.159.
Duman, F., Kokaçya, M. H., Doğru, E., Katayıfçı, N., Canbay, Ö., & Aman, F. (2016). The role of active video accompanied exercises in preventing obesity in children: a prospective study from Turkey. Journal of Clinical Research in Pediatric Endocrinology, 8(3), 334. https://doi.org/10.4274/jcrpe.2284.
Engeström, Y. (1987). Learning by expanding: an activity-theoretical approach to developmental research. Helsinki: Orienta-Konsultit.
Engeström, Y., & Sannino, A. (2010). Studies of expansive learning: foundations, findings and future challenges. Educational Research Review, 5, 1–24.
Fang, Q., Ghanouni, P., Anderson, S. E., Touchett, H., Shirley, R., Fang, F., & Fang, C. (2020). Effects of exergaming on the balance of healthy older adults: a systematic review and meta-analysis of randomized controlled trials. Games for Health Journal, 9(1), 11–23. https://doi.org/10.1089/g4h.2019.0016.
Felini, D. (2015). Beyond today’s video game rating systems: a critical approach to PEGI and ESRB, and proposed improvements. Games and Culture, 10(1), 106–122. https://doi.org/10.1177/1555412014560192.
Feng, J., Spence, I., & Pratt, J. (2007). Playing an action video game reduces gender differences in spatial cognition. Psychological Science, 18(10), 850–855. https://doi.org/10.1111/j.1467-9280.2007.01990.x.
Ferguson, C. J. (2007). The good, the bad and the ugly: a meta-analytic review of positive and negative effects of violent video games. Psychiatric Quarterly, 78(4), 309–316. https://doi.org/10.1007/s11126-007-9056-9.
Funk, D. C., Pizzo, A. D., & Baker, B. J. (2018). eSport management: embracing eSport education and research opportunities. Sport Management Review, 21(1), 7–13. https://doi.org/10.1016/j.smr.2017.07.008.
Gagnon, K. T., Thomas, B. J., Munion, A., Creem-Regehr, S. H., Cashdan, E. A., & Stefanucci, J. K. (2018). Not all those who wander are lost: spatial exploration patterns and their relationship to gender and spatial memory. Cognition, 180, 108–117. https://doi.org/10.1016/j.cognition.2018.06.020.
García-Vidal, J., González-Manjón, D., & García-Pérez, M. (2000). Batería Psicopedagógica Evalúa-9. [Evalúa-9 Psychopedagogical Battery]. EOS.
Gee, J. P. (2003). What Video Games have to teach us about learning and literacy. Palgrave Macmillan.
Gee, J. P. (2008). Video Games and Embodiment. Games and Culture, 3(3–4), 253–263. https://doi.org/10.1177/1555412008317309.
Gelb, T., Wild, C., & Owen, A. (2021). A Retrospective Investigation of Sex Differences in Cognition in Children and Young Adults. Western Undergraduate Psychology Journal, 9(1).
Griffiths, M., Kuss, D. J., & de Gortari, A. B. O. (2013). Videogames as therapy: A review of the medical and psychological literature. In I. M. Miranda & M. M. Cruz-Cunha (Ed.), Handbook of research on ICTs for healthcare and social services: Developments and applications (pp. 43–68). IGI Global. https://doi.org/10.4018/978-1-4666-3990-4.ch003
Gold, A. U., Pendergast, P. M., Ormand, C. J., Budd, D. A., Stempien, J. A., Mueller, K. J., & Kravitz, K. A. (2018). Spatial skills in undergraduate students—influence of gender, motivation, academic training, and childhood play. Geosphere, 14(2), 668–683. https://doi.org/10.1130/GES01494.1.
Harris, D., Lowrie, T., Logan, T., & Hegarty, M. (2021). Spatial reasoning, mathematics, and gender: do spatial constructs differ in their contribution to performance? British Journal of Educational Psychology, 91(1), 409–441. https://doi.org/10.1111/bjep.12371.
Hayes, B. K., & Heit, E. (2018). Inductive reasoning 2.0. Wiley Interdisciplinary Reviews: Cognitive Science, 9(3), 1459. https://doi.org/10.1002/wcs.1459.
Hempel, C. G., & Oppenheim, P. (1945). A definition of “degree of Confirmation”. Philosophy of Science, 12(2), 98–115. https://doi.org/10.1086/286852.
Herrero, D., & del Castillo, H. (2013). Can a failed simulation game be useful for teaching about reality that it aims to simulate? Learning about Evolution and Natural Selection through Spore video game. In Proceedings of 5th International Conference on Education and New Learning Technologies, 13, 957–965. Retrieved from: https://library.iated.org/view/HERRERO2013CAN
Hillig, S., & Müller, R. (2021). How do conversational case-based reasoning systems interact with their users: a literature review. Behaviour & Information Technology, 40(14), 1544–1563. https://doi.org/10.1080/0144929X.2020.1767207.
Hisler, G., Twenge, J. M., & Krizan, Z. (2020). Associations between screen time and short sleep duration among adolescents varies by media type: evidence from a cohort study. Sleep Medicine, 66, 92–102. https://doi.org/10.1016/j.sleep.2019.08.007.
Hoyos, A. M., Yusty, N., & Flor, V. A. (2022). Efecto del uso de videojuegos activos en el nivel de actividad física del adulto joven. Revisión exploratoria. Retos. Nuevas Tendencias en Educación Física, Deporte y Recreación, 45, 888–896. https://doi.org/10.47197/retos.v45i0.90421
Huemer, M. (2018). Newcomb’s Problem. In M. Huemer (Ed.), Paradox Lost (pp. 107–132). Palgrave Macmillan. https://doi.org/10.1007/978-3-319-90490-0_5
Hunter, J. E., & Schmidt, F. L. (2004). Methods of Meta-analysis: correcting Error and Bias in Research Findings. Sage.
Iten, G. H., Bopp, J. A., Steiner, C., Opwis, K., & Mekler, E. D. (2018). Does a prosocial decision in video games lead to increased prosocial real-life behavior? The impact of reward and reasoning. Computers in Human Behavior, 89, 163–172. https://doi.org/10.1016/j.chb.2018.07.031.
Jansson, A., Brun Sundblad, G., Lundvall, S., Bjärsholm, D., & Norberg, J. R. (2021). Students perceived learning in physical education: variations across students’ gender and migration background in Sweden. Sport Education and Society, 1–13. https://doi.org/10.1080/13573322.2021.1878129.
Jenkins, H. (2006). Convergence Culture. New York University Press.
Jenkins, H., Purushotma, R., Clinton, K., Weigel, M., & Robinson, A. (2006). Confronting the challenges of participatory culture: media education for the 21st century. The MacArthur Foundation.
Jukola, S. (2019). Casuistic reasoning, Standards of evidence, and expertise on Elite athletes’ Nutrition. Philosophies, 4(2), 19. https://doi.org/10.3390/philosophies4020019.
Kao, D. (2021). The effects of observation in video games: how remote observation influences player experience, motivation, and behavior. Behaviour & Information Technology, 1–23. https://doi.org/10.1080/0144929X.2021.1906321.
Kracht, C. L., Joseph, E. D., & Staiano, A. E. (2020). Video games, obesity, and children. Current Obesity Reports, 9(1), 1–14. https://doi.org/10.1007/s13679-020-00368-z.
Kolmogorov, A. (1933). Sulla determinazione empirica di una legge di distribuzione. Giornale dell’Istituto Italiano degli Attuari, 4, 83–91.
Kowal, M., Conroy, E., Ramsbottom, N., Smithies, T., Toth, A., & Campbell, M. (2021). Gaming your mental health: a narrative review on mitigating symptoms of depression and anxiety using commercial video games. JMIR Serious Games, 9(2), e26575. https://doi.org/10.2196/26575.
Laniado, N., & Pietra, G. (2005). Videojuegos, internet y televisión. Oniro.
Lauer, J. E., Yhang, E., & Lourenco, S. F. (2019). The development of gender differences in spatial reasoning: a Meta-Analytic Review. Psychological Bulletin, 145(6), 537–634. https://doi.org/10.1037/bul0000191.
Levene, H. (1961). Robust tests for equality of variances. Contributions to probability and statistics. Essays in Honor of Harold Hotelling, 279–292.
Liao, K. H. (2017). The abilities to understand spatial relations, spatial orientation, and spatial visualization affect 3D product design performance: using carton box design as an example. International Journal of Technology and Design Education, 27(1), 131–147. https://doi.org/10.1007/s10798-015-9330-3.
Mansor, N. S., Chow, C. M., & Halaki, M. (2020). Cognitive effects of video games in older adults and their moderators: a systematic review with meta-analysis and meta-regression. Aging & Mental Health, 24(6), 841–856. https://doi.org/10.1080/13607863.2019.1574710.
McLean, L., & Griffiths, M. (2013). The Psychological Effects of Video Games on Young People: a review. Revista de Psicología Ciències de l´Educació i de l´Esport, 31(1), 119–123.
Merino-Campos, C., & del Castillo, H. (2016). The benefits of active Video Games for Educational and Physical Activity Approaches: a systematic review. Journal of New Approaches in Educational Research, 5(2), 115–122. https://doi.org/10.7821/naer.2016.7.164.
Mouronte-López, M. L., García, A., Bautista, S., & Cortés, C. (2021). Analyzing the gender influence on the interest in engineering and technical subjects. International Journal of Technology and Design Education, 31(4), 723–739. https://doi.org/10.1007/s10798-020-09580-3.
Muras, S., & Hernanz, B. (2011). Estudio Videojuegos, educación y desarrollo infantil. Fase cualitativa. Estudio para ADESE Nº: 10371. Madrid: AEVI.
Nazareth, A., Huang, X., Voyer, D., & Newcombe, N. S. (2019). A meta-analysis of sex differences in human navigation skills. Psychonomic Bulletin & Review, 26(5), 1503–1528. https://doi.org/10.3758/s13423-019-01633-6.
Newcombe, N. S. (2020). The puzzle of spatial sex differences: current status and prerequisites to solutions. Child Development Perspectives, 14(4), 251–257. https://doi.org/10.1111/cdep.12389.
Ogawa, E. F., You, T., & Leveille, S. G. (2016). Potential benefits of exergaming for cognition and dual-task function in older adults: a systematic review. Journal of Aging and Physical Activity, 24(2), 332–336. https://doi.org/10.1123/japa.2014-0267.
Öztürk, M., & Sarikaya, İ. (2021). The relationship between the mathematical reasoning skills and video game addiction of turkish middle schools’ students: a serial mediator model. Thinking Skills and Creativity, 40, 100843. https://doi.org/10.1016/j.tsc.2021.100843.
Preece, S., & Bullingham, R. (2020). Gender stereotypes: the impact upon perceived roles and practice of in-service teachers in physical education. Sport Education and Society, 1–13. https://doi.org/10.1080/13573322.2020.1848813.
Prensky, M. (2001). Digital Game-Based learning. McGraw-Hill.
Prensky, M. (2002). The motivation of gameplay: the real twenty-first century learning revolution. On the Horizons, 10(1), 5–11. https://doi.org/10.1108/10748120210431349.
Rodán, A., Contreras, M. J., Elosúa, M. R., & Gimeno, P. (2016). Experimental but not sex differences of a Mental Rotation Training Program on Adolescents. Frontiers in Psychology, 7, 1050. https://doi.org/10.3389/fpsyg.2016.01050.
Rogers, R., Farquhar, L., & Mummert, J. (2020). Motivational differences among viewers of traditional Sports, Esports, and NBA 2K League. Communication & Sport, 2167479520942738. https://doi.org/10.1177/2167479520942738.
Romero Tarazona, R. E. (2017). Estructura familiar, niveles de aprendizaje y su relación con el rendimiento escolar de las alumnas de primaria del colegio Regina Pacis manejo de la lectura. Universidad Inca Garcilaso de la Vega Ed.
Salen, K., & Zimmerman, E. (2004). Rules of play: Game Design Fundamentals. MIT Press.
Shi, Z., Zhang, Q., & Lipani, A. (2022). Stepgame: a new benchmark for robust multi-hop spatial reasoning in texts. Association for the Advancement of Artificial Intelligence. AAAI.
Singh, V. K., & Agashe, C. D. (2015). Effect of information processing and depth perception upon throwing accuracy of basketball players. Физическое воспитание студентов, (2), 37–42. https://doi.org/10.15561/20755279.2015.0206.
Sokolowski, H. M., Hawes, Z., & Lyons, I. M. (2019). What explains sex differences in math anxiety? A closer look at the role of spatial processing. Cognition, 182, 193–212. https://doi.org/10.1016/j.cognition.2018.10.005.
Squire, K. (2003). Video games in education. International Journal of Intelligent Simulations and Gaming, 2(1), 49–62. https://doi.org/10.1145/950566.950583.
Squire, K., & Jenkins, H. (2003). Harnessing the power of games in education. Insight, 3(1), 5–33.
Sternberg, R. J., Guyote, M. J., & Turner, M. E. (2021). Deductive reasoning. Aptitude, Learning, and Instruction, 219–246.
Swing, E. L., Gentile, D. A., Anderson, C. A., & Walsh, D. A. (2010). Television and video game exposure and the development of attention problems. Pediatrics, 126, 214–221. https://doi.org/10.1542/peds.2009-1508.
Tan, E. E. (2021). An Exploration of the Relationship between Exposure to Violent Video Games and Moral Reasoning about Violence [Doctoral dissertation, University of Nottingham]. http://eprints.nottingham.ac.uk/64306/
Vandenberg, S. G., & Kuse, A. R. (1978). Mental rotations, a group test of three-dimensional spatial visualization. Perceptual and Motor Skills, 47(2), 599–604. https://doi.org/10.2466/pms.1978.47.2.599.
Vaughan, R. S., & Laborde, S. (2021). Attention, working-memory control, working-memory capacity, and sports performance: the moderating role of athletic expertise. European Journal of Sports Science, 21(2), 240–249. https://doi.org/10.1080/17461391.2020.1739143.
Vossen, T. E., Henze, I., De Vries, M. J., & Van Driel, J. H. (2020). Finding the connection between research and design: the knowledge development of STEM teachers in a professional learning community. International Journal of Technology and Design Education, 30(2), 295–320. https://doi.org/10.1007/s10798-019-09507-7.
Waschl, N., & Burns, N. R. (2020). Sex differences in inductive reasoning: a research synthesis using meta-analytic techniques. Personality and Individual Differences, 164, 109959. https://doi.org/10.1016/j.paid.2020.109959.
Weber, E., Beirlaen, M., & De Bal, I. (2020). Black Ravens, white shoes & scientific evidence. The Ravens Paradox and/in scientific practice. Ghent University.
Weger, U. W., Loughnan, S., Sharma, D., & Gonidis, L. (2015). Virtually compliant: immersive video gaming increases conformity to false computer judgments. Psychonomic Bulletin & Review, 22(4), 1111–1116. https://doi.org/10.3758/s13423-014-0778-z.
Yu, D., Wang, S., Song, F., Liu, Y., Zhang, S., Wang, Y., & Zhang, Z. (2022). Research on the user experience of the video game difficulty based on flow theory and fNIRS. Behaviour & Information Technology, 1–17. https://doi.org/10.1080/0144929X.2022.2043442.
Acknowledgements
The authors would like to thank Professor Luis Alberto Lázaro Lafuente for giving constructive and helpful feedback.
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Author information
Authors and Affiliations
Contributions
Carlos Merino-Campos: Conceptualization; Investigation; Methodology; Project administration; Resources; Visualization; Writing - original draft.
Héctor del-Castillo: Conceptualization; Investigation; Methodology; Formal analysis; Project administration; Resources; Supervision; Writing - review & editing.
Isabel Pascual-Gómez: Data curation; Writing - review & editing.
Corresponding author
Ethics declarations
Competing Interest
The authors have declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Merino-Campos, C., del-Castillo, H. & Pascual-Gómez, I. Enhancing adolescent reasoning skills through a video game program. Educ Inf Technol 28, 12737–12756 (2023). https://doi.org/10.1007/s10639-023-11691-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-023-11691-y