Abstract
This study examines the impact of educational robotics applications in Information Technologies and Software courses on the motivation, attitude towards robotics, and academic achievement of 6th-grade secondary school students. The research employed pre-experimental method encompassing 112 students. Students got training in robotics using the Arduino education kit over the course of eight weeks consisted of programming and electronic concepts. Findings indicate that while students' motivation levels were moderate both before and after the implementation, there was a relative decrease in course motivation scores after the implementation. Students exhibited positive attitudes towards robotics and achieved a good level of success. Additionally, a significant effect of motivation on attitudes towards robotics was observed. Gender was found to have no effects on motivation, attitude, or achievement. It was determined that students held positive attitudes towards robotics and developed favorable views of their robotics skills. The implications are discussed in terms of theoretical insights, practices and directions for further research.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Today, technology has been rapidly developing in all areas of life, and the production of functional technologies in various sectors has become increasingly important. In the 21st-century, when technology is at the heart of life, it is emphasized that students, from early childhood, need an education that enables them to use computer sciences effectively and also develop their production-oriented and collaborative skills (Bers, 2010, 2019; El-Hamamsy et al., 2021a; Kazakoff et al., 2013; Settle & Perkovic, 2010). Fundamental skills such as problem-solving, creativity, algorithmic and computational thinking, necessary for computer experts and people of all ages, professions, and fields, are emphasized under 21st-century skills (Resnick, 2013; Shin et al., 2013; Wing, 2006). These skills can be imparted through teaching programming and computer science (El-Hamamsy et al., 2021b; Kert et al., 2020; Shin et al., 2013). Accordingly, for the new generation of global citizens to creatively use technology according to their needs, adapt to changing demands and production styles, and remain an active member of a productive technology world, knowledge of programming languages is crucial (Aytekin et al., 2018; Cross et al., 2016).
Various platforms (such as Alice, Blockly, Code Org, Scratch, Mblock, and KoduLab) exist to facilitate teaching programming skills to young students. Most of these tools, which are often free, enable individuals to easily develop programs using drag-and-drop or puzzle-like techniques. Such platforms are also referred to as block-based programming environments. These block-based platforms, unlike text-based programming tools with complex code structures, facilitate the learning of algorithms and programming for young students due to their drag-and-drop nature (Bers, 2019; Kert et al., 2020; Strawhacker & Bers, 2015; Todorovska & Bogdanova, 2020). In recent years, studies on educational robotics (ER) applications have also begun to appear in the literature alongside block-based platforms for programming instruction. In ER, robotics education kits containing microcontrollers, various sensors, gears, and motors, such as Lego, Robotis, and VEX, as well as cost-effective, open-source electronic boards like Arduino, different types of motors, and sensors are used. This diversity enriches ER applications with a wide range of tools.
ER provides students with an interactive learning environment that offers hands-on and experiential learning opportunities (Yolcu & Demirer, 2023). The robot-building process is a comprehensive and collaborative endeavor, integrating various disciplines such as mechanics, electronics, and programming. Robotics education encompasses all these processes. Typically, this education covers mechanical components and basic design principles from a mechanical perspective, circuit components and sensors from an electronics viewpoint, and for programming, algorithms, and fundamentals of programming. Students design their robots by following step-by-step guidebooks, in which they familiarize themselves with materials and apply design principles. While working with electronic components, they gain knowledge of basic electronics through microcontrollers and sensors.
Robot programming is a process where developers or end-users create a robot program to implement specific behaviors. In the context of ER, robots are programmed by students. Students can give instructions to make robots behave in a certain way through a user interface like graphical (block-based) or natural language (text-based). The advantage of robot programming is that it provides immediate feedback to students on whether the robot behaves as intended. This prompts students to wonder why the robot behaves in a certain way, ask questions, seek solutions, and solve problems (Bravo et al., 2017). The ability of ER to show the output of developed codes not only on a computer screen but also on a physical robot helps students concretize abstract concepts and code structures. It positively affects their motivation by allowing them to immediately see the real-life impact of their programmed applications (Kert et al., 2020; Ntourou et al., 2021; Sisman et al., 2021; Stewart et al., 2021; Wu & Chen, 2021).
In ER activities, students experience design and implementation processes similar to those of an engineer (Carro et al., 2021; Jackson et al., 2021). ER processes closely mirror the engineering steps followed in a real robot development process. The engineering design process involves developing a system, component, or process to meet specific needs (ABET, 2015). Students who experience these processes can gain engineering design skills. Although the engineering design process is described in the literature with various names and stages, it fundamentally includes similar phases. According to the Next Generation Science Standards [NGSS] (2013), these stages are defining the problem, doing research, identifying needs, generating alternative solutions, selecting and developing the best solutions, creating a model, testing, and making necessary corrections. The engineering design process, considering younger age groups, is built on a six-stage cycle: (1) ask, (2) imagine, (3) plan, (4) create (5) test & improve (6) share (Fig. 1).
Engineering activities and goals are valuable and inherently motivating because individuals are naturally driven to make things and benefit from curiosity about how things work (Brophy et al., 2008). Rogers and Portsmore (2004) state that reducing engineering to elementary school age is based on constructivist philosophy; according to this philosophy, students learn better while working with materials that allow them to design and construct meaningful artifacts for people. In this study, lesson plans based on the engineering design process provided in Fig. 1 above were used. Thus, it aimed to ensure that students adopt engineering design processes as a lasting learning experience.
1.1 Theoretical background
Although ER has only recently become widespread, its origins date back much further. ER applications are based on constructivism and constructionism theories. The views of Piaget (1973) and Papert (1980), suggesting that children in the learning process are not passive recipients but actively construct their knowledge, have been influential in the field of ER. Active thinking and practical activities during the learning process enable learners to create concepts and rules (Ackermann, 2001; Alimisis, 2013; Harel & Papert, 1991). Constructionism emphasizes student-centered learning through the exploration of concrete objects and the importance of connecting prior knowledge and new information in the real world (Alimisis & Kynigos, 2009). Based on this perspective, students are introduced to programming education and engineering practices from an early age through ER (Arís & Orcos, 2019; Berland & Wilensky, 2015; Bers, 2010; Bers & Portsmore, 2005; El-Hamamsy et al., 2021b; Elkin et al., 2016; Kazakoff et al., 2013; Sullivan & Bers, 2018). Current studies in the field of ER are of significant importance. This study investigates the effects of ER on secondary school students' motivation, attitudes, and achievements.
In many studies in the field of education, students' success and failure are often explained through the concept of motivation (Fryer & Bovee, 2016; Gabrielle, 2003; Guilloteaux & Dörnyei, 2008). Learners' motivation is crucial in the learning and teaching process. Accordingly, focusing on the use of technology has been a key approach in research aimed at increasing motivation in the classroom and assisting students (Di Serio et al., 2013; Huitt, 2001). Compared to those lacking motivation, these studies have revealed that students willing to learn tend to participate more, show perseverance, and complete tasks. On the other hand, a lack of motivation in students has been identified as leading to lower their academic performance and even to increase their academic failure (Molaee & Dortaj, 2015). Learners' motivation occupies a pivotal role in the learning and teaching process (Keller, 1987, 2009). Although many researchers have suggested that ER can enhance learners' motivation for learning, entertainment and interaction alone, if only emerging from the technology itself without integrated teaching strategies, cannot sustain learning motivation, which may rapidly decline over time. Numerous studies have identified a close relationship between the sustainability of learning motivation and teaching strategies. In this context, learners should be well directed with suitable teaching strategies to increase and maintain their learning motivation. In other words, introducing ER to learners may boost learning motivation at the start of learning activities, but appropriate teaching strategies are essential (Hung et al., 2013).
Numerous studies have been conducted to date explaining how motivation can be provided, developing various theories in the process. However, most of these theories describe how motivation occurs and on what it depends. Distinctively, the ARCS (Attention- Relevance- Confidence- Satisfaction) motivation model, proposed by John Keller (1987), is a model that facilitates both the provision and sustainability of motivation. The ARCS motivation model offers the opportunity to design the motivation process as a whole by synthesizing motivational theories and concepts. The "Attention, Relevance, Confidence, and Satisfaction" (ARCS) motivation model, a teaching strategy developed to motivate students, focuses on both intrinsic and extrinsic motivations to increase students' motivation and interest (Keller, 1987). According to research, each component of the ARCS model plays a critical role in enhancing students' motivation during the learning process (Di Serio et al., 2013). Yıldız et al. (2019) in their study, indicate that there is a substantial body of work on this model in technology-related fields (computer-web based training, mobile learning, virtual worlds, etc.), and accordingly, instructional designs based on technological areas improve students' academic achievement, motivation levels, and motivational characteristics. This study has been conducted by applying the ARCS model to investigate the impact of ER activities on secondary school students' course motivation, thereby contributing to the limited literature on the use of ER within the framework of the ARCS model.
Student attitudes are also one of the key factors affecting the learning process. Factors such as students' level of maturity and readiness, interests, needs, attitudes, and values can affect their willingness to learn (Tay & Akyürek Tay, 2004). Attitudes express an individual's positive or negative learned predispositions towards an object or concept. Studies have shown that there is a significant relationship between students' academic achievements and their attitudes (Mohd et al., 2011; Nicolaidou & Philippou, 2003). In skill development processes across various sectors, students' attitudes and interests play a critical role. Attitudes often encompass a wide range of emotional behaviors including preference, acceptance, appreciation, and commitment, and are frequently used to express students' intrinsic values or areas of interest (Welch, 2010). In course design, it is important to identify students' attitudes towards the course and the factors affecting these attitudes.
1.2 Literature review
The interdisciplinary nature of ER enables students to find links between different subjects and have a more comprehensive understanding of these subjects as a whole. In this way, ER offers a more extensive and integrated approach in education (Sun & Zhou, 2023). Studies on ER have seen a significant increase in recent years. Many of these studies focus on the instruction of robotics and its inclusion in STEM (Science, Technology, Engineering, Mathematics) processes (Anwar et al., 2019; Atman Uslu et al., 2022; Jung & Won, 2018; Karim et al., 2015; Zhang et al., 2021). The use of educational robots in teaching processes provides significant positive effects. These effects include the development of computational thinking skills (Sapounidis et al., 2023; Wu & Su, 2021; Zhang et al., 2021), enhancement of problem-solving and creative thinking abilities (Arís & Orcos, 2019; Karim et al., 2015; Zhang & Zhu, 2022), promotion of positive attitudes towards courses (Erol et al., 2023; Hussain et al., 2006; T.T. Wu & Chen, 2021), and strengthening of motivation (Arís & Orcos, 2019; Carro et al., 2021; Erol et al., 2023; Ribeiro et al., 2008; Sáez López et al., 2020; T.T. Wu & Chen, 2021). The integration of ER into STEM education plays a significant role in enhancing students' problem-solving abilities and teamwork skills (Arís & Orcos, 2019; Erol et al., 2023; Kucuk & Sisman, 2020; Ouyang & Xu, 2024; Stewart et al., 2021). Moreover, ER increases interest and participation in the STEM field, positively affecting students' attitudes towards STEM disciplines (Atman Uslu et al., 2022; Chen & Chang, 2018; Erol et al., 2023; Karim et al., 2015; Kim & Lee., 2016; Ouyang & Xu, 2024; Stewart et al., 2021). The focal points of studies that examine ER from different angles and offer various perspectives are summarized in Table 1.
Furthermore, ER is used to facilitate a faster understanding of abstract concepts and to allow the visual and physical application of computer science concepts, thereby enhancing programming and IT skills (Angeli & Valanides, 2020; Atmatzidou & Demetriadis, 2016; Noh & Lee, 2020). Erol et al. (2023), in their study investigating the impact of robotic activities with Arduino on students' attitudes towards ICT (Information and Communication Technology) courses and STEM, revealed that robot design activities conducted with Arduino enhance students' attitudes towards engineering and technology within the context of STEM and ICT courses. Furthermore, student feedback indicates that educational robotic activities are fun, engaging, interesting, and hands-on.
However, it is noted that using ER is a more effective method for developing students' algorithm solving, data processing, and basic programming skills, as well as increasing self-confidence, but not necessarily effective for problem-solving skills (Kert et al., 2020). In contrast, students may find robotic activities diverse, challenging, complex, and time-consuming (Erol et al., 2023). Technical issues, limitations of the robot sets used, limited availability of robots outside of class, and restricted time periods throughout the term have also been found to not positively impact class motivation (McWhorter, 2008).
Some studies, carried out in the past years, have shown that boys generally perform at a higher level than girls in terms of computer experience (Papastergiou, 2009), participation in programming and robotics activities (Rusk et al., 2008), and attitude (Baser, 2013). Additionally, there are findings indicating that boys have more confidence and higher achievement in STEM fields (American Association of University Women & Greenberg Lake the Analysis Group, 1994; Comber et al., 1997; Pajares & Schunk, 2001; Wang & Degol, 2017). However, in recent years, this gender gap has been narrowing. ER activities have become a positive and encouraging tool for women, helping to remove societal biases and bridge the gender gap in computer sciences and STEM fields (Atmatzidou & Demetriadis, 2016; Jackson et al., 2021; Sullivan & Bers, 2018). Most recent research in computer sciences suggests that the difference between men and women is not significant (Atmatzidou & Demetriadis, 2016; Noh & Lee, 2020). Studies on gender in ER and STEM show that gender does not affect STEM attitudes (Kucuk & Sisman, 2020), and both genders can have a successful and beneficial experience in ER activities as well as in STEM and computer sciences, without gender being a limitation (Beisser, 2005; Cheng et al., 2013; Hussain et al., 2006; Kaloti-Hallak et al., 2015; Master et al., 2017; Ribeiro et al., 2008).
1.3 Rationale and importance of the study
Software programming influences all aspects of human production and life in the data age, thereby increasingly emphasizing the value of programming education (Sun & Zhou, 2023). Moreover, programming has been redefined as part of the new K-12 computer curriculum reform worldwide. The OECD (2016) states that programming ability is no longer just essential for computer professionals but also a fundamental skill for children living in the intelligent era of the twenty-first century. This situation highlights the importance of providing students with a broader capacity for thinking and the ability to interact with technology.
In programming instruction, the challenge of concretizing often abstract concepts encountered by students can impact their attitudes towards programming and their learning motivation (Anwar et al., 2019; Erol et al., 2023; Hodges et al., 2020; Jdeed et al., 2020; Jung & Won, 2018; Kert et al., 2020; Kim & Lee, 2016; Sisman et al., 2021). Indeed, attitude and motivation are among the most important factors affecting learning (Bixler, 2006; Malone, 1981; Tay & Akyürek Tay, 2004;).
Research indicates that ER activities play a positive role in learning, foster creative thinking, and enhance problem-solving skills (Zhang & Zhu, 2022). Interaction with robots also increases motivation, engagement, and attitudes towards education (Erol et al., 2023; Ouyang & Xu, 2024; Yolcu & Demirer, 2023). Moreover, the simplification of robot design and assembly processes, the inclusion of visual drag-and-drop programming, and the decreasing cost of educational robot platforms are ushering in a new era for educational technologies (Karim et al., 2015).
The benefits and advantages provided by ER applications, such as their interdisciplinary relationship, the various skills gained during the learning process, assistance in concretizing abstract concepts, and the immediate observation of programming outputs on robots, make creating effective learning environments with robotic activities appealing. Ouyang and Xu (2024) emphasize in their study that to fully realize the potential of educational robotics, it's necessary to go beyond focusing solely on robotics itself. The study highlights the importance of integrating interdisciplinary approaches and diverse educational strategies in the development and design of ER applications, in a manner that can maximize learning effects technologically. However, studies on a curriculum integrated with motivation-based ER are quite limited in the literature and on the agendas of many countries (El-Hamamsy et al., 2021a). Within this study, a teaching program has been developed using the ARCS motivation model, which emphasizes the motivational aspect of instruction and highlights the importance of the motivation factor at every stage of teaching. Important cognitive-affective variables such as motivation, achievement, and attitude have been examined. The study sought answers to the following research questions in a 6th-grade Information Technologies and Software course in which educational robotics applications were implemented:
-
RQ 1. What are the levels of students' course motivation, robotics attitudes, and achievements?
-
RQ 2. What is the effect of educational robotics applications on students' course motivation?
-
RQ 2.a. Is there a significant difference between pre-test and post-test motivation scores according to students' initial motivation levels for the course?
-
RQ 3. Does students' course motivation show any significant differences according to gender?
-
RQ 4. Do students' achievements and robotics attitudes show any significant differences according to their course motivation levels and gender?
2 Method
In this study examining the impact of educational robotics applications on secondary school students' course motivation, achievements, and attitudes towards robotics, the pre-test-post-test single-group experimental design model, which is a pre-experimental method of quantitative approaches, has been utilized. In this design, the effect of the experimental procedure is tested on a single group. Measurements related to the dependent variable for the subjects are obtained before the procedure as a pre-test, and afterward as a post-test, using the same subjects and the same measurement tools (Creswell, 2014; Fraenkel et al., 2018). The study investigates students' course motivation before and after the experimental application. Additionally, students' attitudes towards educational robotics and learning performance have been revealed following the experimental application.
2.1 Participants and the research process
The study group consisted of 112 sixth-grade students (49 girls, 63 boys, aged 11–12) from four different classes of a state school in a socio-economically disadvantaged area. These sixth-grade students had previously attended a two-hour weekly Information Technologies and Software course in the fifth grade, where they were introduced to basic information technologies and computer literacy skills. In the first term of the sixth grade, they were taught coding using the block-based Scratch program. In the second term, ER applications were conducted for 12 weeks as a part of this study. Parental consent was obtained from the students' parents before starting the study, and ethical committee approvals were secured from the relevant institutions.
In the implementation, daily plans and class activities, prepared within the framework of "ARCS Motivation Strategies" and the "Engineering Design Process”, included both programming concepts such as loops, variables, and robotics learning outcomes. The lesson content and plan flow were implemented after receiving expert opinion. For the implementation, an Arduino education kit capable of carrying out the activities in the lesson plans was prepared. Robotics materials used during class activities, including Arduino Uno R3, breadboard, LED, resistor, RGB LED, buzzer, LDR sensor, ultrasonic distance sensor, potentiometer, and jumper cables, were placed in a hobby box, with one set provided for every two students. The pairs were attentively formed to create heterogeneous groups in terms of ability, gender, achievement, and personal characteristics, to integrate students with low skills and learning difficulties into the learning process and also to develop higher learning skills. This approach aimed to increase efficiency by promoting collaboration in groups while maintaining students' motivation and attention in classes. The bi-weekly two-hour lesson plans prepared by the researchers, based on ARCS principles and strategies and steps of the engineering design process, were finalized after being reviewed by two field experts. Table 2 displays an example two-hour weekly plan. The implementation of this plan, including the "Let's Light an LED Activity" circuit diagram and codes, is shown in Fig. 2. Images from the implementation process are presented in Fig. 3.
2.1.1 Data collection instruments
In the research, the Course Interest Scale, Robotics Attitude Scale, and Achievement Test were used as data collection tools. Details of each data collection instrument are provided below.
2.1.1.1 Course Interest Scale (CIS)
The Course Interest Survey (CIS), originally published by Keller (2009), has been adapted into Turkish by Dincer (2015). Based on the ARCS Model, the original version of the CIS is a 34-item Likert-type scale (very true, true, moderately true, slightly true, not true) developed to encompass the components of attention, relevance, confidence, and satisfaction, which are the four sub-dimensions named identically to the components of the ARCS Model. In the ARCS motivation model, the attention category involves arousing and sustaining curiosity and interest (Sample Item 4: "There were many things in this course that caught my interest"), the relevance category addresses situations related to learners' needs, interests, and motivations (Sample Item 18: "The content of this course was relevant to my expectations and goals"), the confidence category is about creating a positive expectation of success among learners (Sample Item 3: "I was confident I would succeed in this course"), and the satisfaction category includes providing intrinsic and extrinsic supports to encourage student effort (Sample Item 10: "Learning the topics of this course was satisfying"). The original scale's Cronbach Alpha internal consistency coefficient is 0.95, while the adapted scale's Cronbach Alpha internal consistency coefficient is 0.91. The data obtained indicate that the adapted scale is a valid and reliable instrument for application among middle school students. The scale, which has a midpoint of 96, determines the lowest possible score as 32 and the highest as 160. Based on this information, it is recommended that the scoring and interpretation of the CIS and its sub-dimensions should be conducted according to the principles of normal distribution, within these specified lower and upper limits. Interpretations of the CIS scores and its sub-dimensions are shown in Table 3.
2.1.1.2 Robotics Attitude Scale (RAS)
In the study, to determine students' attitudes towards ER activities, the Robotics Attitude Scale (RAS), developed by Cross et al. (2016) and adapted to Turkish by Sisman and Kucuk (2018), was used. The scale consists of four sub-dimensions: learning desire, self-confidence, computational thinking, and teamwork, and includes 24 items in a 5-point Likert format. The Cronbach Alpha value of the scale has been calculated as 0.932.
The scale includes a dimension for Learning Desire, which aims to uncover students' curiosity and interest in robotics with items such as "I want to learn more about robotics" and "robotics interests me." In the Confidence dimension, items like "I believe I can become an expert in the field of robotics" and "I can build a robot" are designed to assess students' belief in their ability to build and program robots. The Computational Thinking dimension includes items such as "I am good at logical thinking" and "I solve problems in a logical way" to reveal students' approaches to solving problems they encounter. Lastly, the Teamwork dimension contains items like "I can communicate my ideas to my group" and "I enjoy working in a group" to determine students' views on working in group settings.
2.1.1.3 Achievement test
To measure students' achievements in educational robotics applications, the researcher developed an achievement test and a practical exam consisting of multiple-choice and fill-in-the-blank questions. The achievement test encompasses the outcomes of "Problem Solving, Programming, and Original Product Development" units in the Information Technologies and Software Course, as well as the outcomes associated with robotics applications aligned with these goals. These outcomes were selected based on a review of existing literature, consultations with subject matter experts, and findings from preliminary studies to comprehensively understand the effects of ER applications on student achievement. The outcomes were structured around four main components: loops, conditions, variables in programming, and robotics achievements. These outcomes were included in the achievement test after necessary adjustments based on the feedback of three field experts. A pool of items, mostly at the comprehension and application levels, was created for the achievement test, which included multiple-choice and fill-in-the-blank questions. In addition to the achievement test, the researchers prepared a practical exam for each class, consisting of two questions per class, eight questions in total. These practical questions, related to everyday life, were posed to students as real-life problems, with the expectation that they would approach them solution-focused and solve them using their learned robotics knowledge. The practical exam was assessed through a practice control form prepared based on the defined outcomes. Students' achievement scores were calculated by averaging the scores obtained from the achievement test and the practical exam.
Feedback for the achievement test was sought from different field experts such as a measurement and evaluation expert for the content and face validity, four Information Technology teachers for content and content and structure, and two language teachers and two subject matter experts for language review. The expert group reviewed the prepared achievement test in terms of content, learning outcomes, and language. Based on their feedback, some questions in the item pool were revised, and changes were made to the options and stems of the items. As a result, the achievement test included 12 multiple-choice and 3 fill-in-the-blank questions. The test was scored out of 100 points, and the grading was done in accordance with the Ministry of National Education's directive: “85–100—Excellent,” “70–84—Good,” “60–69—Medium,” “50–59—Pass,” and “0–49—Fail.”
2.1.2 Data analysis
In the analysis of the collected data, the SPSS.21 software was used to initially conduct descriptive statistics such as frequency, percentage, mean, and standard deviation. In the study, dependent t-tests, independent t-tests, and multivariate analysis of variance (MANOVA) were performed upon meeting the assumptions for each test (Field, 2009). A significance level of 0.05 was used for all statistical analyses. The distributions of the data, examined through skewness and kurtosis coefficients, indicated that all variables fell within the + 1 to -1 range, suggesting a normal distribution of the data (Tabachnick & Fidell, 2007). Effect size values in the study were calculated and presented using Cohen’s d and η2. Cohen's effect size values are interpreted as Small: 0.20, Medium: 0.50, and Large: 0.80. In MANOVA tests, partial η2 values of 0.01 indicate a low effect size, 0.06 a medium effect size, and 0.14 and above a large effect size (Cohen, 1988).
3 Findings
3.1 Students' motivation, achievement, and attitudes towards robotics
The descriptive data related to students' course motivation, achievement, and attitudes towards robotics at the end of the application are presented in Table 4. As seen in Table 4, it has been found that students' motivation towards the course (M = 120.47, SD = 22.6) and their achievements (M = 69.35, SD = 10.17) are at a medium level. Students' attitudes towards robotics have been determined to be at a good level (M = 3.54, SD = 0.74).
3.2 Comparison of pre-test and post-test scores for students' motivation towards the course
A dependent t-test was conducted to determine whether there was a significant difference in the pre-test and post-test average scores of students' motivation towards the course. The results revealed a significant decrease in the students' course motivation scores (t = 4.36; p < 0.05). The effect size value was found to be 0.39, indicating a moderate level of impact (Table 5).
Additionally, the dependent t-test results, conducted to determine whether there was a significant difference between pre-test and post-test scores in students' initial motivation levels towards the course, are presented in Table 6. The students' motivation levels towards the course were identified based on their responses to the motivation scale administered at the beginning of the term. In this regard, it was determined that 26 students had high motivation towards the course before the implementation, while 86 students had moderate motivation levels.
For the 86 students who initially had a moderate level of motivation towards the course, it was observed that their average motivation scores significantly decreased after the implementation of educational robotics applications (pre-test = 125.23, SD = 18.37, post-test = 112.34, SD post-test = 19.29). The effect size emerged as high at 0.68.
For the 26 students who initially had a high level of motivation towards the course, it was observed that their average motivation scores increased following the implementation (pre-test = 139.23, SD pre-test = 13.34, post-test = 147.38, SD post-test = 4.57). The effect size was high at 0.82.
3.3 Students' motivation towards the course by gender
The results of the independent t-test conducted to determine whether there was a significant difference in students' motivation towards the course based on gender are presented in Table 7. It was found that both male and female students had a moderate level of motivation towards the course (Mean (male) = 121.40, SD (male) = 21.23, Mean (female) = 119.29, SD (female) = 24.63), and that there was no significant difference in course-related motivation by gender (p > 0.05.
3.4 The impact of students' motivation levels and gender on their achievement and attitudes towards robotics
A Multivariate Analysis of Variance (MANOVA) was conducted to determine if there was a significant effect of students' motivation levels towards the course and their gender on their achievements and attitudes towards robotics. The results are presented in Table 8.
Upon examining Table 8, it is evident that the motivation level towards the course has a significant effect on achievement scores and attitudes towards robotics (Wilks' Λ = 0.704, F(2,107) = 3.92, p < 0.05). The effect size is determined to be high at 0.14. It has been found that neither gender nor the interaction of gender with motivation level significantly affects students' achievement scores and attitudes towards robotics.
Table 9 displays the effects of the dependent variables, robotics attitude and achievement scores, in relation to the independent variables of gender and motivation level towards the course. According to the findings from the MANOVA test, while there is no significant effect of motivation level towards the course and gender on achievement scores (p > 0.05), the motivation level towards the course significantly affects attitudes towards robotics (p < 0.05).
Within the scope of this research question, a second MANOVA test was conducted to investigate which sub-dimensions the significant effect of motivation level towards the course had on attitudes towards robotics. As seen in Table 10, it was found that the motivation level towards the course created a significant difference in the sub-dimensions of attitudes towards robotics (Wilks' Λ = 0.760, F(4,107) = 3.92, p < 0.05). The effect size was determined to be 0.24, indicating a high level.
While the motivation level towards the course has a significant effect on the sub-dimensions of attitudes towards robotics, such as desire to learn, confidence, and computational thinking (p < 0.05), it does not have a significant impact on the teamwork sub-dimension (p > 0.05). When examining the magnitude of the significant effect of motivation level towards the course on the sub-dimensions of attitudes towards robotics, it was found that desire to learn (η2 = 0.190) has a large effect size, whereas confidence (η2 = 0.136) and computational thinking (η2 = 0.123) have a medium level of effect size.
4 Discussion and conclusion
This research investigated the effects of an educational robotics program developed with the ARCS motivation model on students' motivation towards the course, their achievements, attitudes towards robotics, and whether gender had any influences on these factors. The implementation conducted for the study revealed that students had a good level of attitude towards robotics and their achievements were also close to being good. However, a more detailed examination of the results showed that despite students' motivation towards the course being moderate both before and after the application, there was a relative decrease in the average motivation scores after the application. The higher level of interest towards the course initially might be due to the block-based Scratch programming studied by the students in the first term of the Information Technologies and Software course and perceived as easier and more enjoyable, thereby motivating and engaging students. However, this study also suggests that creating electronic circuits, encountering new concepts like resistance, sensors, grounding, and resolving wiring complexities could have increased cognitive load and thus, students' motivation decreased. Indeed, studies indicate that students perform better and exhibit higher motivation when using block-based Scratch in programming instruction, as it offers a more engaging learning environment by visualizing program structures (Kert et al., 2020; Bers, 2019; Kazakoff et al., 2013; Resnick et al., 2003; Ruf et al., 2014; Strawhacker & Bers, 2015). Tlili et al. (2017), in their study, implemented a "learning by doing" strategy for undergraduate computer science students and applied Keller's ARCS motivational model. These approaches were observed to increase student motivation, keep them actively engaged, and assist them in acquiring the necessary technical skills to develop their educational games. Keller's ARCS motivational model is designed to increase students' interest in the learning process, strengthen the relevance of learning materials to their personal and professional goals, support their confidence towards success, and maximize their satisfaction from the learning experiences (Keller, 1987). Therefore, although some students found educational robotics activities difficult, there was no significant decrease in their motivation for the course.
Contrarily, Przybylla and Romeike (2014) have noted that while physical programming is seen as an exciting phenomenon by many teachers, the technical complexity of activities like breadboarding and soldering often makes them unsuitable for classroom use. In this study, it was proposed that teachers could solve these problems using ready-made robot sets like MyIG, TinkerKit, Hummingbird, etc. However, it has been observed that the cost of educational robotic activities conducted with these ready-made sets is significantly higher compared to the materials used in this study. Additionally, factors such as students only being able to work during laboratory hours, lack of resources to revise topics outside of class hours, insufficient weekly lesson hours, and large class sizes may have contributed to a relative decrease in students' motivation towards the course. Parallel to this conclusion, similar findings are reported in the literature (Beug, 2012; Fagin & Merkle, 2002; McWhorter, 2008; Reich-Stiebert & Eyssel, 2015). Beug (2012) in his study concluded that Arduino is not suitable for teaching programming concepts at a beginner level, noting that some students in the Arduino group got bored during activities, possibly due to technical difficulties related to the Arduino board. Ouyang and Xu (2024) in their research, showed that ER is more effective at high school and higher education levels compared to other educational levels (e.g., elementary, middle school). Due to the complex functions of ER, it is considered that most educational robotics might be more suitable for older students (e.g., students in higher education) rather than younger ones (e.g., elementary school students).
Fagin and Merkle (2002) associated the negative results of their research with the lack of equipment for robotic students to work with outside class hours. They suggested allowing students to take robots home after class or providing more out-of-class lab time. McWhorter (2008) identified potential reasons for the lack of positive quantitative outcomes in course motivation from robotic activities, including technical problems, limitations of the robot set used, limited availability of robots outside of class, and the restricted time allocated for robotic activities throughout the term.
On the other hand, Saleiro et al. (2013) indicated in their study that robot systems which do not require additional software installation (based on PIC microcontroller, Arduino, or Raspberry Pi and programmed with Blockly) were successfully used even by 3rd and 4th-grade students. Moreover, the use of robotics in education has been found effective in increasing students' willingness to collaborate with each other and in enhancing their desire and motivation for learning activities, as evidenced in various studies (Arís & Orcos, 2019; Atmatzidou & Demetriadis, 2016; Bargagna et al., 2019; Benitti, 2012; Erol et al., 2023; Gupta et al., 2012; Highfield, 2010; Jdeed et al., 2020; Kucuk & Sisman, 2017; Ouyang & Xu, 2024; Ribeiro et al., 2008; Rubio et al., 2013; Sáez López et al., 2020; Stewart et al., 2021; Wei et al., 2011).
When examining the initial motivation levels of students towards the course, it was found that the 86 students with a moderate level of initial interest experienced a decrease in their interest after the implementation, while the 26 students with a high level of initial interest showed an increase in their interest. In other words, for students already highly interested in the course, robotic activities were engaging and enhanced their motivation. Literature review also indicates that many studies on motivation report similar positive outcomes (Arís & Orcos, 2019; Erol et al., 2023; Kaloti-Hallak et al., 2015; Kert et al., 2020; Kucuk & Sisman, 2017; Ribeiro et al., 2008; Rubio et al., 2013; Sáez López et al., 2020; Saleiro et al., 2013).
According to the findings from the robotics attitude scale, students developed positive attitudes towards robotics and their attitudes were found to be at a good level after the application. Consistently, literature also indicates that robotic activities positively influence students' attitudes towards computer sciences and STEM (Science, Technology, Engineering, and Mathematics) fields (Anwar et al., 2019; Arís & Orcos, 2019; Chen & Chang, 2018; Erol et al., 2023; Hussain et al., 2006; Jung & Won, 2018; Kaloti-Hallak et al., 2015; Kandlhofer & Steinbauer, 2016; Kucuk & Sisman, 2020; Liu, 2010; Ouyang & Xu, 2024; Ribeiro et al., 2008; Rubio et al., 2013; Somyurek, 2015; Zhang et al., 2021).
The average achievement scores of students, calculated by combining the results of the success test and the practical exam conducted at the end of the educational robotics activities, are quite close to a good level. The fact that students had learned block-based coding in the first term of this course may have contributed to this outcome. Additionally, students who did not perform well in written exams may have been able to demonstrate their robotic skills more comfortably in the practical exam, which could have had a positive effect on the results.
Another result of the study is the significant effect of motivation level towards the course on attitudes towards robotics. It can be said that students with a high level of motivation towards the course are more interested in the field of computing and its applications. This may have led to the development of positive attitudes towards robotics. Additionally, it was determined that the motivation level towards the course has a significant effect on the sub-dimensions of attitudes towards robotics, including desire to learn, confidence, and computational thinking. However, no significant effects were determined on the teamwork sub-dimension of the robotics attitude. In the ARCS motivation model used in the study, the attention category, by arousing and maintaining curiosity and interest, may have increased the desire to learn. The relevance category, by helping students perceive teaching needs as consistent with their goals, compatible with their learning styles, and related to their past experiences, may have positively influenced their computational thinking. The confidence category, by creating a positive expectation for success, may have positively impacted students' self-confidence. The grouping of students in pairs may not have provided an adequate team working environment, which could be why no effect was observed in the teamwork dimension.
The study also revealed that gender as an independent variable did not have any effects on students' motivation towards the course, their attitudes towards robotics, or their achievement. This finding aligns with previous research in science, mathematics, technology, and engineering activities, where gender differences have been a notable point of discussion. Historically, many studies have highlighted gender differences, showing that males often had more confidence and higher achievement in fields related to science, technology, engineering, and mathematics (STEM) (American Association of University Women & Greenberg Lake-the Analysis Group, 1994; Comber et al., 1997; Pajares & Schunk, 2001; Papastergiou, 2009; Wang & Degol, 2017). Research has also indicated that males generally exhibited higher levels of computer experience (Papastergiou, 2009), participation in programming and robotics activities (Rusk et al., 2008), and attitudes towards these fields (Baser, 2013) than females.
However, in the last decade, this gender gap has been gradually decreasing. Recent literature suggests that robotics activities attract equal interest from both genders, and gender does not delimitate it. Studies have shown that there are no significant differences in learning outcomes based on gender in the context of robotics (Cheng et al., 2013; Hussain et al., 2006; Jackson et al., 2021; Kaloti-Hallak et al., 2015; Ribeiro et al., 2008; Sullivan & Bers, 2018). This shift may be attributed to various factors, including changes in societal attitudes, more inclusive educational practices, and a broader recognition of the importance of engaging all students, regardless of gender, in STEM fields.
5 Limitations and implications
The limitations of this study include its implementation with a limited number of students over a short period, in a single-group pre-test post-test design at a school with a low socio-economic status. Another limitation is that students' motivation towards the course and their attitudes towards robotics were determined through self-reports. The fact that the educational robotics (ER) activities were conducted only with one type of robotics set might also be considered a limitation. Additionally, the limited classroom hours for students to access ER sets and the lack of such equipment at their homes constrain the further study.
For future research, teaching activities could be designed using different robotics sets. More comprehensive collaborative activities could be planned to foster a team-working spirit among students. Some opportunities could be provided for students to practice more what they learn in class during their out-of-class time. Future studies could examine students' course motivation, achievements, and attitudes towards robotics using larger sample groups and longer-term implementations, including experimental and control group designs. Investigating how students' cognitive and affective states are influenced in environments using different ER sets and various teaching designs would be valuable. Additionally, students' experiences related to the process could be explored more in-depth through qualitative studies, providing a more comprehensive understanding of the impact and dynamics of educational robotics in learning environments.
Data availability
The datasets analyzed during the current study are available from the corresponding author on reasonable request.
References
Accreditation Board for Engineering and Technology, Inc., ABET. (2015). Criteria for accrediting engineering programs. Retrieved from https://www.abet.org/wp-content/uploads/2015/10/E001-16-17-EAC-Criteria-10-20-15.pdf. Accessed 11.08.2023.
Ackermann, E. (2001). Piaget’s constructivism, Papert’s constructionism : What’s the difference ? 1–11.
Alimisis, D. (2013). Educational robotics: Open questions and new challenges. Themes in Science and Technology Education,6(1), 63–71.
Alimisis, A. D., & Kynigos, C. (2009). Constructionism and robotics in education. Teacher Education on Robotics-Enhanced Costructivist Pedagogical Methods, 11–26.
American Association of University Women & Greenberg Lake the Analysis Group. (1994). Shortchanging Girls, Shortchanging America: Executive Summary: A Nationwide Poll that Assesses Self-esteem, Educational Experiences, Interest in Math and Science, and Career Aspirations of Girls and Boys Ages 9–15. https://www.aauwbakersfield.com/uploads/9/6/2/5/96257912/shortchanging_girls_shortchanging_america.pdf/. Accessed 20 Oct 2018.
Angeli, C., & Valanides, N. (2020). Developing young children’s computational thinking with educational robotics: An interaction effect between gender and scaffolding strategy. Computers in Human Behavior, 105. https://doi.org/10.1016/j.chb.2019.106225
Anwar, S., Bascou, N. A., Menekse, M., & Kardgar, A. (2019). A systematic review of studies on educational robotics. Journal of Pre-College Engineering Education Research (J-PEER), 9(2). https://doi.org/10.7771/2157-9288.1223.
Arís, N., & Orcos, L. (2019). Educational robotics in the stage of secondary education: Empirical study on motivation and STEM skills. Education Sciences,9(2), 73. https://doi.org/10.3390/educsci9020073
Atman Uslu, N., Yavuz, G. O., & Koçak Usluel, Y. (2022). A systematic review study on educational robotics and robots. Interactive Learning Environments,31(9), 5874–5898. https://doi.org/10.1080/10494820.2021.2023890
Atmatzidou, S., & Demetriadis, S. (2016). Advancing students’ computational thinking skills through educational robotics : A study on age and gender relevant differences. Robotics and Autonomous Systems,75, 661–670. https://doi.org/10.1016/j.robot.2015.10.008
Atmatzidou, S., Demetriadis, S., & Nika, P. (2018). How does the degree of guidance support students’ metacognitive and problem-solving skills in educational robotics? Journal of Science Education and Technology,27(1), 70–85. https://doi.org/10.1007/s10956-017-9709-x
Aytekin, A., Sonmez Cakir, F., Yucel, Y. B., & Kulaoz, İ. (2018). Coding science directed to future and some methods to be available and coding learned. Eurasian Journal of Researches in Social and Economics (EJRSE), 24–41.
Bargagna, S., Castro, E., Cecchi, F., Cioni, G., Dario, P., Dell’Omo, M., Di Lieto, M. C., Inguaggiato, E., Martinelli, A., Pecini, C., & Sgandurra, G. (2019). Educational robotics in down syndrome: A feasibility study. Technology, Knowledge and Learning,24(2), 315–323. https://doi.org/10.1007/s10758-018-9366-z
Baser, M. (2013). Attitude, gender and achievement in computer programming. Online Submission,14(2), 248–255. https://doi.org/10.5829/idosi.mejsr.2013.14.2.2007
Beisser, S. R. (2005). An examination of gender differences in elementary constructionist classrooms using Lego/Logo instruction. Computers in the Schools,22(3–4), 7–19. https://doi.org/10.1300/j025v22n03_02
Benitti, F. B. V. (2012). Exploring the educational potential of robotics in schools: A systematic review. Computers & Education,58(3), 978–988. https://doi.org/10.1016/j.compedu.2011.10.006
Berland, M., & Wilensky, U. (2015). Comparing virtual and physical robotics environments for supporting complex systems and computational thinking. Journal of Science Education and Technology,24(5), 628–647. https://doi.org/10.1007/s10956-015-9552-x
Bers, M. U. (2019). Coding as another language: A pedagogical approach for teaching computer science in early childhood. Journal of Computers in Education,6(4), 499–528. https://doi.org/10.1007/s40692-019-00147-3
Bers, M. U. (2010). The TangibleK robotics program: Applied computational thinking for young children. Early Childhood Research and Practice,12(2), 1–20.
Bers, M. U., & Portsmore, M. (2005). Teaching partnerships: Early childhood and engineering students teaching math and science through robotics. Journal of Science Education and Technology,14(1), 59–73. https://doi.org/10.1007/s10956-005-2734-1
Beug, A. (2012). Teaching introductory programming concepts: A comparison of Scratch and Arduino (Master's thesis, California Polytechnic State University, San Luis Obispo). https://doi.org/10.15368/theses.2012.95.
Bixler, B. (2006). Motivation and its relationship to the design of educational games. NMC Conference, Cleveland, Ohio, 10(07).
Bravo, F. A., Gonzalez, A. M., & Gonzalez, E. (2017). A review of intuitive robot programming environments for educational purposes. 2017 IEEE 3rd Colombian Conference on Automatic Control, CCAC 2017 - Conference Proceedings, 2018-Janua (pp. 1–6). https://doi.org/10.1109/CCAC.2017.8276396.
Brophy, S., Klein, S., Portsmore, M., & Rogers, C. (2008). Advancing engineering education in P-12 classrooms. Journal of Engineering Education,97(3), 369–387. https://doi.org/10.1002/j.2168-9830.2008.tb00985.x
Cam, E., & Kıyıcı, M. (2022). The impact of robotics assisted programming education on academic success, problem solving skills and motivation. Journal of Educational Technology and Online Learning,5(1), 47–65. https://doi.org/10.31681/jetol.1028825
Carro, G., Sancristobal, E., & Plaza, P. (2021). Robotics as a tool to awaken interest in engineering and computing among children and young people. Revista Iberoamericana De Tecnologias Del Aprendizaje,16(2), 204–212. https://doi.org/10.1109/RITA.2021.3089919
Chalmers, C. (2018). Robotics and computational thinking in primary school. International Journal of Child-Computer Interaction,17, 93–100. https://doi.org/10.1016/j.ijcci.2018.06.003
Chang, C. C., & Chen, Y. (2020). Cognition, attitude, and interest in cross-disciplinary i-STEM robotics curriculum developed by thematic integration approaches of webbed and threaded models: A concurrent embedded mixed methods study. Journal of Science Education and Technology,29(5), 622–634. https://doi.org/10.1007/s10956-020-09822-4
Chen, Y., & Chang, C. C. (2018). The impact of an integrated robotics STEM course with a sailboat topic on high school students’ perceptions of integrative STEM, interest, and career orientation. Eurasia Journal of Mathematics, Science and Technology Education,14(12), 1614.
Cheng, C. C., Huang, P. L., & Huang, K. H. (2013). Cooperative learning in Lego robotics projects: Exploring the impacts of group formation on interaction and achievement. Journal of Networks,8(7), 1529–1535. https://doi.org/10.4304/jnw.8.7.1529-1535
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. In Routledge Academic. https://doi.org/10.2307/2529115.
Comber, C., Colley, A., Hargreaves, D. J., & Dorn, L. (1997). The effects of age, gender, and computer experience upon computer attitudes. Educational Research,39(2), 123–133. https://doi.org/10.1080/0013188970390201
Creswell, J. W. (2014). Research Design: Qualitative, quantitative, and mixed methods approaches (4nd ed.). Sage. Clark, (4th ed.). SAGE.
Cross, J., Hamner, E., Zito, L., Nourbakhshh, I., & Bernstein, D. (2016). Development of an assessment for measuring middle school student attitudes towards robotics activities. 2016 IEEE Frontiers in Education Conference (FIE). https://doi.org/10.1109/fie.2016.7757677.
Di Serio, Á., Ibáñez, M. B., & Kloos, C. D. (2013). Impact of an augmented reality system on students’ motivation for a visual art course. Computers & Education,68, 586–596. https://doi.org/10.1016/j.compedu.2012.03.002
Dincer, S. (2015). The effect of computer-aided instruction software prepared by using different pedagogical agents to students' academic achievements, motivations, interests in their courses, judgements about their computer-aided instruction and cognitive loads (Doctoral dissertation, Çukurova University).
Eguchi, A. (2014). Robotics as a learning tool for educational transformation. International Workshop Teaching Robotics, Teaching with Robotics & International Conference Robotics in Education, 27–34. https://doi.org/10.4018/978-1-4666-8363-1.ch002.
Eguchi, A. (2016). RoboCupJunior for promoting STEM education, 21st century skills, and technological advancement through robotics competition. Robotics and Autonomous Systems,75, 692–699. https://doi.org/10.1016/j.robot.2015.05.013
El-Hamamsy, L., Bruno, B., Chessel-Lazzarotto, F., Chevalier, M., Roy, D., Zufferey, J. D., & Mondada, F. (2021). The symbiotic relationship between educational robotics and computer science in formal education. Education and Information Technologies,26(5), 5077–5107. https://doi.org/10.1007/s10639-021-10494-3
El-Hamamsy, L., Chessel-Lazzarotto, F., Bruno, B., Roy, D., Cahlikova, T., Chevalier, M., Parriaux, G., Pellet, J. P., Lanarès, J., Zufferey, J. D., & Mondada, F. (2021). A computer science and robotics integration model for primary school: Evaluation of a large-scale in-service K-4 teacher-training program. Education and Information Technologies,26(3), 2445–2475. https://doi.org/10.1007/s10639-020-10355-5
Elkin, M., Sullivan, A., & Bers, M. U. (2016). Programming with the Kibo robotics kit in preschool classrooms. Computers in the Schools,33(3), 169–186. https://doi.org/10.1080/07380569.2016.1216251
Erol, O., Sevim-Cirak, N., & Baser Gulsoy, V. G. (2023). The effects of educational robotics activities on students’ attitudes towards stem and ict courses. International Journal of Technology in Education,6(2), 203–223. https://doi.org/10.46328/ijte.365
Fagin, B. S., & Merkle, L. (2002). Quantitative analysis of the effects of robots on introductory computer science education. Journal on Educational Resources in Computing,2(4), 1–17. https://doi.org/10.1145/949257.949259
Field, A. (2009). Discovering statistics using SPSS. In Sage Publication (Vol. 58). https://doi.org/10.1234/12345678.
Fraenkel, J., Wallen, N., & Hyun, H. (2018). How to design and evaluate research in education (10th ed.). McGraw-Hill.
Fryer, L. K., & Bovee, H. N. (2016). Internet and higher education supporting students ’ motivation for e-learning : Teachers matter on and off line. The Internet and Higher Education,30, 21–29. https://doi.org/10.1016/j.iheduc.2016.03.003
Gabrielle, D. (2003). The effects of technology-mediated instructional strategies on motivation, performance, and self-directed learning. In EdMedia+ Innovate Learning (pp. 2568–2575). Association for the Advancement of Computing in Education (AACE).
Gerecke, U., & Wagner, B. (2007). The challenges and benefits of using robots in higher education. Intelligent Automation & Soft Computing,13(1), 29–43.
Guilloteaux, M. J., & Dörnyei, Z. (2008). Motivating language learners: A classroom-oriented investigation of the effects of motivational strategies on student motivation. TESOL Quarterly,42(1), 55–77.
Gupta, N., Tejovanth, N., & Murthy, P. (2012). Learning by creating: Interactive programming for Indian high schools. Proceedings - 2012 IEEE International Conference on Technology Enhanced Education, ICTEE 2012, 4–6. https://doi.org/10.1109/ICTEE.2012.6208643.
Harel, I., & Papert, S. (1991). Situating Constructionism. Constructionism, 1–16.
Highfield, K. (2010). Robotic toys as a catalyst for mathematical problem solving. Australian Primary Mathematics Classroom,15(2), 22–28.
Hodges, S., Sentance, S., Finney, J., & Ball, T. (2020). Physical computing: A key element of modern computer science education. Computer,53(4), 20–30. https://doi.org/10.1109/MC.2019.2935058
Huitt, W. (2001). Motivation to learn: An overview. Educational Psychology Interactive,12(3), 29–36.
Hung, I. C., Chao, K. J., Lee, L., & Chen, N. S. (2013). Designing a robot teaching assistant for enhancing and sustaining learning motivation. Interactive Learning Environments,21(2), 156–171. https://doi.org/10.1080/10494820.2012.705855
Hussain, S., Lindh, J., & Shukur, G. (2006). The effect of LEGO training on pupils’ school performance in mathematics, problem solving ability and attitude: Swedish data. Educational Technology and Society,9(3), 182–194.
Ioannou, A., & Makridou, E. (2018). Exploring the potentials of educational robotics in the development of computational thinking: A summary of current research and practical proposal for future work. Education and Information Technologies,23(6), 2531–2544. https://doi.org/10.1007/s10639-018-9729-z
Jackson, A., Mentzer, N., & Kramer-Bottiglio, R. (2021). Increasing gender diversity in engineering using soft robotics. Journal of Engineering Education,110(1), 143–160. https://doi.org/10.1002/jee.20378
Jdeed, M., Schranz, M., & Elmenreich, W. (2020). A study using the low-cost swarm robotics platform spiderino in education. Computers and Education Open,1(November), 100017. https://doi.org/10.1016/j.caeo.2020.100017
Jung, S. E., & Won, E. S. (2018). Systematic review of research trends in robotics education for young children. Sustainability (Switzerland),10(4), 1–24. https://doi.org/10.3390/su10040905
Kaloti-Hallak, F., Armoni, M., & Ben-Ari, M. (2015, November). Students' attitudes and motivation during robotics activities. In Proceedings of the Workshop in Primary and Secondary Computing Education (pp. 102–110).
Kandlhofer, M., & Steinbauer, G. (2016). Evaluating the impact of educational robotics on pupils ’ technical- and social-skills and science related attitudes. Robotics and Autonomous Systems,75, 679–685. https://doi.org/10.1016/j.robot.2015.09.007
Karaman, S., Anders, A., Boulet, M., Connor, J., Gregson, K., Guerra, W., Guldner, O., Mohamoud, M., Plancher, B., Shin, R., & Vivilecchia, J. (2017). Project-based, collaborative, algorithmic robotics for high school students: Programming self-driving race cars at MIT. ISEC 2017 - Proceedings of the 7th IEEE Integrated STEM Education Conference, 195–203. https://doi.org/10.1109/ISECon.2017.7910242.
Karim, M. E., Lemaignan, S., & Mondada, F. (2015). A review: Can robots reshape K-12 STEM education? 2015 IEEE International Workshop on Advanced Robotics and its Social Impacts (ARSO). https://doi.org/10.1109/ARSO.2015.7428217.
Kazakoff, E. R., Sullivan, A., & Bers, M. U. (2013). The effect of a classroom-based intensive robotics and programming workshop on sequencing ability in early childhood. Early Childhood Education Journal,41(4), 245–255. https://doi.org/10.1007/s10643-012-0554-5
Keller, J. M. (1987). Development and use of the ARCS model of instructional design. Journal of Instructional Development,10(3), 2. https://doi.org/10.1007/BF02905780
Keller, J. M. (2009). Motivational design for learning and performance: The ARCS model approach. Springer Science & Business Media.
Kert, S. B., Erkoç, M. F., & Yeni, S. (2020). The effect of robotics on six graders’ academic achievement, computational thinking skills, and conceptual knowledge levels. Thinking Skills and Creativity,38(1), 100714. https://doi.org/10.1016/j.tsc.2020.100714
Kim, S. W., & Lee, Y. (2016). The effect of robot programming education on attitudes towards robots. Indian journal of science and technology,9(24), 1–11. https://doi.org/10.17485/ijst/2016/v9i24/96104
Kucuk, S., & Sisman, B. (2017). Behavioral patterns of elementary students and teachers in one-to-one robotics instruction. Computers and Education,111, 31–43. https://doi.org/10.1016/j.compedu.2017.04.002
Kucuk, S., & Sisman, B. (2020). Students’ attitudes towards robotics and STEM: Differences based on gender and robotics experience. International Journal of Child-Computer Interaction,23–24, 100167. https://doi.org/10.1016/j.ijcci.2020.100167
Lin, C. H., Liu, E. Z. F., Kou, C. H., Virnes, M., Sutinen, E., & Cheng, S. S. (2009). A case analysis of creative spiral instruction model and students’ creative problem solving performance in a Lego® robotics course. In Learning by Playing. Game-based Education System Design and Development: 4th International Conference on E-Learning and Games, Edutainment 2009, Banff, Canada, August 9–11, 2009. Proceedings 4 (pp. 501–505). Springer Berlin Heidelberg.
Liu, E. Z. F. (2010). Early adolescents’ perceptions of educational robots and learning of robotics. British Journal of Educational Technology,41(3), 44–48. https://doi.org/10.1111/j.1467-8535.2009.00944.x
Malone, T. W. (1981). Toward a theory of intrinsically motivating instruction. Cognitive Science,5(4), 333–369.
Master, A., Cheryan, S., Moscatelli, A., & Meltzoff, A. N. (2017). Programming experience promotes higher STEM motivation among first-grade girls. Journal of Experimental Child Psychology,160, 92–106.
McWhorter, W. I. (2008). The effectiveness of using LEGO Mindstorms robotics activities to influence self-regulated learning in a university introductory computer programming course. University of North Texas.
Mohd, N., Mahmood, T. F. P. T., & Ismail, M. N. (2011). Factors that influence students in mathematics achievement. International Journal of Academic Research,3(3), 49–54.
Molaee, Z., & Dortaj, F. (2015). Improving L2 learning: An ARCS instructional-motivational approach. Procedia - Social and Behavioral Sciences,171, 1214–1222. https://doi.org/10.1016/j.sbspro.2015.01.234
NGSS Lead States. (2013). Next generation science standards: For states, by states. The National Academies Press.
Nicolaidou, M., & Philippou, G. (2003). Attitudes towards mathematics, self-efficacy and achievement in problem solving. European Research in Mathematics Education III, 1(11).
Noh, J., & Lee, J. (2020). Effects of robotics programming on the computational thinking and creativity of elementary school students. Educational Technology Research and Development,68, 463–484.
Ntourou, V., Kalogiannakis, M., & Psycharis, S. (2021). A study of the impact of arduino and visual programming in self-efficacy, motivation, computational thinking and 5th grade students’ perceptions on electricity. Eurasia Journal of Mathematics, Science and Technology Education,17(5), 1–11. https://doi.org/10.29333/ejmste/10842
OECD. (2016). Skills for a digital world. Organisation for Economic Co-operation and Development. https://www.oecd.org/employment/emp/Skills-for-a-Digital-World.pdf. Accessed 14 Aug 2023.
Okita, S. Y. (2014). The relative merits of transparency: Investigating situations that support the use of robotics in developing student learning adaptability across virtual and physical computing platforms. British Journal of Educational Technology,45(5), 844–862.
Ouyang, F., & Xu, W. (2024). The effects of educational robotics in STEM education: A multilevel meta-analysis. International Journal of STEM Education, 11(1). https://doi.org/10.1186/s40594-024-00469-4
Pajares, F., & Schunk, D. (2001). The development of academic self-efficacy. In A. Wigfield & J. Eccles (Eds.), Development of Achievement Motivation (pp. 16–32). United States: Vol. 1446, 2004.
Papastergiou, M. (2009). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education,52(1), 1–12. https://doi.org/10.1016/j.compedu.2008.06.004
Papert, S. (1980). Mindstorms: Children, computers and powerful ideas. In New Ideas in Psychology (Vol. 1). https://doi.org/10.1016/0732-118X(83)90034-X.
Piaget, J. (1973). To understand is to invent: the future of education (G. Roberts, Trans.). Grossman Publishers, A Division of the Viking Press 148.
Przybylla, M., & Romeike, R. (2014). Overcoming Issues with Students’ Perceptions of Informatics in Everyday Life and Education with Physical Computing. In Local Proceeding of the 7th International Conference on Informatics in Schools: Situation, Evolution and Perspectives ISSEP 2014.
Reich-Stiebert, N., & Eyssel, F. (2015). Learning with educational companion robots? Toward attitudes on education robots, predictors of attitudes, and application potentials for education robots. International Journal of Social Robotics,7(5), 875–888. https://doi.org/10.1007/s12369-015-0308-9
Resnick, M. (2013). Learn to code, code to learn. EdSurge.
Resnick, M., Kafai, Y., & Maeda, J. (2003). A networked, media-rich programming environment to enhance technological fluency at after-school centers in economically-disadvantaged communities. National Science Foundation (Information Technology Research), 1–14.
Ribeiro, C., Costa, M. F. M., & Rocha, M. (2008). A study of educational robotics in elementary schools. In Proceedings of the 4th International Conference on Hands-on Science: Development Diversity and Inclusion in Science Education (pp. 580–595).
Rogers, C., & Portsmore, M. (2004). Bringing engineering to elementary school. Journal of STEM Education,5(3), 17–29.
Rubio, M., Hierro, C., & Pablo, Á. (2013). Using arduino to enhance computer programming courses in science and engineering. Proceedings of the EDULEARN13, 72(July), 5127–5133.
Ruf, A., Mühling, A., & Hubwieser, P. (2014). Scratch vs. Karel - impact on learning outcomes and motivation. ACM International Conference Proceeding Series, 50–59. https://doi.org/10.1145/2670757.2670772.
Rusk, N., Resnick, M., Berg, R., & Pezalla-Granlund, M. (2008). New pathways into robotics: Strategies for broadening participation. Journal of Science Education and Technology,17(1), 59–69. https://doi.org/10.1007/s10956-007-9082-2
Sáez López, J. M., Buceta Otero, R., & De Lara García-Cervigón, S. (2020). Introducing robotics and block programming in elementary education. RIED. Revista Iberoamericana de Educación a Distancia,24(1), 95. https://doi.org/10.5944/ried.24.1.27649
Saleiro, M., Carmo, B., Rodrigues, J. M., & du Buf, J. H. (2013). A low-cost classroom-oriented educational robotics system. In Social Robotics: 5th International Conference, ICSR 2013, Bristol, UK, October 27–29, 2013, Proceedings 5 (pp. 74–83). Springer International Publishing.
Sapounidis, T., Tselegkaridis, S., & Stamovlasis, D. (2023). Educational robotics and STEM in primary education: A review and a meta-analysis. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2022.2160394
Settle, A., & Perkovic, L. (2010). Computational thinking across the curriculum: A conceptual framework.
Shin, S., Park, P., & Bae, Y. (2013). The effects of an information-technology gifted program on friendship using scratch programming language and clutter. International Journal of Computer and Communication Engineering,2(3), 246–249. https://doi.org/10.7763/IJCCE.2013.V2.181
Sisman, B., & Kucuk, S. (2018). A validity and reliability study of the Turkish robotics attitude scale for secondary school students. Ege Eğitim Dergisi, July, 262–283. https://doi.org/10.12984/egeefd.414091.
Sisman, B., Kucuk, S., & Yaman, Y. (2021). The effects of robotics training on children ’ s spatial ability and attitude toward STEM. International Journal of Social Robotics,13(2), 379–389. https://doi.org/10.1007/s12369-020-00646-9
Somyurek, S. (2015). An effective educational tool: Construction kits for fun and meaningful learning. International Journal of Technology and Design Education,25(1), 25–41. https://doi.org/10.1007/s10798-014-9272-1
Stewart, W. H., Baek, Y., Kwid, G., & Taylor, K. (2021). Exploring factors that influence computational thinking skills in elementary students’ collaborative robotics. Journal of Educational Computing Research,59(6), 1208–1239. https://doi.org/10.1177/0735633121992479
Strawhacker, A., & Bers, M. U. (2015). “I want my robot to look for food”: Comparing kindergartner’s programming comprehension using tangible, graphic, and hybrid user interfaces. International Journal of Technology and Design Education, 25(3), 293–319. https://doi.org/10.1007/s10798-014-9287-7
Sullivan, A., & Bers, M. U. (2018). Investigating the use of robotics to increase girls ’ interest in engineering during early elementary school. International Journal of Technology and Design Education,29(5), 1033–1051. https://doi.org/10.1007/s10798-018-9483-y
Sun, L., & Zhou, D. (2023). Effective instruction conditions for educational robotics to develop programming ability of K-12 students: A meta-analysis. Journal of Computer Assisted Learning,39(2), 380–398.
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (Allyn & Bacon (Ed.); 7th ed.). Pearson Education.
Tay, B., & Akyürek Tay, B. (2004). The effects of attitude on success in social sciences courses. Türk Eğitim Bilimleri Dergisi,4(1), 73–84.
Tlili, A., Essalmi, F., Jemni, M., & Kinshuk. (2017). Towards applying Keller’s ARCS model and learning by doing strategy in classroom courses. In Lecture Notes in Educational Technology (pp. 189–198). https://doi.org/10.1007/978-981-10-2419-1_26.
Todorovska, K., & Bogdanova, A. M. (2020). Educational robots in preschool education. 17th International Conference on Informatics and Information Technologies - CIIT 2020, 17–19.
Wang, M. T., & Degol, J. L. (2017). Gender Gap in Science, Technology, Engineering, and Mathematics (STEM): Current Knowledge, Implications for Practice, Policy, and Future Directions. In Educational Psychology Review (Vol. 29, Issue 1, pp. 119–140). Educational Psychology Review. https://doi.org/10.1007/s10648-015-9355-x.
Wei, C. W., Hung, I. C., Lee, L., & Chen, N. S. (2011). A joyful classroom learning system with robot learning companion for children to learn mathematics multiplication. Turkish Online Journal of Educational Technology,10(2), 11–23.
Welch, A. G. (2010). Using the TOSRA to assess high school students’ attitudes toward science after competing in the first robotics competition: An exploratory study. Eurasia Journal of Mathematics, Science and Technology Education,6(3), 187–197. https://doi.org/10.12973/ejmste/75239
Wing, J. M. (2006). Computational thinking. 49(3), 1–3. https://doi.org/10.1145/1118178.1118215.
Wu, T. T., and Chen, J. M. (2021). Combining webduino programming with situated learning to promote computational thinking, motivation, and satisfaction among high school students. Journal of Educational Computing Research, 123.https://doi.org/10.1177/07356331211039961
Wu, S. Y., & Su, Y. S. (2021). Visual programming environments and computational thinking performance of fifth- and sixth-grade students. Journal of Educational Computing Research,59(6), 1075–1092.
Yadagiri, R. G., Krishnamoorthy, S. P., & Kapila, V. (2015). A blocks-based visual environment to teach robot-programming to k-12 students. 122nd ASEE Annual Conference & Exposition, 1–12. https://doi.org/10.18260/p.23358.
Yıldız, V. A., Baydaş, Ö., & Göktaş, Y. (2019). The ARCS motivation model: A content analysis of applied articles between the years1997–2018. Trakya Education Journal,9(4), 723–741. https://doi.org/10.24315/tred.520477
Yolcu, V., & Demirer, V. (2023). The effects of educational robotics in programming education on students’ programming success, computational thinking, and transfer of learning. Computer Applications in Engineering Education,31(6), 1633–1647. https://doi.org/10.1002/cae.22664
Zhang, Y., & Zhu, Y. (2022). Effects of educational robotics on the creativity and problem-solving skills of K-12 students: A meta-analysis. Educational Studies,00(00), 1–19. https://doi.org/10.1080/03055698.2022.2107873.
Zhang, Y., Luo, R., Zhu, Y., & Yin, Y. (2021). Educational robots improve K-12 students’ computational thinking and STEM attitudes: Systematic review. Journal of Educational Computing Research,59(7), 1450–1481. https://doi.org/10.1177/0735633120982944
Funding
Open access funding provided by the Scientific and Technological Research Council of Türkiye (TÜBİTAK). Scientific Research Project Coordination Unit of Istanbul University-Cerrahpaşa, Grant/Award Number: SDK-2018-27619 and SYL-2018-29217.
Author information
Authors and Affiliations
Contributions
Dr. Nuray Akman Selcuk is currently working at Behiye Dr. Nevhiz Işıl Anatolian High School as an Information Technologies teacher in Istanbul. She received Phd from Istanbul University Institution of Informatics. Her research interests are information technologies education, technology integration into K-12 education and educational robotics.
Dr. Sevda Kucuk is a professor doctor at the Department of Computer Education & Instructional Technology at Atatürk University. Her research interests are in the augmented reality technology, mobile learning, technology integration, educational robotics, teacher education, distance education, instructional design, instructional strategies, and research methods.
Dr. Burak Sisman is a researcher in the Department of Cognitive Robotics at Delft University of Technology in the Netherlands. His research focuses on educational robotics, STEM education, human-robot interaction, knowledge representation, and artificial intelligence. He has over 18 years of experience in teaching and research. He has conducted various research projects in these fields and has received several patents for his innovative work.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Selcuk, N.A., Kucuk, S. & Sisman, B. Does really educational robotics improve secondary school students’ course motivation, achievement and attitude?. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12773-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-024-12773-1