Abstract
Educational robotics (ER) has the potential to be a novel approach to teaching geohazards such as earthquakes at the college level. ER, which provides learners with problem-solving settings, requires proficiency in content knowledge and practical application to address ill-defined problems, challenging learners to master problem-solving strategies. Despite several efforts in the existing literature, it is necessary to scaffold the problem-solving strategies comprehensively. This qualitative study investigated the problem-solving strategies of nine pre-service science teachers aligned with a coding scheme containing problem-solving strategies not previously documented together. The participants were assigned to construct a methane gas detector with Tinkercad to mitigate post-earthquake explosion risks for rescue teams in an online robotics-integrated earthquake professional development (PD) course. Qualitative data, including artifacts, observations, and interviews, were analyzed using deductive coding. The results indicated that participants predominantly employed trial and error, expert opinion, and case-based reasoning. They rarely utilized heuristics and intuition and did not use capacity evaluation, prediction, or sketching strategies. Furthermore, the study synthesized different problem-solving strategies into a comprehensive framework, which was used as a coding scheme. This framework helps to clarify problem-solving mechanisms in an ER context, offering a structured approach.
Avoid common mistakes on your manuscript.
Introduction
Earthquakes may cause thousands of fatalities and widespread damage due to poorly constructed buildings and erroneous civil engineering practices. For instance, on 6 February 2023, a Turkey–Syria earthquake with a magnitude of 7.8 (with the maximum Mercalli intensity XII) struck the southeastern region of Turkey and the northern part of Syria, resulting in tens of thousands of fatalities, injuries, and the structural collapse of buildings (Naddaf, 2023). Likewise, in Indonesia, where earthquakes frequently strike, an earthquake occurred with a magnitude of 7.3, precisely in the Mentawai islands, on 25 April 2023, leading to a tsunami that damaged homes (Daryono, 2023).
The overall goal of science education is to assist students in comprehending natural phenomena such as earthquakes (NRC, 2012; OECD, 2023). Earthquakes are integral components of science curricula worldwide, and K-12 earthquake education conveys crucial scientific knowledge, including Earth’s structure, seismic causes, epicenter point determination, magnitude measurement, preparedness, and building safety (MoE, 2017, 2018, 2020, 2022). Research in earthquake education ranges from elementary to college level. Lower-grade studies emphasize students’ comprehension of earthquake causes and problem-solving skills, often using specialized teaching materials and games (Ardianto et al., 2019; Cifelli et al., 2019; English et al., 2017; Lownsbery & Flick, 2020; Novia et al., 2021; Tsai, 2001). Meanwhile, college-level research reveals the significance of innovative teaching methods, including earthquake machines and virtual laboratories, to deepen understanding and practical application of earthquake knowledge (Cavlazoglu & Stuessy, 2017; Kuester & Hutchinson, 2007; Novak et al., 2019).
Educational robotics (ER) enhances science education by improving comprehension of complex concepts such as gears, force, torque, and animal behavior (Barak & Assal, 2018; Barak & Zadok, 2009; Chambers et al., 2008; Cuperman & Verner, 2019). It also fosters creativity, spatial ability, computational thinking, and problem-solving skills (Cuperman & Verner, 2019; Fakaruddin et al., 2023; Jaipal-Jamani & Angeli, 2017; Julià & Antolí, 2016; Munoz-Repiso & Caballero-González, 2019). Additionally, ER benefits school attendance and teamwork (Kucuk & Sisman, 2017; Mac Iver & Mac Iver, 2019).
However, more research is needed on using ER, an emerging technology, for teaching earthquakes at the college level. Technology, such as ER, serves as an advantage to science education, especially on the topic of earthquakes (Auyelbek et al., 2022; Benitti, 2012; Sapounidis et al., 2023). Incorporating robotics with sensors and motors may enable learners to apply knowledge to real-world scenarios, improving their understanding of seismic phenomena and enhancing their learning experiences. Moreover, establishing well-defined problem-solving strategies tailored for educators within ER environments, including teachers and pre-service teachers, can promote professional development (PD) where teachers’ needs can be fulfilled. Well-defined problem-solving strategies can guide PD designers in creating an environment where teachers can not only learn science content and robotics knowledge but also integrate insights on how to handle problems based on ER with effective problem-solving strategies.
Teachers play an essential role in guiding students through well-designed ER-based challenges, often demanding subject matter expertise, and applying this knowledge into practice to address these problems. Therefore, the objective of this study is to reveal pre-service science teachers’ employed problem-solving strategies while engaging in a task involving the development of a gas detector used after an earthquake for rescue teams within an ER-based earthquake problem-solving setting.
In this study, we concentrate on the strategies employed by pre-service science teachers using ER in teaching about earthquakes. We ask the following research question:
What problem-solving strategies are employed by pre-service science teachers when engaged in an ER-based problem related to earthquakes, precisely, developing a gas detection device using Tinkercad?
Literature Review
To address the research questions comprehensively, we have examined existing literature in three distinct areas: teaching about earthquakes, ER, and problem-solving strategies.
Teaching about Earthquakes
Teaching and learning about geohazards, such as earthquakes, has become a prominent issue in science education. This content is incorporated into the curricula of various countries, including Finland (MoE, 2017), Singapore (MoE, 2020), the USA (NRC, 2012), and Turkey (MoE, 2018), reflecting its importance and widespread recognition. These topics also align with several educational frameworks, including the Sustainable Development Goals, the science content domains in Earth Science within the trends in the International Mathematics and Science Study (TIMSS) assessment framework, and the Programme for International Student Assessment (PISA) framework for assessing scientific literacy (OECD, 2023; TIMSS, 2023 Science Assessment Framework, 2021; Aydin & Ozcan, 2022). The knowledge of earthquakes in K-12 education encompasses essential scientific information, covering various aspects such as the structure of the Earth’s crust, the causes of seismic activity, defining epicenter points, methods for measuring magnitude and intensity, earthquake preparedness, and constructing earthquake-resistant buildings (Christopherson & Birkeland, 2018). Understanding these subjects equips learners with crucial scientific knowledge to better comprehend and respond to earthquakes.
Some studies concentrated on interventions to improve students’ understanding of earthquakes and disaster preparedness. For instance, English et al. (2017) focused on designing and constructing earthquake-resistant buildings to promote problem-solving approaches to an engineering-based problem of earthquakes. Cifelli et al. (2019) developed earthquake kits to test students’ knowledge of earthquakes at a university to enhance their understanding. Rany and Mundilarto (2021) utilized android-based earthquake disaster learning media to improve students’ problem-solving skills and disaster preparedness knowledge. Additionally, Novia et al. (2021) conducted laboratory experiments, challenging students to test earthquake-resistant buildings and promoting disaster literacy. Savasci (2011) also designed an activity for middle-grade students that aims to assist them in exploring potential factors that influence the extent of earthquake damage, including distance, strength, duration, ground composition, height, and structure of the buildings, and educate them about effective strategies to mitigate such damages.
For college-level students, Ardianto et al. (2019) adopted a series of engaging STEM activities that provided compelling evidence and practical experience. These activities included building an earthquake machine, defining the epicenter point, and constructing earthquake-resistant buildings using hands-on apparatus. The researchers concluded that these activities are suitable for teaching about the causes of earthquakes and tectonic movements and using technology to reduce the effects of natural hazards like earthquakes. Novak et al. (2019) designed an escape room activity for college students, engaging them in earthquake preparedness activities. This innovative setting and its activities provide opportunities to prepare for and prevent earthquakes. In secondary school teacher PD programs, Cavlazoglu and Stuessy (2017) found that conducting discussions about earthquake reports, engaging in interactive games related to seismic events, interpreting seismic data, measuring magnitude, and conducting shake table demonstrations improved teachers’ understanding of earthquake engineering and helped establish more precise connections between domain-specific scientific concepts. Moreover, Kuester and Hutchinson (2007) emphasized the importance of virtual reality-enriched web-based settings for observing, exploring, and comprehending complicated aspects of earthquake-related topics.
Considering the findings from earlier research (Ardianto et al., 2019; Cavlazoglu & Stuessy, 2017; Kuester & Hutchinson, 2007; Novak et al., 2019), it is evident that employing innovative and interactive teaching methods is crucial for effectively addressing earthquake education at the college level. The methods include developing earthquake machines, defining epicenter points, constructing earthquake-resistant buildings, designing escape rooms and games, interpreting seismic hazard maps, conducting magnitude measures, utilizing shake tables, and using virtual laboratories with Lego. These approaches contribute to a deeper understanding of earthquakes and earthquake preparedness, enabling students to apply this knowledge practically by solving problems related to the subject matter.
Educational Robotics
Robotics, the science of building robots, is a discipline in which engineering and computer science intersect to solve challenges in the human-made world (Michalec et al., 2021; Thring, 1966). ER is a teaching method that engages students in activities such as devising, constructing, and programming robots using popular robotics kits like Arduino, Lego, or Fischertechnik. Integrating ER into science education provides a unique problem-solving setting where students can autonomously apply scientific facts, concepts, or rules to real-life, authentic, and ill-defined problems or tasks (Chambers & Carbonaro, 2003). For instance, a typical ER task might involve constructing a Lego EV3 robot to model the behaviors of animals, such as snakes, and exploring how these behaviors contribute to survival (Cuperman & Verner, 2019).
ER aligns with constructivism, a learning theory emphasizing learners constructing new knowledge through their prior knowledge and experiences. By engaging in hands-on activities with robots, students actively participate in their learning process, leading to a deeper understanding of scientific facts, concepts, and rules (Barak & Zadok, 2009). Moreover, ER is grounded in constructionism, a concept proposed by Seymour Papert, which focuses on understanding the cognitive structure of learning by actively building knowledge structures through purposeful artifact production (Papert, 1993; Papert & Harel, 1991; Ucgul & Cagiltay, 2014).
During the past two decades, research has been conducted to examine the effects of robotics on learning outcomes. Some studies have focused on the role and impacts of ER in enhancing students’ knowledge acquisition. For instance, Chambers et al. (2008) explored the mechanical advantages of gears, while Barak and Zadok (2009) delved into concepts like force, friction force, torque, mass, and gravity. Barak and Assal (2018) investigated distance, velocity, and time relations, and Cuperman and Verner (2019) explored models of biological systems. Applying ER in science education enhances learners’ comprehension of subject matter and fosters mastery of essential knowledge (Benitti, 2012; Chambers & Carborano, 2003). This approach encourages learners to engage in more meaningful and authentic learning experiences with previously learned concepts, such as unit conversions, directions, and circle circumference (Somyürek, 2015). In addition, ER enhances creativity, spatial ability, computational thinking, self-efficacy, and analogical reasoning (Cuperman & Verner, 2019; Fakaruddin et al., 2023; Jaipal-Jamani & Angeli, 2017; Julia & Antoli, 2016; Munoz-Repiso & Caballero-González, 2019). For example, LEGO robotics improves problem-solving skills, and teachers play a vital role in linking problem-solving with ER (Zhang & Zhu, 2022). ER also boosts school attendance and teamwork skills when integrated into courses (Kucuk & Sisman, 2017; Mac Iver & Mac Iver, 2019).
Problem-solving Strategies in ER Settings
Problem-solving requires learners to apply their acquired knowledge, actively employ it, and master problem-solving strategies (Dewey, 1938; Gagne, 1965; OECD, 2023). These strategies encompass various approaches employed for resolving problems. Approaching a problem with the correct strategy, especially for ill-defined problems, assists learners in achieving better performance and accomplishing tasks efficiently (Jonassen, 2011; Watts, 1991). Thus, defining a problem-solving strategy for tackling issues to enhance learners’ problem-solving competencies is essential. Fraenkel and Wallen (2009) contend that the ways of knowing or problem-solving strategies people use comprise six components, including sensory experience, agreement with others, expert opinion, logic, and the scientific method.
Some studies (An et al., 2022; Barak & Zadok, 2009; Castledine & Chalmers, 2011) have explored students’ and teachers’ problem-solving strategies in an inductive way when engaged in ER tasks. Barak and Zadok (2009), for instance, assigned students to design a car capable of ascending an inclined plane, crafting a fishing rod, and creating a machine for propelling a ball, targeting junior high school students. They concluded that students tend to employ trial-and-error methods in the early phases of problem-solving. Subsequently, as they gain experience, they adopt other methods, including instinctive approaches and heuristics. These heuristics encompass techniques such as Scamper and Triz, eliminating a component, assigning a new function, and systematically examining. Another example is provided by Castledine and Chalmers (2011), who exposed sixth-grade students to challenges involving racing and navigating mazes using Lego robotics tools. They asserted that students could use problem-solving strategies like predicting and even trial-and-error techniques in real-world situations. Additionally, An et al. (2022) documented that teachers employed and refined strategies such as case-based reasoning, sketches, trial and error, and capacity evaluation through open-ended robotics projects. We also incorporated a well-known problem-solving method described by Fraenkel and Wallen (2009) as a way of knowing, called “expert opinion.” This approach involves consulting an expert to solve the problem.
We have compiled the aforementioned strategies derived from the existing literature into a table with descriptions, and we have provided them in Table 1.
While there have been studies on problem-solving strategies in ER settings (An et al., 2022; Barak & Zadok, 2009; Castledine & Chalmers, 2011), relatively few of these scaffold problem-solving strategies tailored to ER tasks. Some studies have defined these strategies based on data analysis in an inductive way. For example, An et al. (2022) identified strategies such as case-based reasoning, sketching, and trial and error, using thematic analysis to identify patterns in how teachers utilize problem-solving strategies. Another study by Barak and Zadok (2009) did not employ a predefined coding scheme to identify problem-solving strategies. Instead, they developed codes and categories to outline strategies involving trial and error and heuristics.
Moreover, several other studies have also explored problem-solving skills, including those by Hussain et al. (2006), Norton et al. (2007), Dorotea et al. (2021), and Zhang and Zhu (2022). These skills involve mastering strategies for solving ER problems and acquiring content knowledge in areas such as earthquake science and robotics. The existing literature has predominantly focused on problem-solving skills, concluding that environments enriched by ER enhance these skills. However, the root cause of this improvement—whether it stems from mastering problem-solving strategies or from acquiring content knowledge—remains uncertain.
There needs to be more research exploring the impacts of ER on teaching earthquake concepts at the college level. ER is an emerging technology and can be an effective teaching tool in earthquake education at the college level. It offers broader possibilities for activities by incorporating sensors and motors (Benitti, 2012; Sapounidis et al., 2023). For instance, during teaching rescue operations after an earthquake, ER can be used to construct gas detectors or implement early earthquake warning systems, aiding learners in comprehending how subject matter knowledge can be practically applied to solve authentic earthquake-related problems. By integrating ER into earthquake education, educators may enhance learning experiences and foster students’ accurate understanding of seismic phenomena.
Methodology
Participants
The current study’s participants comprised a cohort of nine pre-service science teachers in multiple universities across Turkey, all females aged between 19 and 22. Among them, six were sophomores, while the remaining three were juniors. This study was conducted during the summer break in 2023 as they engaged in an online PD course in which they were assigned to complete several ER-based problem-solving tasks. The PD course was offered as an extracurricular activity. All participants volunteered to take part in the study. None of them had previous experience in ER courses, and neither had they undergone any programming training as part of their pre-service science education curriculum.
PD Context as Procedure
A 48-h PD course was designed to empower pre-service science teachers with essential knowledge and skills in earthquakes and robotics, enabling them to integrate this expertise into problem settings based on ER effectively. We utilized Conner and Clawson’s (2009) suggestions to design effective PD settings. This process involved identifying goals aligned with the specific needs, selecting appropriate content, and determining teaching methods such as expository teaching, workshops, collaboration, instructor quality, workshop duration, theoretical components, interaction, and ensuring feedback. We incorporated technology to enhance content access, provided rich and up-to-date materials, and established metrics for participant assessment in the PD. The PD content covered the structure of the earth, earthquake mechanisms, measuring and interpreting earthquake magnitude, scales, and precautions during, before, and after earthquakes. We thought about the earthquake and robotics content theoretically, followed by activities where the participants were assigned tasks related to ER. The instructors, who were professors, covered topics such as earth structure, earthquake mechanisms, rescue team operations, and robotics. They provided feedback on tasks and task presentations and then evaluated participants’ problem-solving strategies.
The course lasted 6 days, featuring 8 h of daily instruction and problem-solving activities. The PD course was conducted online through Zoom, and professors studying geology, earthquake engineering, civil engineering, and computer science introduced the core knowledge integral to course components. As seen in Table 2, the course had three sections each lasting 2 days:
The initial section of the course (16 h), covering the first and second days, was dedicated to teaching earthquakes. This section covered a comprehensive range of topics, including the Earth’s structure, mechanisms of earthquakes, earthquake-resistant building designs, and considerations surrounding search and rescue team operations following an earthquake, including searching for survivors by listening for voices, employing trained rescue dogs and specialized equipment, implementing gas detectors before commencing drilling in debris, making informed decisions regarding when to conclude operations, and efficiently managing debris removal. The topics were covered through the lecture method, wherein professors employed it to present the main ideas related to the critical factors for the central concept of the earthquake.
The second section (16 h), encompassing the third and fourth days of the course, involved robotics knowledge, exploring the definitions of robots and robotics, ER kits such as Arduino, and the intricate process of constructing robots involving electronic components like sensors and motors. Participants engaged extensively with electrical circuit design and block-based coding exercises on Tinkercad for their studies, transitioning virtual designs into tangible constructions. Tinkercad is an open-source and web-based application software. It also encompasses an Arduino simulator, allowing users to craft and program Arduino-controlled robots.
Participants engaged in two exercises as practice tasks and completed two primary tasks during the fifth and sixth days, referred to as the third section (16 h) with Tinkercad. This section allowed participants to create and assess electronic components, such as circuits, within an online environment, enabling them to share their work and seek guidance on the artifacts they produced. The initial practice task (Task 1) entailed designing a robot equipped with a moisture sensor to water a plant as required. The second practice (Task 2) focused on fish monitoring, enabling users to observe changes occurring in the water environment where goldfish reside. This monitoring aids living organisms in adapting to shifts in environmental conditions. These tasks were given to the participants so they were familiar with solving the primary tasks, Task 3 and Task 4, respectively.
Task 3 involved designing and programming an earthquake early warning system using Tinkercad. Figure 1a illuminates the task of detecting vibrations by P waves during an earthquake to provide protection and alert individuals about the destructive impact of S waves. Figure 1b also illustrates one of the participants’ devised machines on Tinkercad on Zoom.
Task 4 encompasses creating and programming a methane gas detection device for rescue teams after an earthquake using Tinkercad. Figure 2a illustrates a task dealing with Task 4, and Fig. 2b shows one of the methane gas detection devices using Tinkercad, aimed at assisting rescue teams in mitigating the risk of gas-related explosions following an earthquake.
Each participant delivered their presentation, followed by a discussion aimed at providing feedback on the systems presented. These tasks were assigned individually to participants, involving the design and coding of a robot, as outlined in the task description.
Data Sources
We gathered data from the third section of the PD course, explicitly focusing on Task 4, which pertains to earthquake-oriented problem-solving with an emphasis on ER.
Artifacts generated by the participants after completing their assignments were gathered. Artifacts included virtual gas detection devices designed by participants for Task 4 on Tinkercad’s official website. Each participant had an account on the website to manage their artifacts.
Observations were conducted during the presentation of Task 4 on Zoom. These observations included the participants’ presentations on their artifacts and a comprehensive examination of the construction and programming they were assigned, along with feedback from computer scientists and science educators. All presentations were recorded both on Zoom and Google Drive. Throughout the presentations, instructors posed probing questions to gain insight into the gas detectors, such as: (1) What type of gas is typically used in a gas detector?, (2) Can you explain the functioning of a gas detector?, and (3) Please provide an in-depth explanation of your construction and programming choices. We asked these questions to gain deeper insight into the construction and programming of the artifacts and understand the reasons behind their solutions to Task 4.
Interviews were conducted following the presentations to delve into the participants’ reflections on their problem-solving approaches during the task. Interviews focused on how they solved the problem and the rationale behind their choices, including the factors influencing their strategy selection. We utilized interviews since we had already engaged participants in a task, making it convenient for us to inquire about their artifact design, preferences, and the process they used to construct the artifact on the Zoom platform. Structured interviews were employed to elicit information about participants’ strategies when addressing the development of a gas detector problem. Initially, 16 questions were prepared to examine the expertise, but the final version of the interview protocol comprised 12 questions.
Data Analysis
The validation of a data source designed to measure problem-solving strategies begins with a thorough check to ensure alignment with the necessary approach for measuring these strategies. Problem-solving strategies can be measured through various methods, including think-aloud protocols, observations, self-reflection, performance-based tasks, or interviews (Jonassen, 2011).
The validation of these interview questions followed the recommendations of Yin (2003) and Fraenkel and Wallen (2009). This process included aligning the research question with the interview questions. The validation was carried out by two science educators and a computer scientist, all experienced in the tasks as instructors.
Additionally, a pilot study was conducted with a participant, although data collection was unsuccessful due to accessibility constraints. Following the pilot study, revisions were made to the interview questions to enhance their quality. This interview, conducted in accordance with a predefined interview protocol based on Creswell (2013) (see Appendix 1), lasted a minimum of 30 min each and was carried out individually online after the completion of the course.
The qualitative data gathered through artifacts as programming sheets on Tinkercad, artifact presentations as observations, and interviews were analyzed together, following the Data Analysis Spiral proposed by Creswell (2013). The analysis procedure encompasses steps such as data transcription, organization, reading and memoing, data categorization into codes and themes, and visualization of the results. Additionally, inter-rater reliability is evaluated to ensure consensus among multiple coders. Inter-rater reliability assesses the extent of agreement or consistency among coders in evaluating identical data (Miles & Huberman, 1994). The acceptable level of inter-rater reliability typically falls within the 75 to 90% range (Hartman, 1977).
Two researchers studied together in the data analysis. Initially, artifacts, video from the presentations as observation data, and audio files from the interviews dedicated to unveiling problem-solving strategies were imported into NVivo software for analyzing data. Deductive coding was employed during the data analysis. We developed a coding scheme (see Table 1) to investigate the problem-solving strategies of pre-service teachers deductively. The coding scheme is derived from previous research on learners’ problem-solving in an ER-based problem-solving setting. Both coders randomly selected five sources to ensure reliability and subsequently coded participants for Task 4, dealing with creating a gas detector. The initial inter-rater reliability was calculated at 84.30%. Any discrepancies were resolved through discussions, leading to a consensus. The entire dataset was then independently recorded, resulting in an inter-rater reliability of 90%. The names of the participants serve pseudonymously.
Results
This section details the problem-solving strategies employed, their distribution (see Table 3), and excerpts from participants’ artifacts. It also includes the introduction of the artifacts during the presentation as well as observational data and interviews conducted.
Participants did not utilize three of the eight strategies: capacity evaluation, predictions, and sketches. No drawings were made, whether considering the minimum or maximum levels, to represent limitations. Furthermore, the prediction strategy was considered unsuitable for devising the gas detection device; hence, they chose not to employ it (see Table 3). Trial and error, which is the most commonly used strategy, is a decision-making or problem-solving method in which participants decide on a solution to a problem encountered while solving Task 4 intuitively. They then tested this solution to see if it worked. If not, they reviewed their decision, made the necessary corrections, and tried again. If the solution was successful, they continued working on Task 4; otherwise, they made another intuitive decision and entered into a cycle of trial and error. For instance, during her interview, Ela explained how she determined a gas detector’s minimum and maximum measurement levels through trial and error. She observed that using a 1 k-ohm resistor resulted in readings ranging from a minimum of 85 to a maximum of 350. However, when she switched to a 10 k-ohm resistor, the readings changed, showing a minimum of 487 and a maximum of 869.
Another example comes from Sumay, who used this strategy to solve a problem while testing her device. She explained how to use trial and error during her follow-up interview, as exemplified by the following quotes:
Sumay: My device can detect gas levels between 87 and 307. If the level drops below 87, an LED turns on. If it exceeds 307, a buzzer sounds, indicating that the gas level is dangerously high... After developing the gas detector, I simulated it in Tinkercad. However, the LED lights did not turn on, although the buzzer worked. I wondered what could be wrong. I first thought to check the LED cables, but they seemed fine. Then, I checked all the cables and connections. Eventually, I realized I had connected the resistor’s edge to the wrong pin. After correcting this and plugging it into the right place, everything worked as expected. (The interview)
Expert opinion, a strategy nearly as preferred as trial and error, involves consulting specialists to tackle challenges encountered in the problem-solving process. The majority of participants required assistance from computer scientists when they encountered difficulties, especially in tasks such as establishing cable connections or coding, which were necessary to activate an LED light or a piezo buzzer. Another aspect of this strategy is using the Internet to pose specific questions, such as, “How did you determine the type of gas detected by your device?” “What concentration of this gas in the air constitutes an explosion hazard?” “Where did you obtain this precise information?” “What constitutes the threshold point for your vehicle?” “On what basis did you choose this point?” The following quotes contain explanations from Sude’s interview:
Sude: Before designing the detector, I researched the gas type and its threshold points on the internet. I found that it should be between %12.5 - %75. I then defined three tiers with two threshold points...During the designing phase, I tested it, but it did not work. I rechecked it, but it still did not work. I consulted the computer scientist for assistance; then he identified a mistake in the cable connections. After fixing the issue, it started working correctly. (The interview)
Case-based reasoning is one of the most preferred strategies. It encompasses employing a similar approach to one encountered previously to solve a problem. The participants were assigned to Task 4 after completing Task 1, Task 2, and Task 3. Task 1 requires participants to use an algorithm with one threshold point, a two-tier algorithm. In contrast, participants need to use a three-tier algorithm with two threshold points for Task 2 and Task 3. These tasks have three intervals, each requiring specific reactions.
Most participants adopted an algorithm in Task 4 that utilizes a two-tier hierarchy, similar to the one used in Task 1. The participants utilized a two-tier algorithm employed in Task 1, which involves designing a plant watering system where, if the soil moisture value drops below a specific threshold, the system is triggered to release water to the plant. If the moisture value exceeds the threshold, the system closes the tap, preventing the release of water to the plant. For Task 4, the participants employed nearly identical logic to solve the problem. For example, the following quotes highlight the characteristics of this strategy, as illustrated in an interview with Elif and the presentation she delivered (see Fig. 3). It features a threshold point, below and above which the device triggers different responses.
Elif: I used an algorithm where no warning mechanism is activated when the value falls below 100. The piezo begins to function and an LED lights up once the value reaches the threshold of 100, with a minimum value set at 85 and a maximum at 375. (The interview)
Some participants used three-tier algorithms similar to those in Task 2 and Task 3. Task 2 incorporates a monitoring system to maintain a predefined temperature for a goldfish. The task encompasses two threshold points, each prompting distinct reactions: below the minimum value, between the minimum and maximum values, and exceeding the maximum value. Two participants utilized Task 2 as a reference case, resulting in algorithms that exhibit similarities to it. The exertion from Sude’s presentation described a three-tier algorithm with two threshold points, as seen in Fig. 4.
Sude stated in the interview that below 85, no alert is triggered. The LCD light is activated within the range of 85 to 150. Beyond 150, the light and the piezo are initiated simultaneously, with the threshold value set at 150. The participants used an algorithm similar to the ones in Task 2 and Task 3.
The heuristic approach was employed by five participants. They investigated threshold points and struggled to incorporate them into the device; however, they refrained from making any conversions. They employed the values exactly as they appeared in the actual readings. For instance, Ela found that the danger level arises between 50 and 70%, with 70% marking the threshold point for a potential gas explosion. These points were then integrated into the design as 50 and 70% (see Fig. 5a). When asked about the rationale behind these values, she responded, “I attempted to incorporate scientific knowledge into the design, but it was ineffective.” However, Ela overlooked that the gas detector’s operational range was between 85 and 375, placing her selected values outside this interval, resulting in the device not functioning as intended. To determine the corresponding values, she should have applied the following formula: ((375 − 85) / 100) × 50, yielding 145 for the minimum, and ((375 − 85) / 100) × 70, yielding 205 for the maximum. However, Ela did not employ these calculations; instead, she used the criterion that gas values below 200 would activate the piezo, and those above 200 would trigger the LED (see Fig. 5b). This value was chosen intrinsically, and as it turns out, the device functioned as intended.
Two of the nine participants utilized preliminary threshold points without relying on explicit knowledge; instead, they intuitively defined these points, and this way was called intuition. For example, during the artifact presentations, when questioned about the rationale behind selecting the value 200, Burcak explained, “I established the threshold value as 200 based on personal judgment, lacking any specific criteria. I tried it, and it worked.”
Discussion and Conclusions
This study aims to uncover preservice science teachers’ problem-solving strategies when assigned to create a post-earthquake gas detector for rescue teams within a PD course.
Previous research on teaching earthquakes with college students, e.g., Ardianto et al. (2019) or Kuester and Hutchinson (2007) examined various methods, such as STEM activities or virtual reality, and tools within courses in PD settings. In this present study, the primary objective of PD was to offer preservice science teachers a chance to integrate ER into their understanding of earthquakes. This integration was then applied practically through a specific gas detection task.
The study demonstrates that almost all participants successfully completed the task involving creating a gas detector through Tinkercad. They built the detector and explained its functionality, incorporating both their science and robotics knowledge. This would be interpreted as a positive outcome for using ER as a tool for teaching earthquakes. Existing research that explores the incorporation of ER into science education has identified evidence that employing ER enables teaching concepts such as simple machines (An et al., 2022), force and speed (Fakaruddin et al., 2023), reaching food resources (Fridberg et al., 2022), and titration for high school chemistry laboratories (Verner & Revzin, 2017). Others leverage robotics as an effective environment for problem-solving, where learners can apply their scientific knowledge, e.g., Jaipal-Jamani and Angeli (2017). This current study expanded our perspective by introducing a new concept, “earthquake,” to the existing literature on utilizing ER in science education.
Prior investigations into the realm of ER within science education have yielded conclusions centered on problem-solving skills (Barak & Zadok, 2009; Castledine & Chalmers, 2011). Researchers have emphasized that effective problem-solving demands abilities that extend beyond mere knowledge acquisition; these abilities encompass understanding strategies and their application. A few research studies have reported several problem-solving strategies separately within the existing literature. For instance, Barak and Zadok (2009) classified them as heuristics and trial and error. Building upon this foundation, the present study synthesized the problem-solving strategies into a comprehensive framework and used the framework as a coding scheme (see Table 1). This framework contributes to delineating problem-solving processes within the context of ER. Doing so offers a structured approach to defining and understanding problem-solving within the ER problem-solving environment.
As highlighted in the relevant studies on problem-solving strategies in ER settings by Castledine and Chalmers (2011), Barak and Zadok (2009), and An et al. (2022), this study has found that trial and error is the most preferred strategy among participants. Previous literature also concluded that students or teachers initially utilized trial and error, followed by heuristics. The participants in this study favored using case-based reasoning and expert opinions. Considering the problem-solving process, trial and error and case-based reasoning require using experience. It may stem from the participants’ intrinsic motivation, meaning they first attempt to solve the problems they encounter during ER situations. If unsuccessful, they then consult an expert or employ other heuristic methods.
A problem consists of an obstacle (a task) and an objective (Watts, 1991). Solving a problem also requires applying knowledge in new situations through mastering problem-solving skills, as highlighted by Dewey (1938), Jonassen (2011), and the OECD (2023). Although several studies, including those by Zhang and Zhu (2022), Dorotea et al. (2021), Norton et al. (2007), and Hussain et al. (2006), have explored problem-solving skills in ER settings, it is the strategies within this problem-solving process that reveal the foundation of this focus. Methods such as trial and error, case-based reasoning, and expert opinion could serve as catalysts for further enhancing problem-solving skills. Modifying these methods could also assist PD developers or teachers.
Implications for Future Studies
The study’s emphasis on integrating problem-solving strategies with ER in PD settings reveals several implications for future research and educational practices. The findings highlight the potential applications of ER in science education and underscore the significance of problem-solving strategies.
The first implication concerns PD designers: problem-solving strategies should be considered in courses that extend beyond science and robotics content knowledge. Moreover, case-based reasoning represents a problem-solving approach in which participants apply experienced methods within the course. Therefore, PD designers must carefully select tasks in the PD course to ensure problems are solved effectively.
For researchers, the connection between problem-solving skills in ER settings and broader problem-solving capabilities warrants further exploration. Drawing includes the actual connections between skills, and problem-solving methods are recommended. We recommend this coding scheme for researchers aiming to construct an instrument to measure problem-solving strategies in ER settings. We developed and applied this coding scheme in our study, which suggests that there was only one code/strategy, namely expert opinion, in ER settings. This could serve as evidence that the strategies were effectively scaffolded and could be utilized in subsequent studies.
Availability of Data and Materials
The current study’s dataset generated and analyzed is not publicly available due to the fact that the dataset constitutes an excerpt of research in progress but is available from the corresponding author on reasonable request.
References
An, H., Sung, W., & Yoon, S. Y. (2022). Implementation of learning by design in a synchronized online environment to teach educational robotics to inservice teachers. Education Technology Research and Development, 70, 1473–1496. https://doi.org/10.1007/s11423-022-10134-8
Ardianto, D., Permanasari, A., Firman, H., & Ramalis, T.R. (2019). Analyzing higher education students’ understanding of earthquake-resistant buildings on stem learning. Journal of Engineering Science and Technology, Special Issue on AASEC2018, 47–57.
Auyelbek, M., Ybyraimzhanov, K., Andasbayev, E., Abdykerimova, E., & Turkmenbayev, A. (2022). Analysis of studies in the literature on educational robotics. Journal of Turkish Science Education, 19(4), 1267–1290.
Aydin, M., & Ozcan, I. (2022). Evaluating the content accuracy of augmented reality applications on the Solar System. Physics Education, 57(3), 035009. https://doi.org/10.1088/1361-6552/ac50a4
Barak, M., & Assal, M. (2018). Robotics and STEM learning: Students’ achievements in assignments according to the P3 task taxonomy—practice, problem solving, and projects. International Journal of Technology and Design Education, 28(1), 121–144. https://doi.org/10.1007/s10798-016-9385-9
Barak, M., & Zadok, Y. (2009). Robotics projects and learning concepts in science, technology and problem solving. International Journal of Technology and Design Education, 19(3), 289–307. https://doi.org/10.1007/s10798-007-9043-3
Benitti, F. B. V. (2012). Exploring the educational potential of robotics in schools: A systematic review. Computers and Education, 58(3), 978–988. https://doi.org/10.1016/j.compedu.2011.10.006
Castledine, A. R., & Chalmers, C. (2011). LEGO robotics: An authentic problem solving tool? Design and Technology Education, 16(3), 19–27.
Cavlazoglu, B., & Stuessy, C. L. (2017). Identifying and verifying earthquake engineering concepts to create a knowledge base in STEM education: A modified delphi study. International Journal of Education in Mathematics Science and Technology, 5(1), 40–52. https://doi.org/10.18404/ijemst.60674
Chambers, J. M., & Carbonaro, M. (2003). Designing, developing, and implementing a course on LEGO robotics for technology teacher education. Journal of Technology and Teacher Education, 11(2), 209–241. https://www.learntechlib.org/primary/p/14607/
Chambers, J. M., Carbonaro, M., & Murray, H. (2008). Developing conceptual understanding of mechanical advantage through the use of Lego robotic technology. Australasian Journal of Educational Technology, 24(4), 387–401. https://doi.org/10.14742/ajet.1199
Christopherson, R. W., & Birkeland, G. (2018). Geosystems: An introduction to physical geography. Pearson.
Cifelli, F., Basile, F., Carlucci, G., Funiciello, F., & Mattei, M. (2019). Sismo-Lab: An ASL project for the realization of an educational kit on earthquakes. Rendiconti Online Della Società Geologica Italiana, 49, 121–126. https://doi.org/10.3301/ROL.2019.61
Conner, M. L., & Clawson, J. G. (2009). Creating a learning culture strategy. Cambrigde University Press.
Creswell, J. W. (2013). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE Publications Inc.
Cuperman, D., & Verner, I. M. (2019). Fostering analogical reasoning through creating robotic models of biological systems. Journal of Science Education and Technology, 28(3), 1–14. https://doi.org/10.1007/s10956-018-9750-4
Daryono. (2023). Press Release Gempabumi Tektonik M7.3 Di Pantai Barat Sumatera, Kabupaten Kepulauan Mentawai, Berpotensi Tsunami. Retrieved December 9, 2023, from https://cdn.bmkg.go.id/Web/revPRESS-RELEASE-MENTAWAI-25-APRIL-2023-update.pdf
Dewey, J. (1938). Experience and education. The Kappa Delta Pi Lecture Series. Touchstone.
Dorotea, N., Piedade, J., & Pedro, A. (2021). Mapping K-12 computer science teacher’s interest, self-confidence, and knowledge about the use of educational robotics to teach. Education Sciences, 11(8), 443. https://doi.org/10.3390/educsci11080443
English, L. D., King, D., & Smeed, J. (2017). Advancing integrated STEM learning through engineering design: Sixth-grade students’ design and construction of earthquake resistant buildings. The Journal of Educational Research, 110(3), 255–271. https://doi.org/10.1080/00220671.2016.1264053
Fakaruddin, F. J., Shahali, E. H. M., & Saat, R. M. (2023). Creative thinking patterns in primary school students’ hands-on science activities involving robotics as learning tools. Asia Pacific Education Review. https://doi.org/10.1007/s12564-023-09825-5
Fraenkel, J., & Wallen, N. (2009). How to design and evaluate research in education. McGraw-Hill.
Fridberg, M., Redfors, A., Greca, I. M., & Terceño, E. M. G. (2022). Spanish and Swedish teachers’ perspective of teaching STEM and robotics in preschool – results from the botSTEM project. International Journal of Technology and Design Education, 33, 1–21. https://doi.org/10.1007/s10798-021-09717-y
Gagne, R. M. (1965). The conditions of learning. Holt Rinehart and Winston.
Hartman, D. P. (1977). Considerations in the choice of interobserver reliability estimates. Journal of Applied Behavior Analysis, 10, 103–116.
Hussain, S., Lindh, J., & Shukur, G. (2006). The effect of LEGO training on pupils’ school performance in mathematics, problem solving ability and attitude: Swedish data. Journal of Educational Technology & Society, 9(3), 182–194.
Jaipal-Jamani, K., & Angeli, C. (2017). Effect of robotics on elementary preservice teachers’ self-efficacy, science learning, and computational thinking. Journal of Science Education and Technology, 26(2), 175–192. https://doi.org/10.1007/s10956-016-9663-z
Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem solving learning environments. Routledge.
Julia, C., & Antoli, J. O. (2016). Spatial ability learning through educational robotics. International Journal of Technology and Design Education, 26(2), 185–203. https://doi.org/10.1007/s10798-015-9307-2
Kucuk, S., & Sisman, B. (2017). Behavioral patterns of elementary students and teachers in one-to-one robotics instruction. Computers & Education, 111, 31–43. https://doi.org/10.1016/j.compedu.2017.04.002
Kuester, F., & Hutchinson, T. C. (2007). A virtualized laboratory for earthquake engineering education. Computer Applications in Engineering Education, 15(1), 15–29. https://doi.org/10.1002/cae.20091
Lownsbery, D. S., & Flick, L. B. (2020). Examining middle school students’ knowledge and beliefs about earthquake and tsunami. Journal of Geoscience Education, 68(4), 311–323. https://doi.org/10.1080/10899995.2019.1707587
Mac Iver, M. A., & Mac Iver, D. J. (2019). “STEMming” the swell of absenteeism in the middle years: Impacts of an urban district summer robotics program. Urban Education, 54(1), 65–88. https://doi.org/10.1177/0042085915618712
Michalec, O., O’Donovan, C., & Sobhani, M. (2021). What is robotics made of? The interdisciplinary politics of robotics research. Humanities and Social Sciences Communications, 8, 65. https://doi.org/10.1057/s41599-021-00737-6
Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis. SAGE Publication.
MoE Indonesia. (2022). Learning outcomes in sciences and social subjects at the primary education level in the independent curriculum. BSKAP Publications. Retrieved December 14, 2023, from https://kurikulum.kemdikbud.go.id/file/cp/dasmen/13.%20CP%20IPAS.pdf
MoE Finland. (2017). Brochures Education, OKM. Retrieved 14 December 2023 from https://toolbox.finland.fi/wp-content/uploads/sites/2/2018/03/education_in_finland_2022.pdf
MoE Singapore. (2020). Education statistics digest 2020. Ministry of Education-Singapore. Retrieved December 14, 2023, from https://www.moe.gov.sg/-/media/files/about-us/moe-corporate-brochure.pdf
MoE Turkey. (2018). Science curriculum. MoNE Publications.
Munoz-Repiso, A. G. V., & Caballero-González, Y. A. (2019). Robotics to develop computational thinking in early childhood education. Comunicar, Media Education Research Journal, 27(59), 63–72. https://doi.org/10.3916/C59-2019-06
Naddaf, M. (2023). Turkey-Syria earthquake: What scientists know. News Explainer. Nature, 614, 398–399. https://doi.org/10.1038/d41586-023-00364-y
Norton, S. J., McRobbie, C. J., & Ginns, I. S. (2007). Problem solving in a middle school robotics design classroom. Research in Science Education, 37(3), 261–277. https://doi.org/10.1007/s11165-006-9025-6
Novak, J., Lozos, J. C., & Spear, S. E. (2019). Development of an interactive escape room intervention to educate college students about earthquake preparedness. Natural Hazards Review, 20(1), 06018001. https://doi.org/10.1061/(ASCE)NH.1527-6996.0000322
Novia, N., Riandi, R., Permanasari, A., Kaniawati, I., & Ardiyanto, D. (2021). Examining disaster literacy through modified earthquake laboratory experiment on STEM learning. Journal of Engineering Science and Technology, Special Issue on AASSEEEC2021, 81–88.
NRC [National Research Council]. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. The National Academy. https://doi.org/10.17226/13165
OECD. (2023). PISA 2022 Results (Volume I): The state of learning and equity in education. PISA, OECD Publishing, Paris,. https://doi.org/10.1787/53f23881-en
Papert, S., & Harel, I. (1991). Situating constructionism, constructionism. Ablex Publishing Corporation.
Papert, S. (1993). The children’s machine, rethınkıng school in the age of the computer. Basic Books.
Rany, T. D., & Mundilarto, M. (2021). Development of learning media for earthquake disaster through physics subjects to improve problem-solving ability and disaster preparedness. Jurnal Pendidikan Fisika Indonesia, 17(2), 106–114. https://doi.org/10.15294/jpfi.v17i2.27421
Sapounidis, T., Tselegkaridis, S., & Stamovlasis, D. (2023). Educational robotics and STEM in primary education: A review and a meta-analysis. Journal of Research on Technology in Education. https://doi.org/10.1080/15391523.2022.2160394
Savasci, F. (2011). Make an earthquake: Ground shaking! Science Activities: Classroom Projects and Curriculum Ideas, 48(2), 57–64.
Somyürek, S. (2015). An effective educational tool: Construction kits for fun and meaningful learning. International of Journal Technology and Design Education, 25(1), 25–41. https://doi.org/10.1007/s10798-014-9272-1
Thring, M. W. (1966). What is a robot? Nature, 210, 560. https://doi.org/10.1038/210560a0
TIMSS (2023), Science assessment framework. (2021). In I.V.S. Mullis, M. O. Martin, & M. von Davier (Eds.), TIMSS 2023 assessment frameworks (pp. 19–45). TIMSS & PIRLS International Study Center, Lynch School of Education and Human Development, Boston College and International Association for the Evaluation of Educational Achievement (IEA).
Tsai, C. C. (2001). Ideas about earthquakes after experiencing a natural disaster in Taiwan: An analysis of students’ worldviews. International Journal of Science Education, 23(10), 1007–1016. https://doi.org/10.1080/09500690010016085
Ucgul, M., & Cagiltay, K. (2014). Design and development issues for educational robotics training camps. International Journal of Technology Design Education, 24(2), 203–222. https://doi.org/10.1007/s10798-013-9253-9
Verner, I. M., & Revzin, L. B. (2017). Robotics in school chemistry laboratories. In: Munir, M., M., Wilfried, L., Gottfried, K., Richard, B. (Eds.) Robotics in education. Advances in intelligent systems and computing, 457, 127–136. https://doi.org/10.1007/978-3-319-42975-5_12
Watts, M. (1991). The science of problem-solving. Heinemann Educational Books.
Yin, R. K. (2003). Case study research: Design and methods. SAGE Publication.
Zhang, Y., & Zhu, Y. (2022). Effects of educational robotics on the creativity and problem-solving skills of K-12 students: A meta-analysis. Educational Studies. https://doi.org/10.1080/03055698.2022.2107873
Acknowledgements
An earlier version of this paper was presented, titled "Investigating Problem-solving Strategies of Pre-Service Science Teachers in an Online Earthquake Engineering-Oriented Educational Robotics Course," at the LUMAT Research Symposium on Friday, June 16, 2023. The presentation was held online by the University of Eastern Finland in Joensuu, Finland.
Funding
Open access funding provided by the Scientific and Technological Research Council of Türkiye (TÜBİTAK). The authors would like to thank the Scientific and Technological Research Council of Turkey, which provided a fund called 2237-A under grant number 1129B372300289. The other authors contributed to the paper equally. Both authors read and approved the final manuscript.
Author information
Authors and Affiliations
Contributions
Dr. Mirac Aydin (corresponding author) and Salih Cepni conceptualized and designed the study, led the data acquisition process, conducted the primary data analysis and interpretation, and played a pivotal role in drafting and revising the manuscript critically for important intellectual content. Dr. Aydin also ensured the accuracy and integrity of all parts of the work and agreed to the final approval of the version to be published.
Corresponding author
Ethics declarations
Ethical Approval
The authors confirm that all procedures performed in the study involving human participants were according to the 1964 Declaration of Helsinki and its later amendments or comparable ethical standards.
Informed Consent
The authors affirm that informed consent was obtained from all individual participants included in the study.
Statement Regarding Research Involving Human Participants and/or Animals
Not applicable.
Consent to Participate
Not applicable.
Consent to Publish
Not applicable.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Appendix 1
The Interview Protocol
![figure a](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs10956-024-10124-w/MediaObjects/10956_2024_10124_Figa_HTML.png)
![figure b](http://media.springernature.com/lw685/springer-static/image/art%3A10.1007%2Fs10956-024-10124-w/MediaObjects/10956_2024_10124_Figb_HTML.png)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Cepni, S., Aydin, M., Iryanti, M. et al. Scaffolding Pre-service Science Teachers’ Problem-Solving Strategies in a Methane Gas Detector Task Within an Earthquake-Robotics PD Course. J Sci Educ Technol (2024). https://doi.org/10.1007/s10956-024-10124-w
Accepted:
Published:
DOI: https://doi.org/10.1007/s10956-024-10124-w