Abstract
To explain successful subject matter learning with digital tools, the specification of mediating cognitive processes is crucial for any empirical investigation. We introduce a cognitive process framework for the mechanisms of learning with digital tools (CoDiL) that combines core ideas from the psychology of instruction (utilization-of-learning-opportunity framework), cognitive psychology (knowledge-learning-instruction framework), and domain-specific research on learning and instruction. This synthesizing framework can be used to theoretically ground, firstly, the design of digital tools for learning, and secondly, the empirical analysis of students’ learning activities in digitally enriched educational settings via the analysis of specific student-tool interactions.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Digital technologies have not yet fully realized their potential in education, although the findings of meta-analyses show that their implementation into the classroom can have a positive impact on student achievement (e.g., Chauhan, 2017; Higgins et al., 2019; Hillmayr et al., 2020; Q. Li & Ma, 2010; Moran et al., 2008; Tamim et al., 2011). It is commonly agreed upon that this impact on student achievement is not due to digital technology itself, but rather due to specific digitally enriched instructional features (e.g., adaptive feedback, prompting, scaffolding) implemented into those technologies and the specific use teachers and students make of these features (see the media debate, started by Clark, 1994; Kozma, 1994). Still, research often focuses on the effects of the mere presence of digital tools on learning outcomes (Kucirkova, 2014).
When inspecting the cause of such positive impact of digital tools in educational contexts, however, there may not be one single satisfactory answer (Hillmayr et al., 2020): not only does the term ‘digital tool’ encompass a broad variety of different types of software and hardware that can be used in very different ways, research also has demonstrated that different types of digital tools can have specific benefits (Chi & Wylie, 2014; Hillmayr et al., 2020; Koedinger et al., 2012; VanLehn, 2011). That is one reason why measuring learning outcomes of digitally enriched instruction (i.e., instruction that is enriched by digital technology) and comparing these to other types of instruction does not suffice to theoretically underpin the learning mechanisms at play when students utilize technology during learning.
Therefore, research on why learning with digital tools works should refer to theories on cognition during learning, should be specific about the assumed underlying learning activities which the digitally enriched instructional features implemented aim to enhance, and should account for the characteristics of the content. When analyzing such features of digitally enriched learning environments, it is worthwhile to consider that their positive effect on student learning may be rooted in very different psychological constructs. For example, while metacognitive scaffolds inside an online math tutor may help students regulate their learning, simulations inside a digital physics learning environment may guide students into reasoning about the physical phenomenon. Consequently, we suggest to focus not only on learning outcomes, but also on the specific effects of features implemented in digital tools on students’ learning activities and their variation with different learning contexts and content. To draw attention to this connection we use the term “(digitally enriched) instructional features” for a broad variety of different components and functionalities of software (such as, scaffolds, adaptive feedback, simulations of phenomena, prompts), designed and implemented to stimulate and aid learning activities.
In this paper, we present a framework which has the purpose of guiding theoretical analyses and empirical research that aim to explain learning in digitally enriched educational settings via instructional features and learning activities. For this, we draw on three frameworks or models which generally capture the structure and dynamics of learning in such settings. First, we refer to the knowledge-learning-instruction framework by Koedinger and colleagues (KLI; Koedinger et al., 2012) and elaborate how this framework is well suited to describe learning with digital tools by distinguishing between external instructional events and assessment events on the one hand, and internal learning processes and knowledge components on the other hand. Second, the SOI-Model (Selection-Organization-Integration) defines the internal cognitive core processes during learning (Mayer, 2014). According to the model, the learner actively constructs knowledge representations in the working memory using both incoming material from the environment and prior knowledge in the long-term memory. This active construction includes selection: identification of useful information, organization: understanding how the single information interact with each other, and integration: relating new information with prior knowledge. We further argue that an appropriate approach to capture learning should account for the systematic distinction between digitally enriched learning opportunities and students’ actual learning activities during their use—since these may vary substantially among students. Such an approach is described by so-called utilization-of-learning-opportunity frameworks from classroom research (ULO; Seidel, 2014; see also Brühwiler & Blatchford, 2011). ULO frameworks distinguish explicitly between potentially used learning opportunities on the one hand (e.g., educational settings that have the potential for cognitive activation—a core dimension of instructional quality representing offers of challenging tasks and stimulating ways of interacting with the subject matter and with the peers; see Praetorius et al., 2018) and actual student engagement on the other hand (i.e., the mental effort learners invest in genuine knowledge construction processes—germane processing; Sweller et al., 2019; see Nückles, 2021, for a discussion).
Since the perspectives of these frameworks appear highly relevant for empirically investigating and theoretically explaining learning in digitally enriched educational settings, we introduce the CoDiL framework—a Cognitive process framework on the Learning mechanisms of Digital tools in educational settings that incorporates both the core ideas of the KLI framework, and the ULO framework—i.e., core ideas from empirical classroom research, cognitive psychology, and subject-specific as well as content-specific education research (Fig. 1). For an analogous framework for composite instructional designs (i.e., instructional designs with multiple phases) see Loibl et al. (2023).
The CoDiL framework, a cognitive process framework on the learning mechanisms of digital tools in educational settings. The dashed separates the external situation and external behavior on the left, and the internal person characteristics and cognitive processes on the right. The structure of the utilization-of-learning opportunity framework (ULO) is represented by the dashed boxes. The structure of the knowledge-learning-instruction framework (KLI) is indicated by the three columns
In the context of the CoDiL framework, instruction is understood as a digitally enriched educational setting (see the “Acquiring Knowledge Components in (Digitally Enriched) Educational Settings” section), in which the used digital tools can be characterized by their implemented digitally enriched instructional features (see the “Digital Instruction—Instructional Features as Opportunities Stimulating Learning Activities” section). If utilized by the student these features (which offer learning opportunities) are considered to initiate and guide learning activities (see the “Learning Activities When Learning With Digital Tools” section). These learning activities have a behavioral side (i.e., external, and directly observable, e.g., interacting with the digital tool, solution formulation, or written self-explanations; see the “Evaluation—Linking Students’ On-Task Behavior and Learning” section) and a cognitive side (internal and latent, e.g., adaption, discrimination, or revision; see the “Learning Activities When Learning With Digital Tools” section). In interaction with prior knowledge—and mediated by cognitive processes (i.e., selecting, organizing, integrating)—the learning activities cause evolving knowledge during learning—leading to final knowledge at the end of the learning process.
By representing a high-level conceptual integration of different theories, the CoDiL framework serves to systematically describe (see the “Learning as Individual Content-Specific Cognitive Processes to Generate Knowledge” section), develop (see the “Development—Designing Digitally Enriched Educational Settings” section), and evaluate (see the “Evaluation—Linking Students’ On-Task Behavior and Learning” section) research on digitally enriched instruction: we show how it can be utilized to theoretically ground the design of digital tools for educational settings, why it is suitable to frame correlational or causal research endeavors, and how it can guide the evaluation of students’ learning activities in digitally enriched educational settings based on appropriate operationalizations of student-tool interactions. We exemplify the applicability of our framework by framing recent studies regarding the effect of learning with digital tools with regard to our framework.
Learning as Individual Content-Specific Cognitive Processes to Generate Knowledge
Acquiring Knowledge Components in (Digitally Enriched) Educational Settings
In line with established learning theories, we understand learning as an active, constructive, and content-specific cognitive process (Koedinger et al., 2012; Mayer, 2014). Consequently, a framework which aims at explaining learning should explicate on the one hand external, observable, and manipulable elements—e.g., instructional events and observable student-tool interactions—and on the other hand model internal and unobservable learning processes and learning outcomes—e.g., knowledge components (Koedinger et al., 2012; Yeo & Fazio, 2019).
Knowledge components are connected in multiple ways to other elements in the CoDiL framework. Similar to the construct of schemata (Schweppe & Rummer, 2014), Koedinger and colleagues (2012) “define a knowledge component … as an acquired unit of cognitive function or structure that can be inferred from performance on a set of related tasks” (p. 764). The knowledge components define the structure of the final knowledge, but they also specify the prior knowledge that can be activated during learning and the evolving knowledge (including incomplete or erroneous knowledge components) that develops throughout the learning process. Since the knowledge components available at any point in time influence the learning activities, a content-specific analysis of these knowledge components is a fundamental basis for understanding the learning mechanisms at play, and thus a fundamental basis for the design and development of any educational environment that aims to achieve this knowledge acquisition. In particular, we emphasize the argument that a subject-specific analysis of the content (as part of, e.g., adaptive control of thought-rational, Anderson et al., 1997; construction-integration model, Kintsch, 1991; cognitive modeling, Ritter et al., 2007) is relevant for the development of digitally enriched educational settings and the design of digital tools.
Consider, for example, students learning how to compare the size of fractions, such as 2/3 and 4/5. Here, decades of theoretical and empirical research draw a very clear picture of the prior knowledge (natural number concepts, the part-whole concept, and the concept of fraction equivalence; Post & Cramer, 1987) influencing the students’ proficiency, various faulty, or still evolving knowledge aspects (isolated comparisons of numerator or denominator as natural numbers in different forms; Gómez & Dartnell, 2019), and the final knowledge (repertoire of various correct comparison strategies; Clarke & Roche, 2009). These different knowledge components can be used to design an explanatory cognitive model of how students learn to compare fractions: given the influence of different kinds of prior knowledge, the pathway to a desirable change in knowledge may be very different for students who overgeneralize natural number concepts, or students who already have acquired the part-whole concept. Given such cognitive student models, content-specific educational settings (as opportunities for learning) can be designed to initiate and stimulate specific learning activities (“Learning Activities When Learning With Digital Tools” section) that may lead to the final knowledge.
In general, content-specific prior knowledge should be considered relevant when discussing educational settings (Kalyuga, 2007; Simonsmeier et al., 2022), since every learner has some domain-general prior experiences, domain-specific knowledge facets, or an attitude or interest toward the learning domain (Tobias, 1994). Prior knowledge is the key predictor of how information is selected, organized, and consequently, how evolving knowledge arises (Kalyuga, 2013 and Simonsmeier et al., 2022 for a meta-analysis). This evolving knowledge is further elaborated and consistently integrated into already existing knowledge structures (Mayer, 2014). Consequently, all knowledge components have to be carefully considered when discussing the learning process from the initial start of the learning phase and the individual perquisites of the learner to the processing of new information that gets integrated into existing knowledge and constantly updated (i.e., evolving knowledge) until the final knowledge is reached. Here, cognitive (content-specific) student models may serve as guidelines.
Learning Activities When Learning With Digital Tools
Yet, building the design of digitally enriched learning environments on such rich cognitive models of student knowledge does not guarantee learning success for each student. Therefore, the utilization-of-learning-opportunity framework (ULO) seeks to integrate structural aspects of learning environments and actual processes that students undergo during instruction (Seidel, 2014; see also Brühwiler & Blatchford, 2011). The ULO framework is commonly used as a domain-general framework in educational effectiveness research and focuses on teacher-student interaction on a classroom level, describing why students differ in how they succeed in learning scenarios (Alp Christ et al., 2022; Seidel & Shavelson, 2007). This domain-general description works very well for domain-general measures of how students utilize learning opportunities, such as classroom engagement (Fredricks et al., 2004; Guertin et al., 2007; Henrie et al., 2015; Huang et al., 2019; Lo & Hyland, 2007). In its usual application, the main argument of the ULO framework is that for learning to be effective (in terms of students demonstrating high learning outcomes), students have to actively engage in the learning opportunities offered. This underpins that learning is considered to be an active and generative process—in line with generative learning theory (Fiorella & Mayer, 2016; Roelle & Nückles, 2019) and theories about self-regulation (Azevedo, 2020; S. Li et al., 2022; Molenaar et al., 2023).
However, for disentangling each student’s utilization of learning opportunities provided by digital tools, the conceptualization of learning mechanisms needs to focus on individual learning activities and to be content-specific (e.g., Reinhold et al., 2020a). For that, the CoDiL framework describes learning opportunities in digitally enriched educational settings, which are characterized via specifically designed digitally enriched instructional features (“Digital Instruction—Instructional Features as Opportunities Stimulating Learning Activities” section). These instructional features may initiate and stimulate learning activities. We understand such learning activities in digitally enriched educational settings as (1) activities that students do (or do not) engage in when working within the digitally enriched educational setting and as (2) theoretical predictors of learning outcomes. Moreover, the CoDiL framework differentiates between the external, behavioral side and the internal, cognitive side of a learning activity. The external side of a learning activity encompasses specific student-tool interactions that occur when students work with the implemented digitally enriched instructional features; the internal side of a learning activity encompasses the non-observable mental processes initiating and accompanying the external student actions. Among others, such learning activities relevant for digitally enriched educational settings are the following:
-
Abstraction: detachment from example-bound or contextualized knowledge to a context-free, generalizable level (Arnon et al., 2014; Lehtinen & Repo, 1996; Renkl, 2023; Rittle-Johnson & Star, 2011).
-
Conducting experiments: engagement in laboratory work to answer a question based on empirically obtained data (Hart et al., 2000; Lazonder & Harmsen, 2016; Wörner et al., 2022).
-
Creating examples: generation of different instances of a phenomenon for the purpose of experiencing structure, extending the range of variation, experiencing generality and the constraints and meanings of conventions, or extending example spaces and exploring boundaries (Guerrero et al., 2023; Watson & Mason, 2002).
-
Exploration: initial active, own examination of the learning objects to activate relevant prior knowledge and to raise questions (M. Lachner et al., 2022; Loibl et al., 2017).
-
Formulating hypothesis: formation and evaluation of theory to formulate a claim that can be confirmed or refuted following experimental scientific endeavor (Klahr & Dunbar, 1988; Park, 2006).
-
Refinement: improvement of the quality of knowledge by making it more accurate, appropriately general, or discriminating (Booth et al., 2017; Koedinger et al., 2012).
-
Revision: fundamental restructuring of the learners’ pre-instructional conceptual structures to allow understanding of the intended final knowledge (Chi, 2008; Duit & Treagust, 2003; Schroeder & Kucera, 2022; Vosniadou, 1994).
-
Self-explanation: explaining the new-to-learn content to oneself to achieve deepened processing of the learning materials (Bisra et al., 2018; Renkl et al., 1998).
The cognitive processes that are typically assumed to describe how these learning activities result in the acquisition of knowledge components are selecting, organizing, and integrating (Mayer, 1999) information to construct new knowledge—which is integrated into the already existing prior knowledge structure of the long-term memory. This integrated knowledge structure allows learners to apply the acquired knowledge in new situations. Internally, these cognitive processes lead to linking the new information to prior knowledge and thereby constructing new knowledge beyond the given information (Mayer, 1984).
Although such learning activities relating to concrete domain-specific content are of key interest for developing learning environments, they are often not specified in detail in educational research (Yeo & Fazio, 2019), especially when research focuses on learning with digital tools (Hillmayr et al., 2020; Kucirkova, 2014). Yet, we consider the understanding of these learning activities necessary to answer the question why digital tools work—and what makes some learners succeed while others fail. In context of the CoDiL framework, such learning activities function as a “link” between students’ external, behavioral interaction with the digital tool and students’ internal, cognitive processes that lead to knowledge acquisition (which allows for a theory-driven operationalization of cognitive activities via student-tool-interactions; see the “Evaluation—Linking Students’ On-Task Behavior and Learning” section). More specifically, the CoDiL framework understands students’ engagement in these learning activities as necessity for successful learning—in line with the ULO framework and generative learning theory (Fiorella & Mayer, 2016; Roelle & Nückles, 2019).
Digital Instruction—Instructional Features as Opportunities Stimulating Learning Activities
When referring to digital instruction, a decisive argument is the media debate initiated by Clark and Kozma (Clark, 1994; Kozma, 1994). They argue that on the one hand “media are mere vehicles that deliver instruction but do not influence student achievement” (Clark, 1994, p. 22), but on the other hand that certain media “possess particular characteristics that make them both more and less suitable for the accomplishment of certain kinds of learning tasks” (Kozma, 1994, p. 8). Such ‘particular characteristics’ have been broadly discussed and investigated since the 1980s, among them ways to direct student attention to learning goals (Scardamalia et al., 1989) or ways to promote students help-seeking behavior (Aleven et al., 2003)—to name just two. The CoDiL framework acknowledges these perspectives; we argue in line with the media debate that it is not the digital tool itself that initiates learning activities (i.e., Clark’s argument) but the implemented digitally enriched instructional features (i.e., Kozma’s argument—the ‘particular characteristics’).
Such instructional features can be regarded as the subject of affordances and constraints, which frame the activity patterns of students and thus the learning activities. Greeno (1998) in fact used the notion of affordances and constraints much broader, incorporating social and material dimensions of the learning situation; however, these notions have been also successfully introduced into media design with a focus on the features of the environment which support and guide cognition (e.g., Hartson, 2003; Norman, 1999).
In context of the CoDiL framework, instructional features are understood as (1) digitally enriched instructional events, which (2) have the potential to stimulate learning activities; due to them being (3) subject of affordances and constraints; they should be (4) designed in order to foster learning activities—i.e., to lower extraneous load (Sweller, 2020) and to increase generative processing (Schumacher & Stern, 2023) when compared to non-digitally enriched educational settings. This is in line with Cognitive Theory of Multimedia Learning (CTML; Mayer, 2014). We consider, among others, the following digitally enriched instructional features as essential:
-
Adaptive feedback (e.g., Aleven et al., 2017; Reinhold et al., 2020b) may stimulate refinement activities, as it may activate prior knowledge and aid discriminating one’s potentially too narrowly defined knowledge structures. It may initiate revision activities by revealing the limits of students’ prior knowledge, when students are not only confronted with the correct solution, but also with their most-likely misconception.
-
Opportunities to try and fail by posing problems prior to instruction (PS-I; e.g., Boomgaarden et al., 2023; Kapur, 2008; Loibl et al., 2017) may stimulate exploration activities. Here digitally enriched learning environments can aid these learning activities by leading students through the problem-solving process and address students’ failed attempts to make their misconceptions salient and other conceptions more reasonable (Holmes et al., 2014).
-
Prompting students (e.g., Rau et al., 2009; Rittle-Johnson et al., 2017) to use task-specific hints or reconsider specific well-known strategies while solving tasks may stimulate refinement activities—as students may engage in overt elaboration (Fiorella & Mayer, 2016; Weinstein & Mayer, 1986). While elaboration has been shown to foster sense-making and retention, learners often do not spontaneously engage in elaboration processes, but need external guidance, for instance, by prompts, to engage in such processes (Berthold et al., 2007; Chi et al., 1989; Endres et al., 2017; Nückles et al., 2009).
-
Prompting students to summarize and explain central instructional information or draw conclusions from simulations (e.g., Hofer et al., 2018; Reinhold et al., 2020a) may stimulate self-explanation activities, aiding the promotion of active construction of conceptual knowledge.
-
Contrasting cases (e.g., Ma et al., 2023; Schalk et al., 2018) may stimulate revision activities, since learners are encouraged to make connections, identify patterns, and develop their own insights about the topic by comparing two or more examples of a particular concept, issue, or phenomenon—revealing limits of one’s own prior knowledge. Dynamic contrasting cases may make the relevant features more salient.
Of course, some of these (digitally enriched) instructional features can be included in classical (i.e., non-digital) classroom instruction as well, following agreed upon principles of instructional design (Gagne et al., 2005; Merrill, 2001)—yet, the implementation in digitally enriched environments might be particularly promising since affordances of media-based instructions come into play (Mayer, 2014; Sweller, 2020).
Research on Digitally Enriched Educational Settings Utilizing the CoDiL Framework
As a synthesis of the above-mentioned different theoretical frameworks, the CoDiL framework can serve as a holistic framework guiding both the development of digitally enriched educational settings and research thereof. More precisely, structuring research within the CoDiL framework (in the development of the digital tools and the research strategy) aligns research endeavors with (1) theories of cognition during learning of (2) a specific content. It theoretically focuses such endeavors on (3) the assumed underlying learning activities which the (4) digitally enriched instructional features should enhance. Thus, it may help researchers to establish (5) a link between students’ cognition and their on-task behavior which allows for testing causal effects of why specific features of digital tools are beneficial for learning.
Development—Designing Digitally Enriched Educational Settings
In line with generative learning theory (Fiorella & Mayer, 2016; Roelle & Nückles, 2019) and theories about self-regulation (Azevedo, 2020; S. Li et al., 2022; Molenaar et al., 2023), the CoDiL framework highlights the mediating role of students’ engagement in specific learning activities in the cause-and-effect mechanisms of successful learning with digital tools. That is, developing specific digital tools for educational purposes includes the design of digitally enriched instructional features which bear the potential to stimulate learning activities which—mediated by cognitive processes resulting from those learning activities—lead to knowledge acquisition (Fig. 1). By combining and linking content-specific theories of learning with theories of what stimulates relevant learning activities, the CoDiL framework aims at highlighting the following design principles: in order to find the appropriate to-be-implemented instructional features, knowledge about content-specific learner models (i.e., knowledge components and learning activities) should be used to design educational settings (i.e., implement instructional features in the digital tool) that are well-suited to stimulate the relevant generative cognitive processes. The rather broad synthetic structure of the CoDiL framework may serve as a guideline for finding an appropriate theoretical foundation and may illustrate aspects to consider in developmental steps. This may be demanding as it can vary between domains, content, and learning goals, as described in the following different examples, which highlight different aspects of this endeavor:
-
Consider developing an online math tutor to support students in learning fraction arithmetic. Keeping the relevant theoretical mediator for learning success in mind (i.e., engagement in abstraction and refinement activities), digitally enriched instructional features selected to be implemented should bear the potential to leverage students’ knowledge about how to operate with fractions (i.e., to come to more accurate and faster solutions when applying arithmetic operations and to appropriately generate conceptual understanding of those operations) during learning with the tool. For that, adaptive feedback and an adaptive increase in task difficulty regarding difficulty-generating factors may seem appropriate (Reinhold et al., 2020b).
-
In contrast, when developing an appropriate digitally enriched educational setting for students to learn about a physical phenomenon, digitally enriched instructional features should support the a-priori identified purposeful reasoning processes that may establish relevant knowledge facets: to stimulate experimental activities (e.g., formulating hypothesis, conducting experiments) leading to a conceptual understanding of the “control of variables strategy,” a simulation enabling that strategy in a salient way may be an appropriate digitally enriched instructional feature (e.g., Greiff et al., 2015; see also scientific discovery as dual search, Künsting et al., 2011).
Evaluation—Linking Students’ On-Task Behavior and Learning
Studies in the field of digitally enriched learning often focus on the direct path, i.e., the effect of digital tools on learning outcome when compared to another learning scenario—which allows only limited interpretation and explanation of changes in learning outcomes. Following and combining theories of learning (e.g., Fiorella & Mayer, 2016; Mayer, 2014), the CoDiL framework is based on the identical premises that learning activities (and the cognitive processes they result in) during (digital) learning—stimulated and triggered by constraints and affordances that go along with specific digitally enriched instructional features—are what contributes to the final learning outcome. For this reason, we consider the external, behavioral side of students’ learning activities as theoretical as well as empirical mediators of achievement.
In this section, we illustrate how the relevant theories about linking behavioral data to student cognition inform the CoDiL framework in how to investigate these activities directly (and as unobtrusively as possible) during learning: following up on the argument that implemented instructional features in digital tools can stimulate learning activities, students’ interaction with these features (external, behavioral side of the learning activities, implying any process data indicators for student-tool-interaction that can be recorded, e.g., click behavior, or writing-to-learn text prompts, to name two) can be a valid indicator for the cognitive side of learning activities (internal, latent, and thought to result in knowledge acquisition, mediated by cognitive processes).
There is a broad variety of different conceptual ideas for how to establish such a link between behavior and cognition on a theoretical and empirical level (Goldhammer et al., 2021; Greiff et al., 2015; Huber & Bannert, 2023; Mislevy et al., 2012; Molenaar et al., 2023; Sedrakyan et al., 2020). For the CoDiL framework to serve as a widely open framework aiming at causal interpretation of learning effects, we aimed at compatibility with a large variety of different analytical approaches. This is why we consider the term “process data” (as a broader term than “log data”) as an umbrella term encompassing (i) student-tool interactions logged unobtrusively by the digital tool itself and (ii) other process indicators obtained from accompanying assessments during learning, such as, finger-tracing data in open-learning environments (e.g., Moyer-Packenham et al., 2019; Zuo & Lin, 2022), solutions from rather closed unique cognitive items inside a digital learning path (e.g., Boomgaarden et al., 2023; Rau et al., 2017), eye-tracking data (Nückles, 2021; Strohmaier et al., 2020), think-aloud protocols accompanying the use of any kind of digital tool (Ericsson & Simon, 1998; A. Lachner & Nückles, 2015; Renkl, 1997), and journal writing during self-regulated learning with digital tools (Nückles et al., 2020). To sum up, the CoDiL framework emphasizes widely agreed-upon necessities for establishing a link between process data and hypothesized cognition (Goldhammer et al., 2021; Huber & Bannert, 2023; Molenaar et al., 2023; Sedrakyan et al., 2020)—i.e., the need for (a) a solid theoretical foundation, as well as (b) appropriate indicators inside the process data files—to allow for differentiated statements about the effects of digital tools (or more specifically, their implemented instructional features) on learning success. For example,
-
Consider Lalley and colleagues’ (2010) study on the comparison of virtual vs. real frog dissection in biology classrooms. The theoretical framework takes into account ethical and health issues, as well as specimen decay—underlining the necessity of virtual alternatives to reach the same learning goals and asking whether “virtual dissection procedure [result in] comparable learning … outcomes when compared to traditional dissection” (p. 191). While the authors could show a positive effect of the digital learning tool provided compared to real dissection, this effect cannot be further evaluated within the theoretical framework of the study, as no hypotheses about the digitally enriched instructional features implemented in the software and their relation to learning activities during the virtual dissection (compared to the real dissection) are stated. Thus, the research framework lacks a theoretical mediator that could explain why the virtual approach is more effective than the traditional approach—leaving essential questions unanswered.
-
In clear contrast, the study by Koedinger and colleagues (2010) is prototypical for the relevant elements of the CoDiL framework. Here, students who use a formative assessment mathematics tool (and students who do not) were compared in terms of learning outcomes measured via a standardized mathematics test. The theoretical framework (a) encompasses well-established effects of adaptive and individualized learning in the context of formative assessment, stating explicitly that “students would benefit from the tutoring, feedback, and [the] design of the … system” (p. 496)—routed down to estimated positive effects of “practice with timely feedback” and “individualized tutorial assistance” (p. 496). Thus, adaptive immediate feedback and individualized tools (which would be considered digitally enriched instructional features providing additional learning opportunities in terms of the CoDiL framework)—and not digital tool use in general—are regarded as the cause for the effect on learning. From the perspective of the CoDiL framework, these instructional features may stimulate refinement or revision activities in students (i.e., the theoretical mediator of the effect of the digital tool). Yet, for them to become predictors of achievement, it is relevant if (or to which amount) students make use of these digitally enriched instructional features—shifting from design features of the digital tool to the above-mentioned specific learning activities students actually engage in while using the digitally enriched learning tool. Koedinger et al. (2010) assessed engagement in these learning activities by behavioral measures of student-tool interaction; (b) students who did not complete a certain amount of items in the tool were labeled “low usage” and students who did were labeled “high usage”—shedding light on an interaction effect in line with their hypotheses.
Discussion
In this article, we summarized and reviewed different existing theoretical and empirical works regarding the role of digital tools in educational settings. We presented the CoDiL framework as a synthesis of different positions about that specific role of digital tools. One main argument from the last decades of research on educational technology which we want to emphasize is that cognitive processes have a mediating role in the cause-and-effect mechanisms of successful subject-specific learning with digital tools. This mediating role can be framed both in a theoretical and an empirical manner: on a theoretical level, the CoDiL framework describes digital tools by focusing on their implemented digitally enriched instructional features. These instructional features offer learning opportunities to students that may (or may not) be utilized; if utilized they trigger learning activities—which mediated by cognitive processes and in interaction with prior knowledge lead to knowledge gains. From an empirical perspective, these learning activities should be operationalizable by measurable student-tool interactions (generating a broad variety of different process data). Yet, we argue that for the framework to be able to guide research on digital tools in education, its ‘degrees of freedom’ need to be specified for the concrete educational scenario of interest: we recognize that our current framework represents a high-level conceptual integration of KLI, SOI, and ULO. This provides a basic starting point, but more detailed and empirical integration into specific (newly conducted) studies is required. This offers potential for further research from various fields.
On the Assessment of Process Data During Learning With Digital Tools
Present theoretical frameworks on learning in digitally enriched or multimedia scenarios (Chi & Wylie, 2014; Järvelä, 1995; Mayer, 2014; Sweller, 2020) are based on the premise that cognitive processes during (digital) learning cause knowledge acquisition. Although this can be considered a commonly agreed-upon statement about how learning occurs, the specific underlying (latent) learning processes are not always operationalized and assessed in studies about learning in digitally enriched scenarios. Consequently, some recent publications call for a more concrete investigation of the learning process (de Jong, 2010; Kucirkova, 2014) to gain insight into the mechanisms explaining the effects of digital-tool design (Boomgaarden et al., 2023; Sedrakyan et al., 2020)—or aptitude-treatment interactions (Grimm et al., 2023; Huber & Bannert, 2023; Reinhold et al., 2020b). In order to reflect this in our synthesis model, we have centered the CoDiL framework on learning activities that have shown relevant to (digital) learning (e.g., abstraction, conducting experiments, creating examples, exploration, formulating hypothesis, refinement, revision, self-explanation). As this is an active process (in accordance with generative learning theory, Fiorella & Mayer, 2016; Roelle & Nückles, 2019; and theories about self-regulation, Azevedo, 2020; S. Li et al., 2022; Molenaar et al., 2023), we integrated ULO in our framework to contribute for various student behavior (Seidel, 2014); as a direct result of the presented arguments, students’ engagement in these learning activities serves as a theoretical as well as an empirical mediator in the CoDiL framework. Regarding research on the role of digital tools in education, one main work for future primary research is to develop various ways to unobtrusively capture student-tool interactions—and to link these behaviors to the underlying cognitive processes validly. Given such valid measures of learning activities in digitally enriched educational settings, mediation analyses could empirically underpin the role of these activities as theoretically grounded causes for the effects of learning with digital tools.
On the Development of Digital Tools for Educational Purposes
We consider the design of the digital tool (and its digitally enriched instructional features) a central part of the development of a digitally enriched learning environment: we consider it relevant to start research on digitally enriched learning with analyses of the to-be-learned content, the necessary knowledge elements, and the required learning activities to achieve these learning goals—and, thus, not by picking a to-be-investigated digital tool first. In fact, we consider it necessary for researchers to engage in the development (or selection) of digital prototype tools that are explicitly designed to align with the learning mechanisms assumed. Given that, the link between students’ underlying learning activities and their behavioral student-tool interactions may be established during tool development (Goldhammer et al., 2021).
On the Role of Content-Specificity in Learning With Digital Tools
Whereas multiple aspects are important to be considered as mediators for learning success (e.g., cognitive load; Sweller et al., 2019), the activation of and engagement in specific learning activities is considered to be of particular relevance (e.g., Koedinger et al., 2012; Schumacher & Stern, 2023). By describing the CoDiL framework, we argue that digital tools should be designed to stimulate such learning activities. In line with Koedinger and colleagues’ KLI framework, we consider particular purposeful learning activities (that result in cognitive processes relevant for knowledge acquisition) to be content-specific (Koedinger et al., 2012). In our framework, we stress the need to provide detailed information on the specific knowledge components that students need to acquire to learn a specific content. Based on this specification of knowledge components, digital tools can be developed to not only support learning in general (e.g., meta-cognitive scaffolding or corrective feedback), but also to stimulate the essential content-specific (conceptual) knowledge components itself (e.g., task-specific feedback on the most plausible student error given the students’ answer or relevant and hierarchically ordered contrasting cases). Thus, the digital tool (and its implemented instructional features) should be considered an inherent part of the learning environment—aiming for a concrete learning goal.
Conclusion: Guiding Research on Digital Tools in Educational Settings
Studies in the field of digital learning often focus on the investigation of direct effects of digital tools on students’ learning outcome. With this article, we provide a theoretical framework of the learning activities mediating learning with such digital tools in educational settings—focusing on the underlying learning mechanisms in digitally enriched learning scenarios. Research on digital tools in educational settings guided by the proposed CoDiL framework should follow these steps:
-
1.
Specify the content-specific knowledge components to be learned.
-
2.
Specify the learning activities that lead to the acquisition of these knowledge components.
-
3.
Select or design digital tools with instructional features that stimulate and support these learning activities.
-
4.
Collect process data (e.g., on student-tool interaction) to measure the actual utilization of the digitally enriched instructional features of the digital tool that may serve as indicators for the cognitive processes taking place.
References
Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R. (2003). Help seeking and help design in interactive learning environments. Review of Educational Research, 73(3), 277–320. https://doi.org/10.3102/00346543073003277
Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2017). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed., pp. 522–560). Routledge.
Alp Christ, A., Capon-Sieber, V., Grob, U., & Praetorius, A.-K. (2022). Learning processes and their mediating role between teaching quality and student achievement: A systematic review. Studies in Educational Evaluation, 75, 101209. https://doi.org/10.1016/j.stueduc.2022.101209
Anderson, J. R., Matessa, M., & Lebiere, C. (1997). ACT-R: A theory of higher level cognition and its relation to visual attention. Human-Computer Interaction, 12(4), 439–462. https://doi.org/10.1207/s15327051hci1204_5
Arnon, I., Cottrill, J., Dubinsky, E., Oktaç, A., Roa Fuentes, S., Trigueros, M., & Weller, K. (2014). APOS theory: A framework for research and curriculum development in mathematics education. Springer, New York. https://doi.org/10.1007/978-1-4614-7966-6
Azevedo, R. (2020). Reflections on the field of metacognition: Issues, challenges, and opportunities. Metacognition and Learning, 15(2), 91–98. https://doi.org/10.1007/s11409-020-09231-x
Berthold, K., Nückles, M., & Renkl, A. (2007). Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts. Learning and Instruction, 17(5), 564–577. https://doi.org/10.1016/j.learninstruc.2007.09.007
Bisra, K., Liu, Q., Nesbit, J. C., Salimi, F., & Winne, P. H. (2018). Inducing self-explanation: A meta-analysis. Educational Psychology Review, 30(3), 703–725. https://doi.org/10.1007/s10648-018-9434-x
Boomgaarden, A., Loibl, K., & Leuders, T. (2023). The trade-off between complexity and accuracy. Preparing for computer-based adaptive instruction on fractions. Interactive Learning Environments, 31(10), 6379–6394. https://doi.org/10.1080/10494820.2022.2038636
Booth, J. L., McGinn, K. M., Barbieri, C., Begolli, K. N., Chang, B., Miller-Cotto, D., Young, L. K., & Davenport, J. L. (2017). Evidence for cognitive science principles that impact learning in mathematics. In D. C. Geary, D. B. Berch, R. J. Ochsendorf, & K. M. Koepke (Eds.), Acquisition of complex arithmetic skills and higher-order mathematics concepts (pp. 297–325). Academic Press. https://doi.org/10.1016/B978-0-12-805086-6.00013-8
Brühwiler, C., & Blatchford, P. (2011). Effects of class size and adaptive teaching competency on classroom processes and academic outcome. Learning and Instruction, 21(1), 95–108. https://doi.org/10.1016/j.learninstruc.2009.11.004
Chauhan, S. (2017). A meta-analysis of the impact of technology on learning effectiveness of elementary students. Computers & Education, 105, 14–30. https://doi.org/10.1016/j.compedu.2016.11.005
Chi, M. T. H. (2008). Three types of conceptual change: Belief revision, mental model transformation, and categorical shift. In S. Vosniadou (Ed.), International handbook of research on conceptual change (pp. 89–110). Routledge.
Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/10.1080/00461520.2014.965823
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989). Self-explanations: How students study and use examples in learning to solve problems. Cognitive Science, 13(2), 145–182. https://doi.org/10.1207/s15516709cog1302_1
Clark, R. E. (1994). Media will never influence learning. Educational Technology Research and Development, 42(2), 21–29. https://doi.org/10.1007/BF02299088
Clarke, D. M., & Roche, A. (2009). Students’ fraction comparison strategies as a window into robust understanding and possible pointers for instruction. Educational Studies in Mathematics, 72(1), 127–138. https://doi.org/10.1007/s10649-009-9198-9
de Jong, T. (2010). Cognitive load theory, educational research, and instructional design: Some food for thought. Instructional Science, 38(2), 105–134. https://doi.org/10.1007/s11251-009-9110-0
Duit, R., & Treagust, D. F. (2003). Conceptual change: A powerful framework for improving science teaching and learning. International Journal of Science Education, 25(6), 671–688. https://doi.org/10.1080/09500690305016
Endres, T., Carpenter, S., Martin, A., & Renkl, A. (2017). Enhancing learning by retrieval: Enriching free recall with elaborative prompting. Learning and Instruction, 49, 13–20. https://doi.org/10.1016/j.learninstruc.2016.11.010
Ericsson, K. A., & Simon, H. A. (1998). How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking. Mind, Culture, and Activity, 5(3), 178–186. https://doi.org/10.1207/s15327884mca0503_3
Fiorella, L., & Mayer, R. E. (2016). Eight ways to promote generative learning. Educational Psychology Review, 28(4), 717–741. https://doi.org/10.1007/s10648-015-9348-9
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
Gagne, R. M., Wager, W. W., Golas, K. C., Keller, J. M., & Russell, J. D. (2005). Principles of instructional design (5th ed.), Thomson/Wadsworth.
Goldhammer, F., Hahnel, C., Kroehne, U., & Zehner, F. (2021). From byproduct to design factor: On validating the interpretation of process indicators based on log data. Large-Scale Assessments in Education, 9(1), 20. https://doi.org/10.1186/s40536-021-00113-5
Gómez, D., & Dartnell, P. (2019). Middle schoolers’ biases and strategies in a fraction comparison task. International Journal of Science and Mathematics Education, 17(6), 1233–1250. https://doi.org/10.1007/s10763-018-9913-z
Greeno, J. G. (1998). The situativity of knowing, learning, and research. American Psychologist, 53(1), 5–26. https://doi.org/10.1037/0003-066X.53.1.5
Greiff, S., Wüstenberg, S., & Avvisati, F. (2015). Computer-generated log-file analyses as a window into students’ minds? A showcase study based on the PISA 2012 assessment of problem solving. Computers & Education, 91, 92–105. https://doi.org/10.1016/j.compedu.2015.10.018
Grimm, H., Edelsbrunner, P. A., & Möller, K. (2023). Accommodating heterogeneity: The interaction of instructional scaffolding with student preconditions in the learning of hypothesis-based reasoning. Instructional Science, 51(1), 103–133. https://doi.org/10.1007/s11251-022-09601-9
Guerrero, T. A., Griffin, T. D., & Wiley, J. (2023). The effects of generating examples on comprehension and metacomprehension. Journal of Experimental Psychology: Applied. https://doi.org/10.1037/xap0000490
Guertin, L. A., Zappe, S. E., & Kim, H. (2007). Just-in-time teaching exercises to engage students in an introductory-level dinosaur course. Journal of Science Education and Technology, 16(6), 507–514. https://doi.org/10.1007/s10956-007-9071-5
Hart, C., Mulhall, P., Berry, A., Loughran, J., & Gunstone, R. (2000). What is the purpose of this experiment? Or can students learn something from doing experiments? Journal of Research in Science Teaching, 37(7), 655–675. https://doi.org/10.1002/1098-2736(200009)37:7%3c655::AID-TEA3%3e3.0.CO;2-E
Hartson, R. (2003). Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & Information Technology, 22(5), 315–338. https://doi.org/10.1080/01449290310001592587
Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015). Measuring student engagement in technology-mediated learning: A review. Computers & Education, 90, 36–53. https://doi.org/10.1016/j.compedu.2015.09.005
Higgins, K., Huscroft-D’Angelo, J., & Crawford, L. (2019). Effects of technology in mathematics on achievement, motivation, and attitude: A meta-analysis. Journal of Educational Computing Research, 57(2), 283–319. https://doi.org/10.1177/0735633117748416
Hillmayr, D., Ziernwald, L., Reinhold, F., Hofer, S. I., & Reiss, K. M. (2020). The potential of digital tools to enhance mathematics and science learning in secondary schools: A context-specific meta-analysis. Computers & Education, 153, 103897. https://doi.org/10.1016/j.compedu.2020.103897
Hofer, S. I., Schumacher, R., Rubin, H., & Stern, E. (2018). Enhancing physics learning with cognitively activating instruction: A quasi-experimental classroom intervention study. Journal of Educational Psychology. https://doi.org/10.1037/edu0000266
Holmes, N. G., Day, J., Park, A. H. K., Bonn, D. A., & Roll, I. (2014). Making the failure more productive: Scaffolding the invention process to improve inquiry behaviors and outcomes in invention activities. Instructional Science, 42(4), 523–538. https://doi.org/10.1007/s11251-013-9300-7
Huang, B., Hew, K. F., & Lo, C. K. (2019). Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, 27(8), 1106–1126. https://doi.org/10.1080/10494820.2018.1495653
Huber, K., & Bannert, M. (2023). Investigating learning processes through analysis of navigation behavior using log files. Journal of Computing in Higher Education. https://doi.org/10.1007/s12528-023-09372-3
Järvelä, S. (1995). The cognitive apprenticeship model in a technologically rich learning environment: Interpreting the learning interaction. Learning and Instruction, 5(3), 237–259. https://doi.org/10.1016/0959-4752(95)00007-P
Kalyuga, S. (2007). Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review, 19(4), 509–539. https://doi.org/10.1007/s10648-007-9054-3
Kalyuga, S. (2013). Effects of learner prior knowledge and working memory limitations on multimedia learning. Procedia - Social and Behavioral Sciences, 83, 25–29. https://doi.org/10.1016/j.sbspro.2013.06.005
Kapur, M. (2008). Productive failure. Cognition and Instruction, 26(3), 379–424. https://doi.org/10.1080/07370000802212669
Kintsch, W. (1991). The role of knowledge in discourse comprehension: A construction-integration model. In G. E. Stelmach & P. A. Vroon (Eds.), Advances in psychology (Vol. 79, pp. 107–153). https://doi.org/10.1016/S0166-4115(08)61551-4
Klahr, D., & Dunbar, K. (1988). Dual space search during scientific reasoning. Cognitive Science, 12(1), 1–48. https://doi.org/10.1207/s15516709cog1201_1
Koedinger, K. R., Corbett, A. T., & Perfetti, C. (2012). The knowledge-learning-instruction framework: Bridging the science-practice chasm to enhance robust student learning. Cognitive Science, 36(5), 757–798. https://doi.org/10.1111/j.1551-6709.2012.01245.x
Koedinger, K. R., McLaughlin, E. A., & Heffernan, N. T. (2010). A quasi-experimental evaluation of an on-line formative assessment and tutoring system. Journal of Educational Computing Research, 43(4), 489–510.
Kozma, R. B. (1994). Will media influence learning? Reframing the debate. Educational Technology Research and Development, 42(2), 7–19. https://doi.org/10.1007/BF02299087
Kucirkova, N. (2014). iPads in early education: Separating assumptions and evidence. Frontiers in Psychology, 5, 715. https://doi.org/10.3389/fpsyg.2014.00715
Künsting, J., Wirth, J., & Paas, F. (2011). The goal specificity effect on strategy use and instructional efficiency during computer-based scientific discovery learning. Computers & Education, 56(3), 668–679. https://doi.org/10.1016/j.compedu.2010.10.009
Lachner, A., & Nückles, M. (2015). Bothered by abstractness or engaged by cohesion? Experts’ explanations enhance novices’ deep-learning. Journal of Experimental Psychology: Applied, 21(1), 101–115. https://doi.org/10.1037/xap0000038
Lachner, M., Künsting, J., Leuders, T., & Wessel, L. (2022). Erkunden und Entdecken–ertragreich für Lernende mit unterschiedlichen Lernvoraussetzungen. Der Mathematikunterricht, 2, 40–51.
Lalley, J. P., Piotrowski, P. S., Battaglia, B., Brophy, K., & Chugh, K. (2010). A comparison of V-frog© to physical frog dissection. International Journal of Environmental and Science Education, 5(2), 189–200.
Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 86(3), 681–718. https://doi.org/10.3102/0034654315627366
Lehtinen, E., & Repo, S. (1996). Activity, social interaction, and reflective abstraction: Learning advanced mathematical concepts in computer-environment. In S. Vosniadou, E. DeCorte, R. Glaser, & H. Mandl (Eds.), International perspectives on the psychological foundations of technology-based learning environments (pp. 105–128). Lawrence Erlbaum.
Li, Q., & Ma, X. (2010). A meta-analysis of the effects of computer technology on school students’ mathematics learning. Educational Psychology Review, 22(3), 215–243. https://doi.org/10.1007/s10648-010-9125-8
Li, S., Zheng, J., Huang, X., & Xie, C. (2022). Self-regulated learning as a complex dynamical system: Examining students’ STEM learning in a simulation environment. Learning and Individual Differences, 95, 102144. https://doi.org/10.1016/j.lindif.2022.102144
Lo, J., & Hyland, F. (2007). Enhancing students’ engagement and motivation in writing: The case of primary students in Hong Kong. Journal of Second Language Writing, 16(4), 219–237. https://doi.org/10.1016/j.jslw.2007.06.002
Loibl, K., Roll, I., & Rummel, N. (2017). Towards a theory of when and how problem solving followed by instruction supports learning. Educational Psychology Review, 29(4), 693–715. https://doi.org/10.1007/s10648-016-9379-x
Loibl, K., Leuders, T., Glogger-Frey, I., & Rummel, N. (2023). Cognitive analysis of composite instructional designs: New directions for research on problem-solving prior to instruction. In C. Damșa, M. Borge, E. Koh, & M. Worsley (Eds.), Proceedings of the 16th international conference on computer-supported collaborative learning - CSCL 2023 (pp. 321–324). International Society of the Learning Sciences.
Ma, N., Qian, J., Gong, K., & Lu, Y. (2023). Promoting programming education of novice programmers in elementary schools: A contrasting cases approach for learning programming. Education and Information Technologies. https://doi.org/10.1007/s10639-022-11565-9
Mayer, R. E. (1984). Aids to text comprehension. Educational Psychologist, 19(1), 30–42. https://doi.org/10.1080/00461528409529279
Mayer, R. E. (1999). Designing instruction for constructivist learning. In C. M. Reigeluth (Ed.), Instructional-design theories and models: A new paradigm of instructional theory (Vol. 2, pp. 141–160). Lawrence Erlbaum.
Mayer, R. E. (2014). Cognitive theory of multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 31–48). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369.005
Merrill, M. D. (2001). Components of instruction toward a theoretical tool for instructional design. Instructional Science, 29(4/5), 291–310. https://doi.org/10.1023/A:1011943808888
Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., & Levy, R. (2012). Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining. Journal of Educational Data Mining, 4(1), 11–48. https://doi.org/10.5281/zenodo.3554641
Molenaar, I., Mooij, S. D., Azevedo, R., Bannert, M., Järvelä, S., & Gašević, D. (2023). Measuring self-regulated learning and the role of AI: Five years of research using multimodal multichannel data. Computers in Human Behavior, 139, 107540. https://doi.org/10.1016/j.chb.2022.107540
Moran, J., Ferdig, R. E., Pearson, P. D., Wardrop, J., & Blomeyer, R. L. (2008). Technology and reading performance in the middle-school grades: A meta-analysis with recommendations for policy and practice. Journal of Literacy Research, 40(1), 6–58. https://doi.org/10.1080/10862960802070483
Moyer-Packenham, P. S., Lommatsch, C. W., Litster, K., Ashby, J., Bullock, E. K., Roxburgh, A. L., Shumway, J. F., Speed, E., Covington, B., Hartmann, C., Clarke-Midura, J., Skaria, J., Westenskow, A., MacDonald, B., Symanzik, J., & Jordan, K. (2019). How design features in digital math games support learning and mathematics connections. Computers in Human Behavior, 91, 316–332. https://doi.org/10.1016/j.chb.2018.09.036
Norman, D. A. (1999). Affordance, conventions, and design. Interactions, 6(3), 38–43. https://doi.org/10.1145/301153.301168
Nückles, M. (2021). Investigating visual perception in teaching and learning with advanced eye-tracking methodologies: Rewards and challenges of an innovative research paradigm. Educational Psychology Review, 33(1), 149–167. https://doi.org/10.1007/s10648-020-09567-5
Nückles, M., Hübner, S., & Renkl, A. (2009). Enhancing self-regulated learning by writing learning protocols. Learning and Instruction, 19(3), 259–271. https://doi.org/10.1016/j.learninstruc.2008.05.002
Nückles, M., Roelle, J., Glogger-Frey, I., Waldeyer, J., & Renkl, A. (2020). The self-regulation-view in writing-to-learn: Using journal writing to optimize cognitive load in self-regulated learning. Educational Psychology Review, 32(4), 1089–1126. https://doi.org/10.1007/s10648-020-09541-1
Park, J. (2006). Modelling analysis of students’ processes of generating scientific explanatory hypotheses. International Journal of Science Education, 28(5), 469–489. https://doi.org/10.1080/09500690500404540
Post, T., & Cramer, K. (1987). Children’s strategies when ordering rational numbers. Arithmetic Teacher, 35(2), 33–35.
Praetorius, A.-K., Klieme, E., Herbert, B., & Pinger, P. (2018). Generic dimensions of teaching quality: The German framework of Three Basic Dimensions. ZDM Mathematics Education, 50(3), 407–426. https://doi.org/10.1007/s11858-018-0918-4
Rau, M. A., Aleven, V., & Rummel, N. (2009). Intelligent tutoring systems with multiple representations and self-explanation prompts support learning of fractions. In V. Dimitrova, R. Mizoguchi, & B. du Boulay (Eds.), Proceedings of the 14th International Conference on Artificial Intelligence in Education</Emphasis> (pp. 441–448). IOS Press. https://doi.org/10.3233/978-1-60750-028-5-441
Rau, M. A., Aleven, V., & Rummel, N. (2017). Supporting students in making sense of connections and in becoming perceptually fluent in making connections among multiple graphical representations. Journal of Educational Psychology, 109(3), 355–373. https://doi.org/10.1037/edu0000145
Reinhold, F., Strohmaier, A., Hoch, S., Reiss, K., Böheim, R., & Seidel, T. (2020a). Process data from electronic textbooks indicate students’ classroom engagement. Learning and Individual Differences, 83–84, 101934. https://doi.org/10.1016/j.lindif.2020.101934
Reinhold, F., Hoch, S., Werner, B., Richter-Gebert, J., & Reiss, K. (2020b). Learning fractions with and without educational technology: What matters for high-achieving and low-achieving students? Learning and Instruction, 65, 101264. https://doi.org/10.1016/j.learninstruc.2019.101264
Renkl, A. (1997). Learning from worked-out examples: A study on individual differences. Cognitive Science, 21(1), 1–29. https://doi.org/10.1207/s15516709cog2101_1
Renkl, A., Stark, R., Gruber, H., & Mandl, H. (1998). Learning from worked-out examples: The effects of example variability and elicited self-explanations. Contemporary Educational Psychology, 23(1), 90–108. https://doi.org/10.1006/ceps.1997.0959
Renkl, A. (2023). Exemplars. In R. Tierney, F. Rizvi, & K. Ercikan (Eds.), International Encyclopedia of Education (4th ed., pp. 612–622). Elsevier. https://doi.org/10.1016/B978-0-12-818630-5.14067-9
Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive tutor: Applied research in mathematics education. Psychonomic Bulletin & Review, 14(2), 249–255. ri
Rittle-Johnson, B., Loehr, A. M., & Durkin, K. (2017). Promoting self-explanation to improve mathematics learning: A meta-analysis and instructional design principles. ZDM Mathematics Education, 49(4), 599–611. https://doi.org/10.1007/s11858-017-0834-z
Rittle-Johnson, B., & Star, J. R. (2011). The power of comparison in learning and instruction: Learning outcomes supported by different types of comparisons. In J. P. Mestre & B. H. Ross (Eds.), Psychology of learning and motivation (Vol. 55, pp. 199–225). Academic Press. https://doi.org/10.1016/B978-0-12-387691-1.00007-7
Roelle, J., & Nückles, M. (2019). Generative learning versus retrieval practice in learning from text: The cohesion and elaboration of the text matters. Journal of Educational Psychology, 111(8), 1341–1361. https://doi.org/10.1037/edu0000345
Scardamalia, M., Bereiter, C., McLean, R. S., Swallow, J., & Woodruff, E. (1989). Computer-supported intentional learning environments. Journal of Educational Computing Research, 5(1), 51–68. https://doi.org/10.2190/CYXD-6XG4-UFN5-YFB0
Schalk, L., Schumacher, R., Barth, A., & Stern, E. (2018). When problem-solving followed by instruction is superior to the traditional tell-and-practice sequence. Journal of Educational Psychology, 110(4), 596–610. https://doi.org/10.1037/edu0000234
Schroeder, N. L., & Kucera, A. C. (2022). Refutation text facilitates learning: A meta-analysis of between-subjects experiments. Educational Psychology Review, 34(2), 957–987. https://doi.org/10.1007/s10648-021-09656-z
Schumacher, R., & Stern, E. (2023). Promoting the construction of intelligent knowledge with the help of various methods of cognitively activating instruction. Frontiers in Education, 7, 979430. https://doi.org/10.3389/feduc.2022.979430
Schweppe, J., & Rummer, R. (2014). Attention, working memory, and long-term memory in multimedia learning: An integrated perspective based on process models of working memory. Educational Psychology Review, 26(2), 285–306. https://doi.org/10.1007/s10648-013-9242-2
Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S., & Kirschner, P. A. (2020). Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation. Computers in Human Behavior, 107, 105512. https://doi.org/10.1016/j.chb.2018.05.004
Seidel, T. (2014). Angebots-Nutzungs-Modelle in der Unterrichtspsychologie. Integration von Struktur- und Prozessparadigma [Utilization-of-learning-opportunities models in the psychology of Instruction: Integration of the paradigms of structure and of process]. Zeitschrift Für Pädagogik, 60(6), 850–866.
Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. https://doi.org/10.3102/0034654307310317
Simonsmeier, B. A., Flaig, M., Deiglmayr, A., Schalk, L., & Schneider, M. (2022). Domain-specific prior knowledge and learning: A meta-analysis. Educational Psychologist, 57(1), 31–54. https://doi.org/10.1080/00461520.2021.1939700
Strohmaier, A. R., MacKay, K. J., Obersteiner, A., & Reiss, K. M. (2020). Eye-tracking methodology in mathematics education research: A systematic literature review. Educational Studies in Mathematics, 104(2), 147–200. https://doi.org/10.1007/s10649-020-09948-1
Sweller, J. (2020). Cognitive load theory and educational technology. Educational Technology Research and Development, 68(1), 1–16. https://doi.org/10.1007/s11423-019-09701-3
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019). Cognitive architecture and instructional design: 20 years later. Educational Psychology Review, 31(2), 261–292. https://doi.org/10.1007/s10648-019-09465-5
Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning: A second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28. https://doi.org/10.3102/0034654310393361
Tobias, S. (1994). Interest, prior knowledge, and learning. Review of Educational Research, 64(1), 37–54. https://doi.org/10.3102/00346543064001037
VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221. https://doi.org/10.1080/00461520.2011.611369
Vosniadou, S. (1994). Capturing and modeling the process of conceptual change. Learning and Instruction, 4(1), 45–69. https://doi.org/10.1016/0959-4752(94)90018-3
Watson, A., & Mason, J. (2002). Student-generated examples in the learning of mathematics. Canadian Journal of Science, Mathematics and Technology Education, 2(2), 237–249. https://doi.org/10.1080/14926150209556516
Weinstein, C. E., & Mayer, R. E. (1986). The teaching of learning strategies. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 315–327). Macmillan.
Wörner, S., Kuhn, J., & Scheiter, K. (2022). The best of two worlds: A systematic review on combining real and virtual experiments in science education. Review of Educational Research, 92(6), 911–952. https://doi.org/10.3102/00346543221079417
Yeo, D. J., & Fazio, L. K. (2019). The optimal learning strategy depends on learning goals and processes: Retrieval practice versus worked examples. Journal of Educational Psychology, 111(1), 73–90. https://doi.org/10.1037/edu0000268
Zuo, G., & Lin, L. (2022). Engaging learners by tracing and summarizing in a computer-based environment. Applied Cognitive Psychology, 36(2), 391–401. https://doi.org/10.1002/acp.3928
Funding
Open Access funding enabled and organized by Projekt DEAL. This research was funded by the Ministry of Science, Research and Arts of Baden-Wuerttemberg within the Research Training Group “Digitally supported teaching and learning environments for cognitive activation (Di.ge.LL)”.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Reinhold, F., Leuders, T., Loibl, K. et al. Learning Mechanisms Explaining Learning With Digital Tools in Educational Settings: a Cognitive Process Framework. Educ Psychol Rev 36, 14 (2024). https://doi.org/10.1007/s10648-024-09845-6
Accepted:
Published:
DOI: https://doi.org/10.1007/s10648-024-09845-6