In search of attributes that support self-regulation in blended learning environments

Blended forms of learning have become increasingly popular. Learning activities within these environments are supported by a large variety of online and face-to-face interventions. However, it remains unclear whether these blended environments are successful, and if they are, what makes them successful. Studies suggest that blended learning challenges the self-regulatory abilities of learners, though the literature does little to explain these findings; nor does it provide solutions. In particular, little is known about the attributes that are essential to support learners and how they should guide course design. To identify such attributes and enable a more thoughtful redesign of blended learning environments, this systematic literature review (n = 95) examines evidence published between 1985 and 2015 on attributes of blended learning environments that support self-regulation. The purpose of this review is therefore to identify and define the attributes of blended learning environments that support learners’ self-regulatory abilities. Seven key attributes were found (authenticity, personalization, learner-control, scaffolding, interaction, cues for reflection and cues for calibration). This review is the first to identify and define the attributes that support self-regulation in blended learning environments and thus to support the design of blended learning environments. This study may serve to facilitate the design of blended learning environments that meet learners’ self-regulatory needs. It also raises crucial questions about how blended learning relates to well-established learning theories and provides a basis for future research on self-regulation in blended learning environments.


Introduction
During the last two decades we have seen a steep rise in computer-and web-based technologies, which has led to significant changes in education. Blended forms of learning have become increasingly popular (Garrison and Kanuka 2004;Garrison and Vaughan 2008;Graham 2006;Spanjers et al. 2015). Learning activities within these blended environments are supported by a large variety of online and face-to-face instructional interventions. As a result of this, blended learning environments differ widely in the technologies used, the extent of integration of online and face-to-face instruction and the degree to which online activities are meant to replace face-to-face instruction (Smith and Kurthen 2007). Despite their popularity, it remains unclear whether these environments are successful, and if they are, which attributes make them successful (Oliver and Trigwell 2005). An important observation is that blended learning seems to be especially challenging for learners with lower self-regulatory abilities; but the opposite is also true: those who are able to regulate their own learning do well in these environments (Barnard et al. 2009;Lynch and Dembo 2004). However, it remains unclear why this is the case and what can be done to help struggling learners. This is problematic since educational research shows that the effectiveness of a learning environment depends on its design (Piccoli et al. 2001), e.g. the nature of the tasks given to learners and the information provided to help them perform the learning activities (Smith and Ragan 1999;Sweller et al. 1998). In order to design blended learning environments that support self-regulation and thus make learning more effective, we first need to determine the attributes of such environments. This paper therefore makes a first attempt to identify and define these attributes in the existing literature. After providing a brief overview of existing theories of self-regulation, we explain why the model we used as a framework to reflect upon the results of this review was most appropriate. Subsequently, we review the relevant literature, identify the attributes of effective blended learning environments and define them. This definition is particularly challenging, firstly because an inductive or bottom-up approach was used in this systematic literature review (see : Hart 2009;Joy 2007); its aim was to identify attributes rather than validating them. Secondly, numerous studies have already noted (e.g., Petticrew and Roberts 2008) that conceptual transparency is often lacking in intervention studies within learning and educational sciences. It is likely, then, that while the retrieved studies report on common attributes, they approach them from different perspectives. While this complicates the definition process, such definitions are nonetheless likely to make a key contribution when designing interventions aimed at particular attributes.

Learner variables influencing self-regulation
In this study learning is seen as an activity performed by learners for themselves in a proactive manner, rather than as something that happens to them as results of instruction (Bandura 1989;Benson 2013;Knowles et al. 2014). Learning is therefore seen as a self-regulated process (Zimmerman and Schunk 2001). This perception of the abilities of learners to regulate their learning originates from the social cognitive perspective (Bandura 1977). Over the past three decades, various self-regulated learning theories have been grafted onto this perspective. Five main theories can be identified in the leading reviews written to date (e.g., Baumeister and Heatherton 1996;Boekaerts 1999;Boekaerts et al. 2005;Puustinen and Pulkkinen 2001;Zimmerman and Schunk 2001).
Although no theory of self-regulation can be considered superior to any other, the Winne and Hadwin (1998) model was selected to facilitate the search for attributes of blended learning environment that support self-regulation since it has a number of characteristics that make it very suitable for the purpose of this study. These characteristics are outlined in more detail below. As the name suggests, Winne's Four-stage Model of Self-regulated Learning (Butler and Winne 1995;Winne 1995Winne , 1996Winne and Hadwin 1998;Winne and Perry 2000) describes four stages: (1) task definition, during which learners develop perceptions of the task concerned; (2) goal-setting and planning; (3) enacting the tactics and strategies chosen during goal-setting and planning; and (4) metacognitively adapting studying techniques, keeping future needs in mind. Each of these phases consists of five elements: Conditions, Operations, Procedures, Evaluations and Standards (COPES). The theory emphasizes that learners whose teachers prompt more effective processing in stage one (task definition) and stage two (goal-setting and planning) are more likely to have accurate expectations of the task (Winne and Hadwin 1998). At the second level, Winne and Hadwin (1998) describe the conditions that influence each of these phases. First, they provide information about the task conditions (e.g. time constraints, available resources and social context). Secondly, they outline the cognitive conditions (e.g. interest, goal orientation and task knowledge) that influence how the task will be engaged with (Winne and Hadwin 1998). Cognitive conditions are influenced by epistemological beliefs, prior knowledge (all information stored in the long-term memory) and motivation (Winne and Hadwin 1998).
As mentioned above, the Four-stage Model of Self-regulated Learning has four key characteristics that suit the purposes of this study very well. Firstly, the model looks beyond the focus on instructional stimuli and their effect on learning, assuming instead that all learners process the stimuli as intended (Winne 1982). The authors see learners as active agents (Winne 1982(Winne , 1985(Winne , 2006 or mediating factors in the instructional process, a perspective on instruction which is largely undocumented and needs consideration (Keller 2010b;Winne 1982). The model gives clear indications about which phases should be targeted, namely task definition followed by goal-setting and planning (Winne and Hadwin 1998). A second consideration is that each phase (one to four) incorporates the COPES process, which when combined make up the cognitive system (Greene and Azevedo 2007). This cognitive system explicitly models how work is done in each phase and allows for a more detailed look at how various aspects of the COPES architecture interact (Greene and Azevedo 2007). Thirdly, with monitoring and control functioning as the key drivers of regulation within each phase, Winne and Hadwin's model can effectively describe how changes in one phase can lead to changes in other phases over the course of learning (Greene and Azevedo 2007). This allows the model to explicitly detail the recursive nature of self-regulation (Greene and Azevedo 2007). A fourth and final reason for this model's suitability is that it separates task definition and goal-setting and planning into distinct phases, in contrast to the model of Pintrich (2000) for example; this allows more pertinent questions to be asked about these phases than would otherwise be the case when focusing on instructional interventions (Greene and Azevedo 2007;Winne and Marx 1989). In this respect the systematic literature review presented here will focus on asking such questions and identifying the attributes of blended learning environments that are deliberately integrated into or added to the environment in order to support selfregulated learning (Zumbrunn et al. 2011).

Support in blended learning environments
This study focuses exclusively on blended learning environments. In their editorial for the Journal of Educational Media, Whitelock and Jelfs (2003) described three definitions of the concept of blended learning. These definitions were also used as a categorization by Graham (2006) in the handbook of blended learning, and by Ifenthaler (2010) in his book on learning and instruction in the digital age. The first definition (based on Harrison (2003)) views blended learning as the integrated combination of traditional learning with web-based online approaches (Bersin and others 2003;Orey 2002a, b;Singh et al. 2001;Thomson 2002). The second one considers it a combination of media and tools employed in an e-learning environment (Reay 2001;Rooney 2003;Sands 2002;Ward and LaBranche 2003;Young 2001) and the third one treats it as a combination of a number of didactic approaches, irrespective of the learning technology used (Driscoll 2002;House 2002;Rossett 2002). Driscoll (2002, p. 1) concludes that Bthe point is that blended learning means different things to different people, which illustrates its widely untapped potential^. Oliver and Trigwell (2005) add that the term remains unclear and ill-defined. Taking these observations into account, the definition used in this study is as follows: BBlended learning is learning that happens in an instructional context which is characterized by a deliberate combination of online and classroom-based interventions to instigate and support learning. Learning happening in purely online or purely classroom-based instructional settings is excluded^ (Boelens et al. 2015).
A formal definition of learner support in blended learning environments does not yet seem to have been provided in research literature, although a considerable number of researchers (e.g., Kearsley and Moore 1996;Keegan 1996;Robinson 1995;Tait 2000;Thorpe 2002) have made valuable contributions by defining similar concepts. Learner support in blended learning environments often refers to meeting the needs all learners have, choices at course level, preparatory tests, study skills, access to seminars and tutorials, and so on. These are elements in systems of learner support that many practitioners see as essential for the effective provision of blended learning (Kearsley and Moore 1996;Keegan 1996). Nonetheless Sewart (1993) notes that a review of key areas of the literature dating back to 1978 does not reveal any comprehensive analysis of learner support services (see also Robinson (1995)). It is therefore particularly challenging to address the issue of learner support in blended learning. Tait (2000) describes the central functions of learner support services in non-strictly face-to-face settings most fundamentally, arguing that it should be cognitive, affective, and systemic (Tait 2000). In this study, 'support' refers to all measures taken to instigate and / or facilitate learning.
A final remark should be made regarding the term 'learning outcome'. This term is often used in the same sense as learning objectives (Melton 1997), but in our opinion this understanding is too narrow and too focused on an increase in performance. In this study, learning outcomes are defined as changes (due to support) in cognitive, metacognitive or motivational abilities, which together constitute a learner's ability to self-regulate (e.g., Allan 1996;Popham et al. 1969).

Problem statement
There is a growing realization that the precise design of blended learning environments has different impacts on learning for different types of learners. It has been suggested that blended learning makes high demands of learners' self-regulatory abilities and is therefore a major challenge for those with lower self-regulatory abilities. The opposite is also true: blended learning environments are well suited to learners who work well in environments with e.g. a lot of learner control. We do not yet know why this is the case or what a solution might be for learners who struggle. In particular, little is known about the attributes of blended learning environments that are essential to support learners and how they should guide course design. Winne and Marx (1989) and  have called for an approach to course design in blended learning that centres more closely around supporting self-regulation. As a consequence, the research question addressed in this systematic literature review is: BWhat attributes of blended learning environments support learners' self-regulation?^In answering this research question, we identify the attributes of blended learning environments that support self-regulation and define them. On the one hand, this facilitates the design of blended learning environments that meet learners' self-regulatory needs. On the other hand, it also contributes to research in the field of ICT and education by shifting the focus towards learners' self-regulation in technology-mediated environments.

Methodology
The methodological approach used to answer the research question was based both on research literature on systematic literature reviews (e.g., Hart 2009;Joy 2007) and on the methodologies used in highly valued educational reviews with similar methodological aims (e.g., Bernard et al. 2004;Blok et al. 2002;Butler and Winne 1995;De Jong and Van Joolingen 1998;Greene and Azevedo 2007;Tallent-Runnels et al. 2006;Tinto 1975). The systematic literature review methodology is particularly suited to the aim of this study, because it focuses on the identification, critical evaluation and integration of findings from a considerable number of relevant resources (Baumeister and Leary 1997). Using this methodology allows us to formulate general statements and overarching conceptualizations (Sternberg 1991). Although this methodology is most appropriate for the aim of this study, it also has its limitations. Higgins and Green (2008) described the main issues as follows: they argue, firstly, that because such a methodology allows us to target broader research questions, it inevitably restricts the depth of analysis; and secondly, that categorizing findings across the retrieved articles puts pressure on the replicability and transparency of the methodology. As elaborated on below, we propose a peer-reviewed and double-checked bibliographical approach in order to ensure transparency and replicability.
As the focus of this study is to identify and define attributes, rather than exploring each attribute in detail, the depth issue is less of a threat. Nonetheless, we propose further research avenues for elaborating on each of the attributes.
By comparing the studies on the systematic literature review methodology, it could be observed that most of the reviews suggest a similar design as presented by Hart (2009). His methodological outline and suggestions will be therefore used to perform the systematic literature review. First, general searches for background information on the study's main concepts were performed. This resulted in an initial map of related topics, a vocabulary of concepts and a provisional list of key authors. The findings of this phase were reported in the introduction of the systematic literature review and functions as a theoretical basis to reflect upon the results of this study. On the other hand, the focus on the topics to be analysed and the identification of information needs regarding the topic was established, resulting in a clear research question. This research question was reported during the problem statement. To answer this research question relevant data was collected and analysed. These procedures will be described below.

Data collection
To establish a collection of publications to be analysed and synthesized, relevant databases for retrieving publications on instruction and information (and communication) technology were identified (n = 5): Web of Science, ProQuest, EBSCOhost, Science Direct and OvidSP. The search terms used to perform the searches derived from a deductive process based on the key concepts of this study as presented in the introduction. The following search string was used: (Bblended learning^OR Bonline learning^OR Bhybrid learning^OR Bweb based learning^OR Bdistance learning^OR Bvirtual learning^) AND design AND (low OR poor OR inadequate OR negative) AND self-regulat* AND (Bprior knowledge^OR Bcognitive strategies^OR Blearning strategies^OR Bmotivation^) AND (problem* OR solution* OR effects OR issues OR explain*) AND (Badult learner^OR Badult learning^OR postgraduate OR postgraduate OR postsecondary OR post-secondary) NOT (kindergarten OR "primary education" OR "secondary education" OR under-graduate OR undergraduate OR "K-12" OR elementary). A number of additional inclusion and exclusion criteria were specified to select appropriate publications for inclusion in the systematic literature review. To be included in the review, publications had to (a) have been published between January 1985 and February 2015, (b) have no duplicates, (c) include full text, (d) include empirical evidence (research based on, concerned with, or verifiable by observation or experience rather than theory or pure logic (see: Barratt (1971); Mouly (1978)) relating to the impacts and outcomes of blended learning environments; this was to address the perceived lack of empirical evidence concerning blended learning. Finally, publications had to (e) include performance measures that reflected individual courses (micro level) or learning tasks, rather than entire programmes.

Data analysis
Following the suggestion of Hart (2009), the publications were first skimmed for structure, overall topic, style, general reasoning, data and bibliographical references. A second more detailed survey followed of the sections of each publication (introduction, theoretical foundations, methodology, etc.). The third step included the creation of a summary of each publication retrieved. This was to ensure the preservation of the rich data and context of each publication. A minimally condensed version of this summary can be found in Appendix 1. The summary includes: (a) the aim of each publication, (b) the dependent and independent variables, (c) the sample (including the characteristics of the participants), (d) the procedure or method used, (e) the measurement instrument(s) used and (f) the results and conclusions. This analysis was performed and managed in QSR NVIVO 10 and summarized in MS Word and Excel documents. Based on this third step, the analysis for common attributes was performed by comparing the different variables, results and conclusions with one another. Once the attributes were identified, a twofold (peerreviewed by the other author), double check (manual versus bibliometric (Cheng et al. 2014) to ensure inter-coder reliability) was performed to ensure that the attributes identified when synthesizing the summaries were found by both researchers individually and explicitly retrieved in the consulted publications. Thus, both researchers synthesized a sample of the summaries and compared their findings. A text search query was also used to check whether the attributes identified by analysing the summaries were also found explicitly in the retrieved publications (see for detailed methodology: Cheng et al. (2014); Graddol et al. (1994); Popping (2000); Romero and Ventura (2007); Wegerif and Mercer (1997)). Finally, based on the identification of the common attributes and the publications that refer explicitly to these attributes, a detailed analysis of the publications involved was done to determine what decisions and conclusions could be drawn from these publications. The results of this analysis can be found in the results section.

Results
Using the search string mentioned above, an initial search was performed per database, on title and abstract. In total, 247 publications were retained and imported into Endnote X7. A search for overlap or duplicates was done. The publications retrieved first were retained and the duplicate removed from the database. A total of seventeen publications were deleted and 230 publications retained. The last step was the automatic search, performed in Endnote X7, for the full texts of each abstract. A total of 88 publications were removed from the database due to a lack of full text. The remaining 142 publications were imported into QSR NVivo 10 for further analysis. All 142 publications were scanned for general relevance and empirical evidence. Reviews (n = 30) and irrelevant publications (n = 17) (see for example: BCommunity based forest enterprises in Britain: Two organizing typologies^by Ambrose-Oji et al. (2014)) were excluded. This brought the number of publications included to 95. No publications were excluded based on (d) the level of focus (course or curriculum): all the publications retrieved reported on course level.

Descriptive statistics of the publications included
General descriptive statistics say something about the field of blended learning and the inclusion of self-regulation in the discourse. The search included all publications from between January 1985 and February 2015. It is noteworthy that no publications were retrieved from the period 1985 to 2001. Between 2002 and 2009 an annual average of four publications were published relating to the search results of this systematic literature review. Between 2010 and February 2015, an average of eleven publications were published per year. The descriptive results of the systematic literature review also show which journals the majority of retrieved publications originated from. The largest proportion of publications were retrieved from Computers & Education (n = 19); Computers in Human Behaviour produced thirteen publications, followed by The Internet & Higher Education (n = 10), the International Journal of Human-Computer Studies (n = 4), Nurse Education Today (n = 3), Learning & Instruction (n = 3), Higher Education (n = 2), Journal of Computing in Higher Education (n = 2) and the International Journal of Educational Research (n = 2). These journals accounted for 61 % of all the retrieved publications. In total, 61 of the retrieved publications were quantitative; 33 included experimental interventions with pre-and post-tests in controlled conditions; 23 retrieved information using surveys; and 5 reported on quasiexperiments (e.g. no pre-or post-tests). Finally, 13 publications were qualitative in nature and used case studies (n = 5), observations (n = 1), document analysis (n = 2) or interviews (n = 5) as their method. In the mixed-method combinations of quasiexperiments and interviews, observations and document analysis were used (n = 13). Table 1 shows the number of publications retrieved by type of research and methodology used. The publications retrieved were also analysed by the learning variables taken into account. The majority of the publications (n = 57) reported on a mix of learning variables (cognition, metacognition and motivation); 30 publications reported on individual variables. Table 2 shows the number of publications retrieved by learner variable. Both the methodological data and the variables used can be found in the individual summaries presented in Appendix 1.

Attributes of blended learning for self-regulation
As mentioned above, after analysing the publications' descriptive features and learner variables (cognitive, metacognitive and motivational) a search was performed to identify common attributes of interest in the retrieved publications. Once the attributes were identified, a twofold (peer-reviewed), double check (manual versus bibliometric) was performed to ensure that the attributes identified when synthesizing the summaries Mixed methods 13 * Eight exclusions were made due to a lack of explicit reference to attributes were found by both researchers individually and explicitly retrieved in the consulted publications.
The systematic literature review presented here suggests that blended learning environments that foster cognition, metacognition and motivation and thus support self-regulation have seven main attributes. These attributes are (1) authenticity, (2) personalization, (3) learner control, (4) scaffolding, (5) interaction, (6) reflection cues and finally (7) calibration cues. Table 3 shows the number of publications retrieved per attribute: 87 reported on at least one attribute (eight were excluded due to a lack of explicit reference to at least one attribute). It is important to note that 59 articles reported on at least two attributes, with a maximum of six attributes per publication. This illustrates the interrelatedness of each attribute with the others. The summaries in Appendix 1 report on the attributes identified in each of the publications. Based on these findings the relevant publications were synthesized in more depth. Each attribute is elaborated on in more detail below.

Authenticity
In total, 29 publications appear to centre around authenticity (e.g., Ai-Lim Lee et al. 2010;Artino 2009b;Chen 2014;Corbalan et al. 2008;Demetriadis et al. 2008;Donnelly 2010;Gulikers et al. 2005;Smith et al. 2008;Ting 2013) and report its influence on cognitive (e.g., Corbalan et al. 2008;Gulikers et al. 2005), metacognitive (e.g., Chen 2014; Kuo et al. 2012) and motivational (e.g., Kovačević et al. 2013;Sansone et al. 2011;Siampou et al. 2014) variables that influence the self-regulatory abilities of learners. The retrieved publications contained several definitions of authenticity, ranging from 'real-world relevance' and 'needed in real-life situations' to 'of  important interest to the learner for later professional. In sum, authenticity was treated as the real-world relevance, to the learners' professional and personal lives, of the learning experience. It was described as being manifested in both the learning environment and the task at hand. The majority of publications retrieved referred to the motivational value of authentic learning tasks. In this respect Ai-Lim Lee et al. (2010) used a survey study and Kovačević et al. (2013) an experimental design to conclude that authentic tasks in an educational context are associated with finding meaning and relevance and therefore associated with higher motivation. In their survey study, Sansone et al. (2011) add that when learners have little pre-existing interest or motivation, tasks that practise skills needed in real-life situations were more motivating. An example is provided in the interview study of Smith et al. (2008), who report that learners wanted to be involved in education as long it proved to have a practical application and relevance to their professional background.
On the metacognitive side, a survey study included in the experimental study of Chen (2014) and Kuo et al. (2012) found that authentic digital learning materials significantly influenced learners' perceptions of learning outcome expectations, learning gratification and learning climate in web-based learning environments. Wesiak et al. (2014) conducted an experiment and analysed log-files of learners. They add to the previous findings that real-world relevance in an online medical simulation improved metacognitive skills. Taken together, these findings suggest that authentic tasks influence cognitive (e.g. prior knowledge and performance), metacognitive (e.g. learning outcome expectations) and motivational (e.g. enjoyment, intrinsic motivation) learner variables, which in turn influence the self-regulatory abilities of learners. However, Gulikers et al. (2005) conducted an experiment and emphasized that authentic tasks and authentic contexts are two different things and have different impacts on learning (no evidence was found for the superiority of authentic environments). Corbalan et al. (2008) analysed log-files during an experiment and added to this that for novice learners, the acquisition of complex skills by performing authentic tasks is heavily constrained by the limited processing capacity of their working memory and that such tasks can cause cognitive overload and should therefore be adapted to the individual needs of learners.

Personalization
We identified 24 publications which address personalization (e.g., Hung and Hyun 2010;Law and Sun 2012;Leen and Lang 2013;Liaw et al. 2010;Ma 2012;Reichelt et al. 2014;Yu et al. 2007). In these publications, personalization is defined as nonhomogenous experiences related directly to the tailoring of the learning environment (both the characteristics and objects) to the inherent needs of each individual learner (topics of high interest value). Examples include elements of name recognition or the integration of name-specific references to the learner, self-description or tailoring of the environment to the individual preferences (content, subject, etc.) of the learner and cognitive-situationing or adapting the environment to the performance level of the learner.
Some of the retrieved publications report on interventions carried out to identify the effect of personalization on a mix of learner variables, whereby Reichelt et al. (2014), using a quasi-experimental set-up including document analysis, and Leen and Lang (2013), using a survey study, found that personalized learning materials, a good fit of learning contexts integrating the personal preferences of the learners and communicative features expressed in a personalized style contribute to enhanced motivation and learning, seem to engage learners in learning processes and provide learning success. Accordingly Ai-Lim Lee et al. (2010) investigated the influence of a desktop virtual reality application's constructivist learning characteristics on learning outcomes. During this investigation they found that options regarding individual preferences relate positively to learning effectiveness and satisfaction.
Other publications reported more generally on the nature of blended learning environments and their suitability with regard to a range of learner variables. Liaw et al. (2010); Ma (2012); Mohammadi (2015); Yu et al. (2007) used survey studies and interviews to evaluate the feasibility of e-learning for continuing education and concluded that diversity, flexibility, adaptability and individualization are catalysts for increasing motivation, user satisfaction, intention to use e-learning and regulating abilities. Law and Sun (2012) did the same with regard to a digital educational game. Here, too, adaptability (to personal preferences) was seen as an influencing factor for the user experience. Although the literature retrieved seems to find a positive influence of personalization on metacognitive and motivational learner variables (e.g., Liaw et al. 2010;Mohammadi 2015;Yu et al. 2007) personalization itself had no straightforward effect on learning performance (Ai-Lim Lee et al. 2010;Reichelt et al. 2014).

Learner control
In total, 18 publications refer to the amount of control learners have in blended learning environments (e.g. (e.g., Artino 2009aArtino , 2009bCorbalan et al. 2008;Hughes et al. 2013;Hung et al. 2011;Leen and Lang 2013;Lin et al. 2012;Mohammadi 2015;Reychav and Wu 2015;Roca et al. 2006;Ting 2013;Yu et al. 2007)). These publications consider learner control to be an inclusive concept that describes the degree of control that learners have over the content and activities within the learning environment. Examples include control over the pace of the course, the content used, learning activities in which the content is presented and content sequencing which allows the learner to determine the order in which the content is provided. Corbalan et al. (2008) and Hughes et al. (2013) found in their experimental studies, including log-file analysis, that shared (learner and instructor) control has positive effects on learner motivation, and that the choice provided positively influenced the amount of effort invested in learning, combined with higher learning outcomes. In his survey study, Artino (2009b) provided evidence for the positive predictive ability of the task learners choose (rehearsal vs in-depth) on elaboration, metacognition, satisfaction and continuing motivation. During their survey study, Lin et al. (2012) found that the higher the level of control and learning afforded by a virtual-reality-based learning environment, the better the learning outcomes as measured by performance achievement, perceived learning effectiveness and satisfaction would be. While learner control seems to influence cognition (Ai-Lim Lee et al. 2010), metacognition (Artino 2009b) and motivation (Lin et al. 2012) this influence is not unfailingly positive. Some remarks are made in the publications retrieved. Corbalan et al. (2008) found that learners with lower levels of competence in a domain lack the ability to make productive use of learner control; Artino (2009a) observed, in his survey study on how feelings, and actions are associated with the nature of an online course, that a lack of control on the part of the learner results in boredom and frustration. Leen and Lang (2013) found that older adults had a strong need for a sense of belonging and personal growth, and thus a heightened interest in learner control, whereas younger adults' motives for learning were more competition-related. Learners with a high need for control might tend to adopt e-learning quickly, whereas learners with low self-control abilities tend to reject e-learning (Yu et al. 2007). For individuals with lower self-control abilities, it seems essential to establish user-friendly learning environments in the early stages of development (Yu et al. 2007). Hung and Hyun (2010) conclude as a result of their interview study that learners with low prior knowledge require a learning context provided by the instructors to sustain the learning experience.

Scaffolding
The search produced 24 publications related to scaffolding in blended learning environments (e.g., Aleven and Koedinger 2002;Artino and Jones 2012;Artino and Stephens 2009;Chia-Wen et al. 2011;Davis and Yi 2012;Demetriadis et al. 2008;Govaere et al. 2012;Kim and Ryu 2013;Koh and Chai 2014;Kuo et al. 2012;Niemi et al. 2003;Wesiak et al. 2014). These publications define scaffolding as changes in the task or learning environment that assist learners in accomplishing tasks that would otherwise have been beyond their reach. This could involve ongoing diagnosis of the amount of support learners need and the provision of tailored support based on the results of this ongoing diagnosis, both of which result in a decrease in support over time.
Some of the retrieved publications report on interventions done to identify the effect of scaffolding on cognition, metacognition and motivation. Wesiak et al. (2014), for example, found clear indications that the addition of thinking prompts provided by scaffolding services is beneficial to learners, who reported an increasing amount of effort in terms of time spent. These findings imply a positive effect of the refinements of thinking prompts and/or affective element added. This supports the assumption that scaffolding support fosters metacognition and reflection. Aleven and Koedinger (2002) conducted an experiment and concluded that scaffolding of problem-solving practice, using self-explanation, with a computer-based cognitive scaffolding tutor was an effective tool for the support of the acquisition of metacognitive problem-solving strategies and that guided self-explanation adds value to guided problem-solving practice without self-explanation. Demetriadis et al. (2008) and Govaere et al. (2012) found, using an experimental set-up, that learners in a scaffolded group achieved significantly higher scores, which indicates that explicitly asking scaffolding questions to activate learners has positive effects. Accordingly, Kim and Ryu (2013) showed that, during the assessment of a web-based formative peer assessment system, learners using such a system achieved significantly higher scores for metacognitive awareness. Devised questions, prompts, and peer interaction as scaffolding strategies are shown to facilitate metacognitive skills. Artino and Stephens (2009), on the other hand, used a survey to investigate the potential developmental difference in self-regulated learning and come up with instructional guidelines to overcome these differences. They suggest that scaffolding for the support of self-regulated learning in online learning environments should ideally be achieved by explicitly providing instructional support, structure and scaffolds of social interaction. Artino and Jones (2012) articulated the benefits of attending to learners' achievement emotions in structuring online learning environments. This way, learning and performance are improved by facilitating learners' use of adaptive self-regulatory learning strategies. Yu et al. (2007) emphasized, in their investigation of the feasibility of the adaption of e-learning for continuing education, that for learners with lower selfregulatory abilities it is essential to scaffold support around strategies of behaviour modification, to increase learners' confidence and self-regulatory abilities while maintaining their participation and improving the learning effect.

Interaction
We retained 70 publications that appear to centre around interaction (e.g., Alant and Dada 2005;Chen 2014;Clark et al. 2015;DuBois et al. 2008;Gomez et al. 2010;Ho and Dzeng 2010;Liaw et al. 2010;Lin et al. 2012;Ma 2012;Siampou et al. 2014;Ting 2013;Xie et al. 2013). These publications describe interaction as the involvement of learners with elements in the learning environment, including content (learning materials, object, etc.), the instructor (teacher, coach, trainer, etc.), other learners (peers, colleagues, etc.) and the interface (objects in the online or offline learning environment).
Some of the publications retrieved report on the positive influence of social interaction on self-regulation, whereby Ting (2013) and Reichelt et al. (2014) found in their experiments that communicative features, peer interaction and back-feedback gave learners more control over their learning. Kuo et al. (2012) emphasized in this respect that the method of the integration of collaborative learning mechanisms within an online inquiry-based learning environment has great potential to promote middle-and low-achievement learners' problem-solving ability and learning attitudes. Michinov and Michinov (2007) add to this that paying closer attention to social interaction is particularly useful during transition periods at the midpoint of an online collaborative activity. Liaw et al. (2010) found during a survey study that enriching interaction and communication activities have a significant positive influence on the acceptance of mobile-learning systems. Siampou et al. (2014) investigated whether the type of interaction influences the learners' modelling processes. Their results suggest that the online dyads focused extensively on the analysis and synthesis actions and their learning was higher than their offline counterparts. Lin et al. (2012) identified in a correlation study that the establishment of social interaction to promote intrinsic motivation increased positive affect and fulfilment in web-based environments. Ai-Lim Lee et al. (2010) found that interaction with the desktop virtual reality application only impacted learning effectiveness (positively). Gomez et al. (2010) emphasize the interaction between motivation and social interaction and perceived learning, concluding that when learners value these social interactions, they will enjoy learning more.
Other publications report on the negative influence of the lack of social interaction on a mix of learner variables. Artino (2009a) and DuBois et al. (2008) observed using an experiment that a lack of interaction results in a decrease in engagement and satisfaction and an increase in drop-out risk. In summary, it can be observed that the publications retrieved report positively on the influence of social interaction for increasing cognitive (e.g., Siampou et al. 2014), metacognitive (e.g., Kuo et al. 2012) and motivational e.g., Lin et al. (2012) learner variables. A negative influence is seen with regard to motivation when there is a lack of social interaction.

Reflection
In total, 14 publications appear to focus on cues that increase the reflective practice of learners in blended learning environments (e.g., Aleven and Koedinger 2002;Anseel et al. 2009;Ibabe and Jauregizar 2010;Kim and Ryu 2013;Martens et al. 2010;Mauroux et al. 2014). Reflection cues are defined in these publications as prompts that aim to activate learners' purposeful critical analysis of knowledge and experience, in order to achieve deeper meaning and understanding. The publications describe three main types: first, reflection during action, which takes place while learners are performing a task; second, reflection about action, which is systematic and deliberate consideration of a task that has already been completed; and third, reflection before action, which involves proactive thinking about a task which will soon be performed.
There is some evidence that reflection can be used to increase learner motivation, especially when learners are in a state of low motivation to learn (Ibabe and Jauregizar 2010). The majority of evidence supporting the influence of reflection on self-regulation-influencing variables relates to cognitive learner variables. Anseel et al. (2009) concluded, in their investigation of reflection as a strategy for enhanced task performance, that reflection combined with feedback has a more positive impact than feedback alone on task performance. Ai-Lim Lee et al. (2010) and Aleven and Koedinger (2002), who used experiments, added to this that engaging learners in reflective thinking is a significant antecedent to learning outcomes and that engaging them in explanation helps learners acquire betterintegrated knowledge.
In addition, a substantial number of publications were found that focus on metacognitive variables. Kim and Ryu (2013), for example, found that peer interaction and back-feedback gave learners more control over their learning; these learners scored significantly higher for metacognitive awareness and performance than the traditional peer assessment group, who in turn achieved higher scores for metacognitive awareness than a self-assessment group who received no peer interaction or back-feedback. Based on a survey study, Niemi et al. (2003) suggested that young learners gain new information about their learning strategies and skills through negotiation with peers and that this negotiation also helps more experienced learners strengthen their learning.
In summary, the publications retrieved report positively on the influence of reflection on cognitive (e.g., Anseel et al. 2009), metacognitive (e.g., Kim and Ryu 2013) and motivational (e.g., Ibabe and Jauregizar 2010) learner variables. Anseel et al. (2009) emphasize that learners' levels of learning goal orientation, need for cognition and personal importance affect the extent to which individuals engage in reflection positively. Ibabe and Jauregizar (2010) and Mauroux et al. (2014) supplement this claim with the finding that when leaners have low levels of motivation and acceptance of reflection, the only type of reflection tool they will use are self-assessment tools.

Calibration
The search identified 15 publications which appear to centre around cues for calibration in blended learning environments (e.g., Anseel et al. 2009;Artino 2009a;Artino and Stephens 2009;Brusso and Orvis 2013). These publications describe calibration cues as triggers for learners to test their perceptions of achievement against their actual achievement. They are used both to overcome deviations in learner's judgements from the facts by introducing notions of bias and also to address metric issues regarding the validity of cues' contributions to judgements. Two main types of calibration cues were identified in the publications retrieved: prompts that aim to trigger metacognitive monitoring, such as reviewing content, and secondly, checklists and timed alerts to summarize content and practice tests to help learners compare their own perceptions and the facts.
Using an experimental design Vighnarajah et al. (2009) found that learners reported practising different self-regulated learning strategies (intrinsic and extrinsic goal orientation, control of learning beliefs, rehearsal, elaboration, critical thinking, peer learning, and help seeking). The strategies that interested learners the least were task value, effort regulation, and metacognitive self-regulation. Artino (2009a) illustrated the importance of learner goal-setting by showing that learners with career aspirations directly related to the course content would be more likely to report adaptive motivation and academic success than their peers. Using a survey study, Brusso and Orvis (2013) found that learners who experienced a larger goal-performance discrepancy at the beginning of a course performed worse in the subsequent sessions than those whose performance more closely mirrored their goals. The two survey studies conducted by Brusso and Orvis (2013) and Anseel et al. (2009) suggest that a combination of reflection interventions and goal-setting instructions (looking back on past behaviour by means of coached reflection and managing future behaviour by setting goals) appears to be a particularly strong intervention. Artino and Stephens (2009) illustrate this by presenting two instructional strategies for helping learners identify and set challenging, proximal goals and for providing them with timely, honest, explicit performance feedback.
Despite the moderate number of publications retrieved, the evidence indicates the importance of helping learners make a reasonable estimation of the instructors' expectations and their own capabilities. The studies call for appropriate cues for task definition, goal-setting and planning in order to influence the cognitive (e.g., Brusso and Orvis 2013) metacognitive (e.g.,Artino and Stephens 2009) and motivational (e.g., Artino 2009a) learning variables that in turn influence selfregulation.

Conclusions and discussion
The aim of this systematic literature review was to identify attributes of blended learning environments that support self-regulation. An inductive or bottom-up approach was used. Following the initial literature analysis, seven attributes were identified and defined. First, authenticity was defined as the real-world relevance of the learning experience (both task and learning environment) to learners' professional and personal lives. Secondly, personalization was defined as non-homogenous experiences related directly to the tailoring of the learning environment (name recognition, selfdescription and cognitive situationing) to the inherent needs of each individual learner. Third, learner control was defined as an inclusive concept which describes the degree to which learners have control over the content and activities (pace, content, learning activities and sequencing) within the learning environment. Fourth, scaffolding was defined as changes in the task or learning environment (support which diminished over time) which assist learners in accomplishing tasks that would otherwise be beyond their reach. Fifth, interaction was described as learners' involvement with elements in the learning environment (content, instructor, other learners and interface). Sixth, reflection cues were defined as prompts that aim to activate learners' purposeful critical analysis of knowledge and experience (before, during and after), in order to achieve deeper meaning and understanding. Finally, calibration cues were described as triggers for learners (forms, timed alerts and practice tests) to test their perceptions of achievement against their actual achievement and their perceived use of study tactics against their actual use of study tactics.
While this systematic literature review has attempted to identify and define the seven attributes as clearly as possible, it remains unclear what the exact relationship is between each attribute and the self-regulatory behaviour exhibited by learners. It is beyond the scope of this review to address this problem directly. In what follows, however, we make a first attempt to explain the relevance of each attribute using the Four-stage Model of Self-regulated Learning developed by Winne and Hadwin (1998). As mentioned earlier, it is the first two phases of this model-task definition and goalsetting and planning-that are most susceptible to instruction, so the main focus will lie on these two phases (Butler and Winne 1995;Winne and Hadwin 1998;Zimmerman 2000).

Attributes and their relation to the four-stage model of self-regulated learning
In promoting self-regulation, both constructivist and sociocultural theories stress the importance of building on learners' existing knowledge and skills (Harris and Pressley 1991;Vygotsky 1978). It has been argued that, rather than providing direct instruction about predefined strategies, teachers should provide support that assists learners to self-regulate their own learning effectively (Butler 1998;Palincsar and Brown 1988). Based on this premise, a search for attributes that support self-regulation in blended learning environments was performed. Authenticity and personalization in the environment seem to contextualize and individualize the conditions and standards needed to make appropriate judgements about the task at hand and thus direct goal-setting and planning. Both authenticity and personalization support learners in situating the task in a realistic, familiar context and tailor it to the general preferences of the learner. In doing so, the environment takes into account the cognition, metacognition and motivation of the learners and supports the identification of conditions (how the task at hand will be approached) and standards (criteria against which products will be evaluated) (Butler 2002;Reeve and Brown 1985). It is worth bearing in mind, however, that when learners have had negative prior experiences, they will judge the conditions and standards less accurately (Lodewyk et al. 2009). Similarly, learner control and scaffolding seem to help learners maximize their degree of control over their own learning and evaluate their learning (comparing standards) more accurately (Perry 1998;Perry et al. 2004) and thus set more appropriate goals and plan further actions. As the learners are allowed to choose how to learn more freely, and as the support provided is tailored and reduced over time, learners experience how products should be evaluated according to the standards they set themselves and thus how to maximize self-regulation. The relation between learner control and scaffolding is worth mentioning, because when learners have low self-regulatory skills, for example, a high degree of learner control in the environment will leave them wandering aimlessly unless they are supported by scaffolds that gradually disappear over time (Lynch and Dembo 2004). Interaction and cues for reflection expose learners to the various procedures available (e.g. through social interaction, reflection questions, etc.), providing them with self-initiated feedback about their own performance and helping them to select appropriate procedures for tackling the task at hand (Kumar et al. 2010). This supports learners in identifying the procedures needed to define and execute the task, which influences their planning of the actual performance. While reflection and interaction support practice retrospectively, they do not have an impact on faulty calibration mechanisms. Cues for calibration therefore need to be put in place to make learners with low selfregulatory abilities aware of such problems. Cues for calibration help learners assess their performance correctly and compare it to the standards they initially set and act upon any perceived deficit (Hadwin and Winne 2001). Involving learners in processes of external feedback (e.g. by taking tests) will provide them with a realistic framework against which to compare themselves (Winne and Jamieson-Noel 2002).

The attributes and their relation to current learning theories
To consolidate the relevance of the attributes identified for the design of blended learning environment, they were also tested against other well-established learning theories and instructional design models, with positive results. While conceptual transparency is sometimes lacking within and between these models, our results bear striking similarities to the Four Component Instructional Design model of van Merriënboer (1997), which focuses on task execution support. Van Merriënboer's model states that learners will be able to complete a task when there is a degree of (1) authenticity ( van Merriënboer 1997); (2) personalized task selection (Salden et al. 2006); (3) learner control in selecting their own learning tasks (Corbalan et al. 2009); (4) support for calibrating learners' goal directedness ( van Merriënboer 1997); (5) scaffolding for complex tasks to prevent cognitive overload (van Merriënboer et al. 2002); (6) reflection triggered by cues integrated with feedback (van den Boom et al. 2007;Wouters et al. 2009); and (7) interaction with peers (van Zundert et al. 2010). It can also be observed that the attributes identified by the review presented here are among the basic components of any powerful learning environment (De Corte et al. 1996;De Corte et al. 2003) as well as a typical constructivist learning environment (Jonassen 1999;Wilson 1996). These conclusions support the view that the attributes of blended learning environments identified as supporting self-regulation can in fact be seen as basic attributes of any effective learning environment; they can therefore be found in learning theories and instructional design models that are not specifically related to blended learning. This finding contributes to the question raised by certain researchers of whether the concept of blended learning should be reconsidered (Oliver and Trigwell 2005). Our findings do indeed suggest that the concept of blended learning could be simplified both theoretically and conceptually. The principal value of this review, however, lies in its identification of design features that foster learners' self-regulation. To the best of our knowledge, this is the first study of self-regulation to present such a framework of design attributes.

Limitations of the study
A number of limitations, both of the publications described and the systematic literature review itself, should be acknowledged. The publications retrieved for this contribution demonstrate both theoretical and methodological limitations and inconsistencies. With regard to methodology, we often see a lack of awareness about the studies' reliability issues. In many case, only the group receiving treatment is described; pre-and posttests are only administered to the experimental group; and/or no control group is included. Such methodological flaws make it difficult to ascertain the exact design of a study and gain insight into its validity. It also remains unclear in some cases which variables are targeted by the study design. A well-thought-out model of variables and their interactions and mediations would be beneficial for reviewing the literature and reflecting upon interactions and common characteristics in the wide-ranging field that is instruction and support in blended learning environments. Furthermore, the literature often reports on multiple related concepts at the same time (e.g. proactive stickiness, learning gratifications, computer self-efficacy, learning outcome expectations, social environment, interaction, learning climate, system characteristics and digital material features). This makes it difficult to ascribe certain effects to specific interventions or variables.
A number of theoretical limitations were also evident in the publications retrieved. First, conceptual transparency, including situating the concepts within a broader theoretical framework or instructional theory, is problematic. Due to a lack of clarity about other potentially influencing variables in the model used, or the learning environment in which the study was conducted, it is sometimes difficult to determine which variable is responsible for which outcome. Secondly, the studies appear to make minimal use of instructional design approaches. Using such systematic approaches would help give more insight into the interventions and their conditions. Without a detailed description and specific design, however, study replication is impossible. The third and final remark is that the existing literature is often descriptive rather than theoretical or explanatory. Studies frequently reported on observations using surveys, for example, instead of researching the reasons behind these observations by conducting interventions and experiments. This point also influences the nature of the systematic literature review presented in this study. Specifically, the review is unable to describe in great depth which interventions are successful for which variables. In addition, it also describes the attributes that affect cognitive, metacognitive and motivational variables rather than explaining, for example, the precise degree of learner control needed to evoke a change in motivation for learners with low self-regulatory abilities.
As stated above, the systematic review methodology also has its limitations. One limitation is the scope and level of detail provided about each of the attributes identified, which can be seen as a constraint for immediate application in practice (e.g. design of learning environments). The main focus of this review was to identify attributes rather than focus immediately on application; the output therefore remains descriptive. Accordingly, our first suggestion for future research is to undertake a deeper analysis of each of the attributes presented by performing an additional, extended literature review per attribute in order to gain a more profound understanding of the current situation. The second limitation concerns the development of the search string and the validity of the attribute categorization. The approach combined a theory-driven search string with inclusion and exclusion criteria; a twofold (peer-reviewed), double (manual versus bibliometric) check was also performed, resulting in a robust selection of publications. This contributes to the replicability and validity of the study and to the detailed demarcation of attributes. On the other hand, however, a reasonable number of potentially relevant publications (e.g. reviews of different support types, learner variables or attributes) were excluded. Thirdly, while considerable effort was made to interpret the publications correctly and as intended by their authors, other potentially relevant findings may have been overlooked due to the explicit search for concepts relating to selfregulation in blended learning environments.
Despite the limitations mentioned above, this systematic literature review makes a number of useful contributions. It provides a clear overview of the existing literature by identifying and defining seven attributes that appear to be worth taking into account when designing blended learning environments that support selfregulation, namely authenticity, personalization, learner-control, scaffolding, interaction and cues for reflection and calibration. In addition, one key finding will help further the debate on the relevance of models for designing blended learning environments: attributes of blended learning environments that support selfregulation appear to tie in closely with the attributes of any effective learning environment. Finally, this study has the potential to function as a basis for further research on the attributes of blended learning and technology-mediated environments that support self-regulation. It would be useful not only to review existing research further on self-regulation per attribute (as suggested above), but also to obtain more experimental evidence for each attribute. Such studies might involve the following steps: firstly, create a sound basis for comparison using a wellestablished instructional design model (e.g., Merrill 2002; van Merriënboer 1997) for the experimental and control conditions. Secondly, after administering a pre-test for one of the self-regulatory variables, a treatment can be implemented among an experimental group focusing on the attributes of self-regulation; this will help clarify how certain attributes relate to the variable being investigated. A third and final step would be to compare the post-tests of the experimental and control groups and describe any differences found. Using such an approach would enhance the replicability and validity of the study and help to unravel how and why the attributes identified here impact the variables responsible for learners' selfregulatory abilities. • The authentic web-based medium presented seemed to be an effective tool for academic discussion and problem solving. Nonetheless, learners need to be supported in using the web-based medium to enhance academic discourse.

Appendix 1
Educ Inf Technol

Results
Attributes & Learner variables • Learning will be improved when negative emotions are minimized and positive emotions are maximized.
• The learning task and the technology should be considered in the design of learning environments.

Artino and
Stephens (2009) • To explore potential developmental differences in self-regulated learning.
In particular.
• To examine whether there are motivational and self-regulatory differences between undergraduate and graduate learners enrolled in online courses. • Instructors have to consider their online audience, adjusting the type and amount of structure, support, and scaffolding they provide during online instruction (provide explicit instructional support and structure, develop learners' self-efficacy and scaffold online discussions). their learning and contribute to further success.

IX
• Formal education should also develop learners' informal learning ability for a lifelong learning process. It is suggested that instructors ideally support self-regulatory interventions.

Cholowski and
Chan (2004 and support of the learning tasks on the learners competence scores. IX: task difficulty, competence, task load, training time and germane load. DX: learning outcomes, learning efficiency and task involvement. N = 55. Method: • Learning outcomes of learners who received adaptive training were higher, and they experienced a lower task load during practice than learners who received non-adaptive training.

Attributes & Learner variables
• To investigate whether perceived task load would make learning more effective and efficient.
• To assess whether shared control has positive effects on learner motivation.
quant. experiment + log-file analysis + survey. • Learners in the shared-control conditions showed higher task involvement. Choice provided positively influenced the amount of effort invested in learning, combined with higher learning outcomes. • It is possible to improve individual learning in a technology environment, by implementing questioning strategies.
Donnelly (2010) • To investigate, in a tutorial setting, the factors that govern the success of interaction in blended problem-based learning. IX: use of face-to-face PBL tutorials, online journal entries, use of video conferencing, use of asynchronous discussions and use of synchronous chat and international guest collaboration. DX: interactions as transactions and interaction in blended problem-based learning. N = 17.
Method: qual. observation + quant. log file analysis + interview + selfreflective papers. • Conditions for the effectiveness of blended learning: the selection of authentic tasks within the problem which demand a division of labour between the face-to-face and the online environments, the maintenance of common goals and motivation, the mutual expectations of learners and tutors, the awareness of the individual role and group leadership, and changes in these and the availability of appropriate communication tools.
Att.: authenticity and interaction. LX: cognition, metacognition and motivation. • Content must include multimedia animation, actual case introduction, self-achievement simulation, and suitability of teaching materials unit, which will influence the learning Att.: interaction. LX: cognition and motivation. • Motivational mechanisms of pre-training self-efficacy and positive error framing also exhibited significant

Educ Inf Technol
Att.: learner control and interaction. LX: cognition, metacognition and motivation. • Learners with low prior knowledge require an inclusive curriculum and learning context provided by the instructors to sustain the learning experience.

Educ Inf Technol
• Metacognitive reasoning based on learners' initial circumstance and academic advising arrangement with an advisor played a critical role, starting with the earliest stage of first arrival.
Att.: Personalization and interaction. LX: metacognition and motivation. Hung et al. (2011) • To investigate the role of the multimedia disclosure method for informed consent and its contribution to higher learning motivation and learning interest, to better remembering, comprehension and satisfaction than the conventional method.
IX: disclosure method and psychosocial learning processes. DX: learning outcomes. N = 112. Method: quant. survey. • Different disclosure methods lead to significantly different learning motivation and learning interest and outcomes.
• During the psychological learning processes, learning motivation and learning interest were positively correlated with learning outcomes (remembering, comprehension, and satisfaction), and correlations with comprehension and satisfaction were significant.
Ibabe and Jauregizar (2010) • To assess the degree to which learners take advantage of a self-assessment tool. IX: availability of a self-assessment tool, interactive self-assessment exercises and different metacognitive variables. DX: taking advantage, better grades, • Better academic performance for learners that use interactive selfassessment were measured.
Att.: interaction. LX: cognition and metacognition. • In a wiki, groups tend to be collaborative, whereas in a threaded discussion, groups tend to be more cooperative.
Jonas and Burns (2010) • To undertake a module evaluation which formed part of the universities' teaching and learning strategy. IX: limited IT skills, feeling isolated, lack of perception regarding e-learning, motivation and development of independent learning skills, reduction in travel costs and positive academic support for learning. DX: learning outcomes. N = 13. Method: quant. survey.
• Six factors that restricted the achievement of learning outcomes: use of IT skills, feeling isolated, lack of perception regarding e-learning, motivation and development of independent learning skills, reduction in travel costs and positive academic support for learning).
Kim and Ryu (2013) • To assess a web-based formative peer assessment system emphasizing learners' metacognitive awareness for their performance in ill-structured tasks.
IX: attitudes toward peer assessment, motivation, identification of the context, clarity of the id process, completeness of the id, justification, critical thinking and creativity. DX: • Sequential metacognitive learning processes help learners monitor their learning and adapt strategies that are not working effectively.
LX: metacognition. • Feasibility in the form of learner satisfaction is an important factor when developing training.

Educ Inf Technol
• Learners had high levels of satisfaction with both the clinical content and the technical features of the training. Being able to obtain training online greatly increases accessibility and dissemination. The fact that the training was done by an experienced, but newly trained, psychologist gives promise for increased dissemination of the applied training as well.
Koh and Chai (2014) • To employ cluster analysis to categorize teachers into groups based on their self-reported technological pedagogical and content knowledge before they were engaged in lesson design activities as part of their professional development. IX: pre-technological knowledge, pre-pedagogical knowledge, pre-content knowledge, pre-pedagogical content knowledge, pre-technological content knowledge, pre-technological pedagogical knowledge and pre-technological pedagogical content knowledge. DX: effectiveness and user satisfaction. N = 266. Method: quant. experiment + survey. • For in-service teachers who were already familiar with curriculum, the transformation of content with technology-based approaches needs to be emphasized in design activities.
• Both pre-service and in-service teachers, regardless of their cluster membership, it seemed clear that the design process was inherently complex and could be better scaffolded with distributed intelligence.

Results
Attributes & Learner variables could be defined in terms of relevance and curiosity evoking. Kuo et al. (2012) • To propose a hybrid learning mechanism for improving learners' web-based problem-solving abilities via the combination of the cognitive apprenticeship model and the collaborative learning strategy. IX: interest in learning social studies, immersion in learning social studies, capability of learning social studies, usefulness of learning social studies and attitude toward problem-solving. DX: problem-solving ability and learning attitude. N = 58. Method: quant. experiment + survey.
• The method integrating cognitive apprenticeship and collaborative learning mechanisms in an online inquiry-based learning environment has great potential to promote middle-and low-achievement learners' problem-solving ability and learning attitudes.
• Hybrid approaches could ease their learning anxiety via the inspection of high-achievement peers, while think aloud is essential for these learners when conducting the cognitive apprenticeship process.
Lafuente Martínez et al. (2015) • To explore the role of e-assessment in making the learning process more visible to the instructor, while revealing its impact on the adjustment of ensuing feedback. IX: e-assessment. DX: learning process visibility. N = 73. Method: qual. document analysis + interview. • Promote peer-to-peer communication which can be recorded by a wide range of technological tools throughout the activity. Use asynchronous text-based communication as it is still a highly effective device to enable high learning transparency.
• Consider formative assessment activities as a means for gathering information to improve feedback, and not only to control and grade learners. Engage learners in dialogic-guidance feedback formats. Learners expect support, they Att.: authenticity, personalization, learner control, reflection and interaction. LX: metacognition and motivation. Att.: Learner control and interaction. LX: cognition.

Educ Inf Technol
Leen and Lang (2013) • To explore motives of young and old learners to participate in two ICTcourse settings: e-learning and face-toface courses.
• To exploring individual differences in learning motivation between young and older learners in the field of computer based learning. IX: belonging, instrumentality, personal growth, and competition. DX: learning motivation and personality. N = 211. Method: quant. survey. • Older learners expressed stronger motives of belonging and personal growth, and thus expressed a stronger interest in self-determined and intrinsic learning and social motives. Young learners, in contrast, strongly endorsed competitive-related motives of learning.
• Older learners showed higher instrumentality when the difference between chronological age and subjective age is big.

Results
Attributes & Learner variables significant positive influence on the acceptance of m-learning systems.
• A classification for m-learning affordances is presented: educational content and knowledge delivery application, adaptive learning application, interactive application, collaborative application and individual application.
Lin (2011) • To explore the determinants of the e-learning continuance intention of learners with different levels of e-learning experience.
• To examine the moderating effects of e-learning experience on the relationships among the determinants. IX: frequency of negative critical incidents, perceived ease of use and attitude. DX: continuance intention. proper facilitations and associations.
• Identification of guidelines: designing multisensory learning experiences, creating a storyline, mood building, fun in learning, and establishing social interaction.
Att.: learner control and interaction. LX: motivation. • Individual difference factors for the learner showed significant paths to effort expectancy for only personal innovativeness and self-efficacy.

Educ Inf Technol
Finally the relationship between personal innovativeness and performance expectancy was significant.
Att.: interaction. LX: cognition and metacognition. Ma (2012) • To identify the advantages and disadvantages of computer-aided online distance learning for college teachers.
IX: conception on learning (metacognition and cognitive strategies). DX: learning outcomes and academic performance. N = 118. Method: qual. case study + interview. • Advantages of online distance learning: resourcefulness and adaptability or flexibility were identified.
• Disadvantages of online distance learning: limited interaction (lack of interaction causes problems), little instructional variation, the metacognitive and cognitive strategies needed, self-regulation needed and IT-skills needed were identified.
Att.: personalization and interaction. LX: cognition and metacognition. Makoe et al. (2008) • To investigate whether learners' approaches to learning via online peer assessment will show a stronger relationship to learning outcomes than their respective conceptions of learning. IX: self-conceptions of learning. DX: learning outcomes and approach to learning. N = 163. Method: quant. experiment + qual. interview. • At the main level there was a significant association between conceptions and approaches.
• Learners embarking on distance education seem to hold distinctive conceptions of learning, which Att.: interaction. LX: cognition and metacognition. • Implications: stimulation of reflection is important, strong guidance and feedback about reflection, relevance of the mobile and online learning journal and use of the mobile and online learning journal.
• The use of reflective online learning journals, without the incentive of marks, is relevant and feasible.
Att.: reflection. LX: metacognition and motivation.   the degree to which learners reported using motivational strategies that emphasized the value of potential studying-related outcomes.
• Strategies aimed at enhancing or sustaining motivation to reach learning outcomes may be more defined in terms of strengthening why learners should exert effort and persist in the learning task, and these kinds of strategies may be less dependent on the learning context.
• Discouraging exploration of the Internet may negatively impact learners' ability to sustain interested engagement while learning on their own. • If the questioning approach was used, this may result in favourable scores early on, but overall the remaining deliverables and final marks may be lower.
• It is suggested this knowledge articulation dialogue method would better suit quantitative subject matter courses.

Results
Attributes & Learner variables Tan and Richardson (2006) • To investigate the writing of short messages, using a sociocultural perspective of literacy as a social discursive practice that implicates identity construction. IX: SMS messages, messages in class and online messages. DX: out-of-school practices. N = 31. Method: qual. document analysis + interviews. • In assigned school writing, the activity was one of language study and practice entailing the maintenance of school values and academic and examination discourse. School writing, done within the examination-oriented and often teacher-centred class, consisted of set text types that fit examination genres.
• In learners informal interactions, learners wrote freely to maintain friendship ties, to overcome boredom, and basically to fulfil their need for meaningful communication. Content in learners' messages was unguarded and uncensored, revolving mainly around relationships, school and social life.
Att.: authenticity, personalization and interaction. LX: metacognition and motivation. Tao (2008) • To comprehend the teachers' and learners' perceptions on concerns toward e-learning issues.
IX: learning effect, administrative challenges, customization, geographic and content integration and instructional design challenges. DX: perception on institutional e-learning issues N = 145. Method: quant. survey.
• Learners have black-or-white perceptions on the use of e-learning, they see learner and administrative support as crucial and rather feel a lack of competitive awareness on the professional market.
Taplin et al. • It is necessary to be cautious of qualitative valuations of iLectures.
• It appears that some learners may agree that something is worthwhile if they perceive it to be free.
Attributes: interaction. LX: motivation. • Mobile technologies add new dimensions to learning activities, both the personal and portable nature of the devices, as the kinds of learning interactions they can support. Mobile learning enables learners to interact and capture experiences in both physical and social realms, and makes learning more experiential and multifaceted.

Educ Inf Technol
• Guidelines: mapping subject content onto social interactions, recording social interactions, synthesis of group behaviours and subject content and delivery of instructional information and visualization of the design framework.
Att.: authenticity, learner control, scaffolding, refection-evoking and interaction. LX: metacognition and motivation. Tseng and Kuo (2010) • To propose and validate a self-regulation model that explores the effects of social capital and social cognitive factors on knowledge-sharing behaviour. IX: community identity and interpersonal trust. DX: social awareness, knowledge-sharing behaviour and knowledge-sharing self-efficacy. N = ?. Method: quant. survey.
• Knowledge-sharing behaviours in the online community exhibit a triadic interplay among the community identify, interpersonal trust, social awareness, learners' perception of self-efficacy, and knowledge-sharing behaviour in the online environment.
Verhagen et al. Att.: personalization, calibration and interaction. LX: metacognition and motivation. Frequent strategies appear to be intrinsic and extrinsic goal orientation, control of learning beliefs, rehearsal, elaboration, critical thinking, peer learning, and help seeking.
• Strategies that interest learners the least are task value, effort regulation, and metacognitive self-regulation. quasi-experiment + pre-and posttest + qual. interview significantly although the assessment showed mixed findings.
• The course benefited from being new and giving the learners a broad view.
• Critical thinking was improved among the learners. Time spent with the simulation increased.
• Positive effect of the refinements of thinking prompts and / or affective element added to the scaffolding service.
• The type of notes taken by the learners, during the think aloud method, supports the assumption that scaffolding support fosters metacognition and reflection. • Strong relationships between social and learning interactions during these five phases of social conflict development.
Att.: authenticity and interaction. LX: motivation. • Approaches to learning via online peer assessment were less related to the learning outcomes than conceptions of learning.

Educ Inf Technol
• Support for deep learning is advisable.
Att.: scaffolding and reflection. LX: metacognition and motivation. Yu et al. (2007) • To investigate the feasibility of developing e-learning.
• To examine reasons for adopting or rejecting e-learning as an alternative way to conduct continuing education for public health nurses. IX: age, education level, marital status, job position and previous experience in web-based learning. DX: feasibility of adopting e-learning as an alternative way of continuing education and reasons for adopting or rejecting e-learning. N = 233. Method: quant. survey. • Asynchronous e-learning courses are suitable for individuals with high self-control, it allows them to learn in remote locations according to their own needs and pace.
• Needs assessment is strongly recommended in the programme preparation stage. Only by fulfilling learners; individual needs, reducing learning barriers, increasing their motivation and self-controlling ability, can this approach be successful.
Att.: personalization and learner control and reflection. cLX: metacognition and motivation.
(IX independent variables, DX dependent variables, Att. attributes and LX learning variables) Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.