Collaborative design as a form of professional development

Context

In 2012, a working group at the USC Annenberg Innovation Lab convened to explore the sorts of professional development that might help educators enact “participatory” models of learning (Jenkins 2009). One of the outcomes of this workshop was an initial model of professional development (Hickey and Itow 2012) that was subsequently implemented and refined with several individual teachers in face-to-face and online settings. These implementations took place with eight teachers in a small Midwestern college town. Seven of these teachers taught face-to-face courses as well at large public high schools in and around the small Midwestern town. In order to distinguish this participatory approach from more “individualized” approaches to personalization, this model is tentatively characterized as participatory professional development for personalized learning. In 2013 Hickey and Itow were invited to use this new approach to redesign the English Language Arts (ELA) department of a small university-run online high school. This provided an ideal opportunity to explore whether the initial model of professional learning could indeed provide sufficient agency for collaboration between a group of teachers and a researcher to allow fundamental transformation. The existing classes were essentially “correspondence courses” where students downloaded assignments, completed them, and uploaded them for grading by the teacher. Five new teachers were hired with the express charge of collaboratively designing and then teaching four new ELA courses (one for each of the four secondary grades). The collaborative design took place over a 6 week virtual summer workshop led by the researchers.

This work grew out of prior published work on situative approaches to student learning and is grounded pragmatically but resolutely in situated theories of cognition and learning. (e.g. Greeno et al. 1998). By situating professional development in the contexts of teachers’ classes (whether physical or online), teachers can meaningfully participate in discussions that challenge their tacit assumptions about knowledge and stimulate reflective discourse.

Situatedness

Given that accountability pressure often functions to disempower teachers, this approach to professional development is intended to help teachers enact new participatory approaches to instruction while accommodating concerns over student and teacher accountability. It leverages the social aspects of online networks—such as discussion forums, wikis, and commenting—to foster a participatory environment. In this environment, teachers form a professional learning community that can be used for support as they grapple with new pedagogical practices and discuss how they might foster productive types of student engagement with disciplinary knowledge (Engle and Conant 2002) in their classrooms. The learning community is particularly concerned with fostering in their classrooms the same kind of participatory environment teachers experience during the professional development.

In this approach, both teacher learning and student learning are organized around a core participatory instructional routine. This routine manifested first in the professional development activities and then in the activities the teachers developed for their classes.

Agency

The five professional design principles introduced above were used to organize an online professional development workshop. The overall goal of the workshop was to help the teachers create new online courses that enacted the core participatory routine described above and related assessment practices. In particular, teachers were encouraged to focus their assessment and formative feedback for their students more directly on engaged social participation and less directly on apparent individual mastery.

The workshop structure had teachers work on parallel activities and then meet in thrice-weekly videoconferences to review and discuss their efforts. Consistent with the first professional development principle, the workshop was initiated with teacher learning activities around the core instructional routine introduced above. This was effective in helping the teachers appreciate the central role of learner agency in participatory teaching. Giving the teachers agency to collectively negotiate how the participatory routines would be designed in their online classes presumably prepared them to then give their students agency to collectively negotiate how those routines would ultimately be enacted.

Cyclical nature of learning and change

This workshop represented the first formal pilot of the professional development model, though the model had been implemented and refined in small trials with select teachers prior to this study. The researchers initially guided the teachers through the curricular design process, stepping back as the teachers began to form a professional learning community. Throughout the workshop teachers were asked to reflect on their learning as they designed and implemented their curricula. The teachers’ learning community served as a support system, allowing teacher-leaders to emerge. Fostering this learning community was a laborious but necessary step in refining the design principles for this approach to professional development, but it was less laborious than previous efforts (Itow and Hickey 2012).

The central goal in studying this collaboration was uncovering the issues teachers face when integrating new theories of learning into their teaching practice. This research was structured using design-based implementation research (DBIR) (Penuel et al. 2011) because it positions teachers as an integral part of the research team. The first of four elements of DBIR, focus on persistent problems of practice from multiple stakeholders’ perspectives, emerged as a focal point of analysis. In this study, the persistent problem was defined by the research team as test-driven accountability pressures that threaten to narrow and decontextualize learning unless effective alternatives are provided. The openness of the professional learning community allowed this problem to be discussed and debated. When the teachers discussed the persistent problem, they primarily attributed the narrowed and decontextualized learning to pressure to enhance standards-based achievement on externally-developed achievement tests. This presented an opportunity for the researcher to point out the many broader practice-oriented standards in the new Common Core English standards and recognize the opportunity that they presented for organizing participation.

Because DBIR involves teachers directly in research, the use of this framework allowed for teachers to collaboratively explore new concepts, design learning environments, and aid one another in the learning process in an iterative and structured fashion. The DBIR framework facilitated collaborative inquiry amongst the entire research team, allowing for teachers’ needs and experiences to influence immediate and future changes to the approach.

This approach to professional development grew out of a local, situative theory for learning and assessment for students. It continues to be refined as the research team uses teachers’ insights and feedback about their experience with the model to make immediate adjustments to the current implementation while flagging issues to be addressed for the next iteration.

Just as participatory professional development has been refined in an iterative process, teachers were reminded to make adjustments to their designs based on their experience and feedback from their students. They were then encouraged to make formal refinements to their designs and prepare to implement them the next time they taught the course.

Key findings

The most important finding is that this initial effort to begin scaling up this professional development model was ultimately successful. While they never met in person, the group soon built a community and found a routine. All four courses were successfully designed by the end of the summer. The remaining four teachers successfully implemented the four courses in the Fall 2013 and Spring 2014.

The extensive commenting and online discussions provided examples of collaborative agency and cyclical change beyond what was observed in the thrice-weekly videoconference. Across the six-week workshop, the teachers assumed more and more the responsibility for determining how the participatory learning and assessment activities could be enacted in these particular classes with the learning management system the school was using. In the first weeks, the researcher gave quite detailed feedback on all of the teachers’ curricular designs and was contacted directly by each of the teachers when questions arose. Beginning in week two, however, and continuing to the end of the workshop, the teachers began to turn to each other for design advice, and one teacher in particular took on a leadership role. This teacher began offering suggestions and changes before such suggestions were requested; this allowed the researcher to step back and let the teachers help each other as they grappled with this new situated and participatory approach to learning and assessment.

All five designing teachers expressed that over the 6 weeks they gained a sense of agency in the community, which helped them gain a better understanding of how to integrate social practices, including networked writing, into their classroom practice. Each teacher reported continuing to use the concepts and skills they learned in the professional development. The teachers’ experiences shaped the refinement of participatory professional development, and contributed to our understanding of how to provide participatory professional development for personalized learning that impacts student achievement and engages learners in networked writing.

2013 was an accreditation year, and the reviewing agency cited this work and the resulting interaction in the courses as a core reason for awarding the school a full 5 year accreditation. The school administration have requested that the researchers expand their effort expand both the professional development model and the participatory learning and assessment activities to other content domains at the school.

Context

The three studies presented in this section took place in the frame of a research program (Pieters and Voogt 2008) that investigates relationships between sustainable curriculum innovation and collaborative design in teams of teachers, further addressed as teacher design teams (TDTs). The assumption underlying the program is that TDTs foster sustainable curriculum development and contribute to professional learning of participating teachers. The three studies reported here followed a design research approach (McKenney and Reeves 2012). In particular, the studies investigated how TDTs contributed to teacher professional learning in the context of curriculum reform. The three studies are part of a larger number of studies conducted in the frame of the research program and can be considered as an example of Borko’s second phase, a well-specified professional development scenario enacted in different settings.

The first study (Anto 2013) took place in the context of a reform in Ethiopia to increase student-centered approaches to teaching and learning. The specific problem addressed was the need to increase the level of English language teaching in a remote Ethiopian University by introducing a communicative approach to language teaching using audio technology. The second study (Bakah 2011) took place in the context of a reform to upgrade Ghana’s polytechnics to higher education institutions. The specific problem addressed was the professional development of lecturers in engineering with the aim to align the curriculum with needs of industries. The third study (Kafyulilo 2013) took place in the context of a reform aiming to integrate technology in secondary education in Tanzania. The focus of the study was on pre- and in-service teachers’ development of technology integration competencies. Mixed methods designs were applied to collect data through questionnaires, individual and focus group interviews, and observation of TDTs interactions and classroom implementation of designed artefacts.

Situatedness

The TDTs were designed based on characteristics of effective professional development (e.g. Borko 2004; Penuel et al. 2007; Elmore and Burney 1999). The Ethiopian study was situated in a remote university, where the TDT of English language teachers started with a kick-off workshop to introduce and discuss the design task and the concept of collaborative design in teams. In Ethiopia, facilitators (experienced peers) and novice teachers collaboratively designed communicative English language lessons. The newly designed lessons were enacted, observed, and feedback was shared. In the Ghana study, TDTs were formed in the automobile, electrical and production engineering departments in two polytechnics. The TDTs prompted the teachers to bridge the gap between syllabus and industry competency standards, by creating situated learning experiences; this caused the teachers to restructure their syllabi to reflect current technology developments in industries. The Tanzanian study took place in a teacher education institute (pre-service teachers) and three secondary schools (in-service teachers). TDTs in physics, chemistry, and biology engaged in two cycles of technology-enhanced lesson design, enactment and reflection.

Agency

During all study phases, stakeholders, teachers in particular, substantially participated in setting directions for the study. The context and needs analysis phase aimed to involve stakeholders in problem definition. For example, Bakah et al. (2012a) reported the willingness of Ghanian polytechnic teachers to be involved in curriculum design in order to close the gap between the polytechnic curriculum and the needs of the local engineering industry. Polytechnics deans were also receptive to the TDT approach from the beginning. Ghanaian TDTs were in control of the goals, content and organization of the course while Tanzanian and Ethiopian TDTs were involved in determining the lessons comprising their design. The researchers organized the processes and facilitated the TDT activities. By the conclusion of the study, the collaborative design in teams had spread to other topics and departments in Ghana (Bakah et al. 2012b). In the Ethiopian setting the artefacts produced by the TDTs were distributed and used after the project formally concluded, but collaboration among English lecturers had not continued, due to lack of management support.

Cyclical nature of learning and change

Each study was conducted as four sub-studies: a context and needs analysis, two cycles of development, implementation and evaluation, and an impact study. The context and needs analysis resulted in a better definition of the problem and informed the development phase (e.g. Bakah et al. 2012a; Anto et al. 2012). In the impact study continuation of TDTs (e.g. Bakah et al. 2012b) or continued use of the acquired technology competencies were studied (Kafyulilo et al. 2013). The two cycles of development, implementation and evaluation aimed to improve the design and contributed to learning of all involved stakeholders. E.g. in the Ethiopian study, the parallel involvement of facilitators in regular teaching and training activities, and shortage of time were considered factors hindering teacher learning in the first cycle. The findings showed that novice teachers performed as well as facilitators. The Tanzanian study showed that supporting the collaboration process and facilitating the design process improved the quality of TDT work.

Key findings

The Interconnected Model of Professional Growth (IMPG) (Clarke and Hollingsworth 2002) was used to understand teachers’ learning in each of the TDTs. The IMPG model postulates that change can take place in any of four domains: the external domain, the personal domain, the domain of practice and the domain of consequences. Change in the external domain is defined as becoming acquainted with new ideas, practices and/or strategies, introduced and developed by others. Change in the personal domain happens when teachers acquire new knowledge, skills, attitudes or beliefs. The domain of practice refers to change due to experiences during collaborative design in the TDTs and enactment of the new curriculum materials in educational practice. The domain of consequences deals with the outcomes of new practices for teachers and students. Change may occur in any domain and is mediated through the processes of reflection and enactment.

Context

The Remote Networked School (RNS) initiative goes back to 2002. Small rural schools were under the threat of closure due the quality and access to education given the financial cost of maintaining minimal equality of opportunity for students. In response, the Ministry of Education mandated CEFRIO to act on its behalf in an exploration of how to enrich the learning environment of these schools by taking advantage of information and communication technologies. A systemic approach (Engeström 1987) was adopted by a tripartite partnership (Ministry of Education and CEFRIO/school districts/universities). The partnership structure created a multi-level change process: agents at all levels, from superintendents to teachers, as well as parents and community organizations, were informed and involved.

Teacher collaborative design was conceptualized as a collective activity involving key education partners. Classroom teachers’ participation was considered essential to the co-design of the remote networked school. The RNS’ research-intervention team wanted to apply five different perspectives: (1) The reflective practitioner model (e.g. Schön 1983), (2) Putnam and Borko’s (2000) perspective on cognition, (3) sociocultural perspectives (e.g. Lave and Wenger 1991), (4) the works of designers of computer-supported collaborative learning environments (e.g. Barab et al. 2004 and Scardamalia and Bereiter 1994), and (5) knowledge building approaches (Bereiter and Scardamalia 1993). It was expected that teachers’ professional development would benefit from this approach.

Situatedness

The two-year pilot study engaged three school districts and 12 schools (phase 1, 2002–2004). Teacher professional development was one key element that took different forms and shapes, including planned tutorials and improvised exchanges with members of the research-intervention team, collaborative design sessions (using collaborative technologies), researchers and teachers’ presentations or demonstrations at local events and national knowledge transfer sessions. Teacher participation in the design process of their local remote networked school resulted in students from different classrooms engaging together in learning activities and projects as well as in collaborative inquiries. This meant that an alternative activity system had to develop for teachers to engage students in curricular activities that apparently went beyond what had been traditionally expected of them. In its early years, the initiative benefited from an educational reform that spanned the entire K-12 curriculum and emphasized both instructionist and constructivist pedagogical approaches. The expression mise en œuvre de l’école éloignée en réseau meant iterative cycles of RNS design/creative implementation. Over 300 schools have already engaged in the RNS initiative. In the latter phases, institutionalization of the RNS has been the focus of the partnership.

Agency

From day one, the RNS initiative has recognized teachers’ agency in the co-design of the RNS. Teachers voluntarily engaged in several types of collaborative design activities, and especially ones based on knowledge building principles. Planning, conduction and evaluation of activities were carried out using mediating tools such as collaborative technologies and socio-constructivist concepts, including the classroom-as-a-learning-community. Online support/guidance was provided in the form of: a research-intervention team member accessible all day through the videoconferencing system; and, in 2011, three teachers with extensive RNS experience joined the research-intervention team (four more joined in 2013) and they have been interacting one day a week since with colleague teachers. Teachers initially asked for technical support, but increasingly asked support in pedagogical design.

Teaching in different schools, the teachers collaborated mostly online in networked classrooms. The technology in use included a web-based videoconferencing system and a web-based platform for written online discourse, one on which design and learning/knowledge building artefacts resided. Selected artefacts were later included in a book written in collaboration with teachers (Allaire and Lusignan 2011). Over 500 volunteer teachers have been active in the RNS initiative.

The cyclical nature of learning and change

The RNS initiative progressed through several iterations following a design-based research methodology (Inchauspé et al. 2004; Allaire et al. 2006; Laferrière et al. 2008). Research iterations were a key feature of the intervention. The research-intervention team provided ethnographic data for discussions with school districts, schools, and interested individual teachers feeding the refinements of following iterations. The data sources included questionnaires, interviews, and online artefacts (videoconference recordings, forum exchanges and websites, including guidelines, exemplary practices and written accounts).

The analysis mostly concentrated on three activity systems: The university-school partnership activity system, the classroom-based collaborative inquiry activity system, and an online collaborative space for learning and knowledge building activity system. Actions and operations enabling or constraining the use of collaborative technologies and knowledge building principles as mediating tools were pinpointed.

Learning/knowledge building in a distributed way became possible through a historically developing activity within each of the concrete settings. Iterations (or cycles of research-intervention) have been the cornerstone of the design-based research. Using Engeström’s (1987) activity theory framework, teacher collaborative design became the overarching action within and between the RNS activity systems (Laferrière and Breuleux 2011).

Key findings

Teachers’ work setting was transformed as the learning community expanded and formed a web of networks, that is, as small groups interacted and learning and/or knowledge-building artefacts were shared. The new open-ended workplaces became congruent with principles brought forward by sociocultural perspectives for understanding cognition and conducive with the informal learning that takes place in communities of practice (Barab et al. 2004) or professional learning communities (Vescio et al. 2008).

However, there were systemic limits to the expansion of teacher collaborative learning; ones reflective of powerful cultural schemes in place at the schools, characterized by conventional teaching and organizational management of large schools. One limit that restricted sustainability and scalability is inherent to the integral nature of co-design: organizational partnerships that create hubs of innovation, university-based and school-based participants working collaboratively to develop computer-supported pedagogical designs and delineate relevant research questions. Together but at too few sites, given the Quebec student population, teachers pushed the boundaries of their individual teaching and that of their collaborators as they encountered real and authentic new problems in their practices.

Despite these limitations, teacher collaborative design was the result of teachers’ exercise of agency and leadership as manifested by boundary crossing, artefacts, stories, and new routines or rituals. Based on these results teacher collaborative design proved to be relevant, feasible, and sustainable.

Situatedness

Our cases showed the importance of individual teacher learning through collaborative design in authentic and meaningful contexts. However, as the USA case showed, teachers can also feel restricted by the external conditions such contexts have. Several studies showed that to better understand teacher decision-making in collaborative design processes, external priorities set by other stakeholders (e.g., national/state policy, school principal, parents) and teachers’ practical concerns (Doyle and Ponder 1978) need to be taken into account. How external priorities and practical concerns impact teacher learning through collaborative design requires further collaborative inquiry. The (small scale) study of Boschman et al. (2014) suggests that practical concerns dominate discussion in design teams and may hinder teacher learning. Research should, therefore, focus on how external priorities and practical concerns impact teachers’ learning in collaborative design processes.

Agency

In collaborative design, teacher agency is shaped by the teacher’s existing orientation towards the subject matter, pedagogy and technology related to a specific design task (Boschman et al. 2014)—or, in other words, a teacher’s belief system. According to Korthagen and Kessels (1999) teacher’s epistemic beliefs shape the conceptualisation of problems, especially in the case of creative activity, such as design. White (2000) related epistemic beliefs to teachers’ curricular and instructional choices. These findings suggest that a teacher’s belief system affects teacher design practice. Our cases provide indications that participation in collaborative design contributes to changes in teacher beliefs about pedagogy (USA) and about teacher collaboration and quality curriculum materials (Africa). However, more research is needed to understand how individual beliefs impact teacher learning in collaborative design and how we can identify situated contexts that will increase the chance for all teachers to create authentic and meaningful designs as they move beyond their original individual beliefs.

Equally important for teacher agency is the sense of ownership, as has also been demonstrated in the three cases of this study. Several studies investigated how different designer roles contribute to a sense of ownership and impact the planning and implementation of the designed artefact in education practice (Penuel et al. 2009; Cviko et al. 2014). Penuel et al. (2009) demonstrated that teachers in a co-designer or re-designer role adopted instructional planning practices as a result of the role assigned to them also after the professional development program had finished. Cviko et al. (2014) found that teachers embraced re- and co-designer roles, which resulted in better enactment of the designed artefact in instructional practice. These studies suggest that re- and co-design help teachers learn to better understand the innovation and provide them with competences in instructional planning and enactment.

Cyclical nature of learning and change

By using the IMPG model (Clarke and Hollingsworth 2002) the African cases offer some insights in how collaborative design contributes to learning and how learning from design is refined when the design is enacted in practice. The results of the studies of Penuel et al. (2009) and Cviko et al. (2014), suggest that teachers developed instructional planning competencies through design and enactment of curriculum innovations. Additional research is needed to better understand the mutual relationship of design and enactment for learning.

Situatedness

As the African and Canada cases illustrate, the effects of design teams are also determined by the interactions within the team and of the team with its environment. Social network analysis offers a new lens and methodology to study collaboration in teams. Recent work of Penuel et al. (2012) explored the use of social network analysis to investigate direct and indirect impacts of professional development on teacher learning. We propose to apply this approach to study in-depth how collaborative (re-design) team affects team learning.

Agency

As the Canada case showed, collaborative design both transforms the individual and the group in a reciprocal process (Rogoff 1994). Research on team learning as a result of collaborative design is relatively scarce. The Canadian case portrays team learning as shared transformative agency, indicating that the design task (and the related innovation) is not only an individual asset, but becomes shared. From the perspective of teacher learning through collaborative design we advocate research on the impact of three factors and how they contribute to teacher learning in collaborative design processes. These factors are: (a) culture and social interaction (e.g. Wertsch 1991), (b) community (e.g. Bransford et al. 1999) and (c) cultural apprenticeship and guided participation (Rogoff 1990).

Cyclical nature of learning and change

Our cases do not reveal in-depth knowledge on how knowledge develops in design teams and how this affects team learning and team effectivity. In the frame of research on effective teams in corporate settings Mohammed et al. (2010) reviewed the literature on team mental models. Research on team mental models focuses on how shared understanding of the key elements of the task and the collaborative process affects teams performance. This approach might be promising in studying team learning in collaborative design, in particular, when attention is being paid to the team learning related to the cyclical nature of design work.

Situatedness

Scalability concerns the conditions that need to be in place to scale collaborative design to large numbers of other settings (cf. phases 2 and 3 of Borko’s (2004) research agenda for professional development arrangements). Scaling triggers the need for a better understanding of the situated nature of collaborative design processes. Not much research on scaling innovations is done, let alone scaling of collaborative design as a form of professional development. In this regard, the Canadian case described in this contribution is rather unique, although limited from the perspective of scale.

Agency

Sustainability involves: maintaining improvement over time, learning gains for everyone and not a few and availability of resources and opportunities to solve problems in a flexible way (Hargreaves and Fink 2000). At the system level, shared transformative agency is a relevant concept, as was shown in the Canadian case where shared transformative agency within and between schools and within and between university-school partnerships was important for sustainability of the RNS. In the African case an effort was made to investigate the sustainability of collaborative design as a professional development approach within institutions after the intervention had finished. Bakah et al. (2012b) went back to the study sites after the formal termination of the teacher design teams intervention and found that the concept of teacher design teams had sustained and expanded to other departments and for other curriculum-related problems involving other teachers. The study of Bakah et al. (2012b) was framed on theoretical notions provided by theories of change as stated by Coburn (2003). Coburn (2003) describes scaling of innovations as the result of a set of four interrelated dimensions: spread, depth, sustainability and shift in ownership. To study sustainability and shift in ownership social network analysis (see previous section) can also be a useful approach, as it can help to better understand how collaborative design teams are situated in the context of their school and other partnerships. This may contribute to a better understanding of system learning through collaborative design.

Cyclical nature of learning and change

Transferability relates to the frame of iterative learning through involvement in collaborative design processes. We know of only a few studies in this area pertaining to collaborative design in teams as a way of learning in pre-service teacher education (Agyei and Voogt 2014; Kafyulilo et al. 2013). These studies investigated the extent to which pre-service teachers who had become beginning teachers at the moment of study used technology integration knowledge and skills that were learned through participation in a collaborative design arrangement during their pre-service teacher education. The studies used Baldwin and Ford’s (1988) model of transfer of learning and were able to show that involvement in collaborative design accounted directly (Agyei and Voogt 2014) or indirectly (Kafyulio et al. 2013) for continuous use of the knowledge and skills learned in their respective practices. These studies also showed that school environment factors often hindered continuation of the use of these knowledge and skills in new settings.