The Skyes platform in the TPACK-SAMR framework
The Skyes integration policy includes a semester-long pilot which comprises the following activities:
-
Teacher training course. It encapsulates TK (for example, the ways to apply learning analytics in order to build individual tracks for students), PK (for example, approaches to integrate a digital platform in a learning/teaching process), and CK (for example, what kind of interactive learning materials are most effective in a digital environment).
-
The evaluation of students’ language skills. The evaluation is conducted in a form of an entry test via the platform or by teachers in order to be able to measure the impact after the technology has been introduced.
-
Ongoing monitoring of students’ and teachers’ activity and a final test. The monitoring results in a performance report with the students’ progress records and teachers’ performance indicators.
-
Technical and methodological support. It is provided by the Skyes team via a helpline and email throughout the pilot integration.
In addition, the interview data allowed for speculating on how the introduction of Skyes may impact learning and teaching in the TPACK-SAMR framework. Table 2 is intended to describe possible levels of Skyes integration envisaged by the platform design and affordances in terms of TK, PK, and CK.
University 1 findings
The interview with a University 1 representative shows that the introduction of Skyes has become possible due to the rector’s initiative. As the new technology was an option, this allowed the EFL teachers for more experimentation and, hence, some used the platform with varying degrees of intensity, while others did not use it at all. It should be noted that the experiment caused some resistance amongst the staff:
The teachers are afraid that the technology might replace them.
At the same time, there appeared a number of enthusiastic teachers. Nevertheless, neither the teaching staff nor the students fully understood why they should use the platform. In general, their engagement is described as low. Using the platform is envisaged as involving extra expenses. Thus, there is still no final decision on the adoption of the technology. In addition, there is no leader in charge of the platform promotion.
Systematic feedback from the students was not collected during the experiment. However, personal conversations revealed some complaints about technical issues:
The mobile application is not working, whereas using mobile phones is more convenient for students.
There are additional complaints that the teachers had no opportunity to test the content of the platform beforehand. Furthermore, there occur difficulties with adjusting the platform tasks with the classroom activities. Finally, the interviewee complained that the learning outcomes of the platform users were not assessed and examined against those of non-users.
The teachers’ questionnaire data demonstrate that 75% of the respondents used the platform, and 87% of them were either fully or rather satisfied. Sixty-three percent had few technical problems, while 37% did not have any. The students’ involvement and interest (62%), interactivity and accessibility for the students (62%), the teacher’s time saving (50%) and a more effective use of the time for independent work (50%) seemed to be the main benefits. Initially, 38% had a complete understanding of how to integrate the platform into the current educational process, and another 62% had an approximate understanding. Seventy-five percent wanted to continue using the platform to some extent. Eighty-eight percent considered the presence of their own textbook impeded the Skyes implementation, and 63% noted the difficulty of the alignment between the Skyes and the existing curriculum.
According to the students’ questionnaire, 93% of the respondents were either fully or rather satisfied with the experience of using the platform, and 72% indicated that the platform motivated them for further work; 91% admitted the usefulness of this work. The majority (55%) used the platform 1–2 h a week, 21% used it less than 1 h. The students often encountered such difficulties as technical issues, the incomprehensibility of tasks, the problem with accessibility, and the vagueness of the teacher’s instruction for learning on the platform. At the same time, 82% understood how learning on the platform would contribute to the final assessment. Seventy-eight percent would like to continue using the platform including 17% who would prefer to expand its use, while 12% would like to use it less.
University 2 findings
The interview shows that University 2 decided to implement the Skyes platform to meet the requirements of the FSES that prescribe providing students with the learning materials:
We have FSES of HE, which states that you ought to provide one textbook for two [students], or to have a distance educational environment.
Although at the beginning of the year a part of the staff showed some resistance, later they changed their attitude.
There were purely psychological problems that caused the necessity to sit down with the teachers and talk. But by the middle of the year everyone, in general, was happy, because they did not need to check homework.
The platform users’ academic outcomes were not assessed and gauged against those of non-users. However, the interviewee states that the new technology has contributed to raising student-orientedness.
If we talk about the Skyes as a platform, it is surely student-centred.
Also, the teachers made the assessment totally clear for students. The students knew that completing the tasks weighed 50% of the overall course assessment.
If a student fulfills all the tasks on the platform, they pass the course.
In addition, the teaching staff and students highlight that the Skyes digital system is user-friendly and has appropriate technical support.
We did not experience any problems in regard to the technical support from the Skyes platform.
The teachers’ questionnaire shows that about 91% of respondents used the platform, and 86% of them were either fully or rather satisfied with the platform. Sixty-two percent did not have many technical problems, and 29% had none at all, whereas 5% of respondents encountered a large number of them. The main benefits seem to be interactivity and accessibility for the student (76%), teacher’s time saving (62%), more efficient use of the time allotted for independent work (53%), and the growth of student involvement and interest (29%). Initially, 67% had a complete understanding of how to integrate the platform with the current educational process, and another 33% had an approximate understanding. Sixty-seven percent wanted to continue using the platform to a larger or former extent, 24% to a smaller extent, and 5% did not want to use it further. Forty-eight percent considered the presence of their own textbook impeded the Skyes implementation, 38% noted the difficulty of the alignment between the Skyes and the existing curriculum, and 24% did not expect the students to become active platform users.
The students’ questionnaire indicates that 75% of the respondents were either fully or rather satisfied with the experience of using the platform, and 40% indicated that the platform motivated them for further training; 79% considered the training useful. The majority (49%) used the platform 1–2 h a week, 23% used it less than 1 h. The students often encountered such difficulties as technical issues, the incomprehensibility of the tasks, the problem with accessibility, the vagueness of the teacher’s instruction for learning on the platform. At the same time, 61% realized how their learning with the platform would contribute to their final assessment. Sixty-four percent would like to continue using the platform including 3% who would prefer to expand its use, while 20% would decrease the extent of its use and 9% would completely terminate its usage.
University 3 findings
The interview with the head of the project on the implementation of Skyes in University 3 shows that the motivation for its introduction was the lack of English teachers. The latter happened because of the spike in the number of the students.
The Radiophysics Department has grown by six times since the 1990s.
Half of the English classes were replaced with the independent work on the Skyes platform which allowed the administration to avoid expenses on hiring additional staff. Moreover, the platform proved to be a useful distance learning tool during the COVID-19 pandemic.
Our timetable indicates the platform for the [English] class instead of a room.
In the perception of innovation, at the beginning of the experiment there was a resistance to educational innovation, but it was overcome.
It was obvious there had to be a teachers’ riot: Skyeng is bad, and we are cool. There was a riot.
Both the students and the teachers are tech-savvy. However, some teachers were not satisfied with the platform content. In addition, not everyone adjusted their teaching methods to the integration of the Skyes platform.
Some teachers are still applying their own methodology.
Regarding the transformation of the learning process, the platform enables individualisation and student-centredness. The need to change the teacher’s role was noted:
I think that in English [learning] the teacher’s role will change, but the University will still need a lot of them [teachers]. Their roles include mentoring, accompanying, teaching in difficult situations, and adaptation.
The development of a monitoring system and advisory services with educational analytics is believed to play a special role. However, the platform users’ academic outcomes were not assessed and gauged against those of non-users. A technological assessment map was developed according to which the work on the platform contributed 30% to the overall course assessment.
The teachers’ questionnaire demonstrates that about 29% of the respondents use the platform, and 86% of them are either fully or rather satisfied with the platform. However, 29% wanted to cease or decrease the platform use. Fourteen percent had significant technical problems, while 37% had none or few. The teachers’ time saving (57%) along with interactivity and accessibility for the students (57%) seem to be the main benefits. Initially, 29% were unaware of how to integrate the platform with the current educational process. Seventy-two percent considered the presence of their own textbook and the difficulty of the alignment between the Skyes and the existing curriculum had impeded the Skyes implementation. Forty-three percent were intended to continue using the platform.
According to the students’ questionnaire, 69% of the respondents were either fully or rather satisfied with the experience of using the platform, 55% considered the training useful. Sixty-six percent indicated that the platform failed to motivate them for further training. Sixty percent used the platform 1–2 h a week, 29% used it less than 1 h. The students often encountered some difficulties, namely, the incomprehensibility of tasks, technical difficulties, the vagueness of the teacher’s instruction for learning on the platform, and the problem with accessibility. Forty-three percent would like to continue using the platform including 5% who would prefer to expand its use, while 21% would like to use it less, and 24% are no longer willing to use it.
TPACK-SAMR based analysis
The TPACK-SAMR based analysis was used for designing both Table 2 and Table 3. Table 2 described possible levels of Skyes integration envisaged by the platform design and affordances in terms of TK, PK, and CK. Table 3 highlights the TPACK-SAMR indicators demonstrated in the real learning process at the three universities. The data obtained from the interviews and online questionnaires were analysed, and the final analytical matrix for all the universities was filled in (Table 3).