Advertisement

Design and Execution of Large-Scale Pilots

  • Roumiana Peytcheva-ForsythEmail author
  • Harvey Mellar
Chapter
Part of the Lecture Notes on Data Engineering and Communications Technologies book series (LNDECT, volume 34)

Abstract

This chapter presents the piloting process across the various stages of the TeSLA system development. The chapter discusses the contexts of the pilot institutions and the way these affected the planning, execution and results of the pilots at project and institutional levels, the development of the communication protocols, the development of contingency plans based on risk assessments, and the reporting procedures. The chapter also presents an outline of the success of the pilots in capturing data for use by the instrument developers as well as for the development of pedagogic approaches to the integration of TeSLA instruments in course assessment and the use of TeSLA with SEND students. Advice for future TeSLA users is presented, as well as lessons learned from the piloting process.

Keywords

Assessment activities TeSLA instruments TeSLA integration Case studies 

Acronyms

AU

Anadolu University

CPD

Continuous Professional Development

JYU

University of Jyväskylä

OUNL

Open University of Netherlands

OUUK

The Open University of United Kingdom

PDB

Project Demonstration Board

PL

Pilot Leaders

PMB

Project Management Board

PM

Pilot Manger

SEND students

Students with Special Educational Needs and Disabilities

SU

Sofia University

TL

Technical Leader

TUS

Technical University of Sofia

VLE

Virtual Learning Environment

UOC

Universitat Oberta de Catalunya

Notes

Acknowledgements

We want to thank to all Pilot Leaders for their hard work and contribution to the running of the institutional pilots, and the collection and analysis of the data: Serpil Kocdar (AU), Tarja Ladonlahti (JYU), Francis Brouns (OUNL), Wayne Holmes, Chris Edwards (OUUK), Lyubka Aleksieva (SU), Mariana Durcheva, Ana Rozeva (TUS), M. Elena Rodríguez (UOC).

References

  1. 1.
    Chatzigavriil A (2014–2015a) GV100 e-assessment pilot study. Retrieved 20 Feb 2016 from http://eprints.lse.ac.uk/64329/1/Government-e-assessment-Pilot-study.pdf
  2. 2.
    Chatzigavriil A (2014–2015b) Law e-assessment pilot study. Retrieved 20 Feb 2016 from http://blogs.lse.ac.uk/lti/files/2015/10/Law-e-assessment-Pilot-study.pdf
  3. 3.
  4. 4.
    Edwards C, Holmes W, Whitelock D, Okada A (2018) Student trust in e-authentication. In: L@S ’18: proceedings of the fifth annual ACM conference on learning at scale. ACM, New York, Article no. 42Google Scholar
  5. 5.
    JISC (n.d.). Online surveys (formerly BOS) (2019). Retrieved 12 Apr 2019 from https://www.onlinesurveys.ac.uk/
  6. 6.
    Karadeniz A, Peytcheva-Forsyth R, Kocdar S, Okur MR (2018) Approaches to prevent cheating and plagiarism in e-assessment: higher education students’ views. In: Proceedings from EDULEARN18: 10th annual international conference on education and new learning technologies. IATED Academy, Spain.  https://doi.org/10.21125/edulearn
  7. 7.
    Kocdar S, Karadeniz A, Peytcheva-Forsyth R, Stoeva V (2018) Cheating and plagiarism in e-assessment: students’ perspectives. Open Praxis 10(3):221–235CrossRefGoogle Scholar
  8. 8.
    Litherland K, Carmichael P, Martínez-García A (2013) Ontology-based e-assessment for accounting: outcomes of a pilot study and future prospects. J Acc Educ 31(2013):162–176CrossRefGoogle Scholar
  9. 9.
    Mellar H, Peytcheva-Forsyth R, Kocdar S, Karadeniz A, Yovkova B (2018) Addressing cheating in e-assessment using student authentication and authorship checking systems: teachers’ perspectives. Int J Educ Integrity. Retrieved 12 Feb 2018 from https://link.springer.com/article/10.1007/s40979-018-0025-x
  10. 10.
    Nilsson A, Andrén M, Engström M (2014) E-assessment of prior learning: a pilot study of interactive assessment of staff with no formal education who are working in Swedish elderly care. BMC Geriatr 14(1). http://www.biomedcentral.com/1471-2318/14/52
  11. 11.
    Noguera I, Guerrero-Roldán A, Peytcheva-Forsyth R, Yovkova B (2018) Perceptions of students with special educational needs and disabilities towards the use of e-assessment in online and blended education: barrier or aid? In: Proceeding from 12th international technology, education and development conference, Valencia, Spain, 5–7 Mar 2018Google Scholar
  12. 12.
    Noguera I, Guerrero-Roldán AE, Rodríguez ME (2017) Assuring authorship and authentication across the e-assessment process. In: Joosten-ten Brinke D, Laanpere M (eds) Technology enhanced assessment. Communications in computer and information science. Springer, Cham, pp 86–92CrossRefGoogle Scholar
  13. 13.
    Okada A, Whitelock D, Holmes W, Edwards C (2019) e-Authentication for online assessment: a mixed-method study. Br J Edu Technol 50(2):861–875CrossRefGoogle Scholar
  14. 14.
    Okada A, Noguera I, Aleksieva L, Rozeva A, Kocdar S, Brouns F et al (2019) Pedagogical approaches for e-assessment with authentication and authorship verification in Higher Education. Br J Edu Technol 50(2):861–875CrossRefGoogle Scholar
  15. 15.
    Peytcheva-Forsyth R, Aleksieva L (2019) Students’ authentication and authorship checking system as a factor affecting students’ trust in online assessment. In Proceedings from INTED2019: 13th annual international technology, education and development conference, Valencia, Spain, 11–13 Mar 2019Google Scholar
  16. 16.
    Peytcheva-Forsyth R, Aleksieva L, Yovkova B (2018a) The impact of technology on cheating and plagiarism in the assessment—the teachers’ and students’ perspectives. In: AIP conference proceedings, vol 2048, p 020037.  https://doi.org/10.1063/1.5082055
  17. 17.
    Peytcheva-Forsyth R, Aleksieva L, Yovkova B (2018b) The impact of prior experience of e-learning and e-assessment on students’ and teachers’ approaches to the use of a student authentication and authorship checking system. In Proceedings from 10th annual international conference on education and new learning technologies, Palma de Mallorca, Spain, 2–4 July 2018Google Scholar
  18. 18.
    Peytcheva-Forsyth R, Yovkova B, Ladonlahti T (2017) The potential of the TeSLA authentication system to support access to e-assessment for students with special educational needs and disabilities (Sofia university experience). In: Proceedings from ICERI2017, Sevilla, Spain, 16–18 Nov 2017Google Scholar
  19. 19.
    Peytcheva-Forsyth R, Yovkova B, Aleksieva L (2018c) Factors affecting students’ attitudes towards online learning—the case of Sofia University. In: AIP conference proceedings, vol 2048, p 020025 (2018).  https://doi.org/10.1063/1.5082043
  20. 20.
    Peytcheva-Forsyth R, Yovkova B, Aleksieva L (2019) The disabled and non-disabled students’ views and attitudes towards e-authentication in e-assessment. In: Proceedings from INTED2019: 13th annual international technology, education and development conference, Valencia, Spain, 11–13 Mar 2019Google Scholar
  21. 21.
    Rodríguez ME, Baneres D, Ivanova M, Durcheva M (2018) Case study analysis on blended and online institutions by using a trustworthy system. In: Ras E, Guerrero Roldán A (eds) Technology enhanced assessment. TEA 2017. Communications in computer and information science, vol 829, pp 40–53. Springer, ChamCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Sofia UniversitySofiaBulgaria
  2. 2.UCL Institute of EducationLondonUK

Personalised recommendations