Abstract
This study investigated the impact of technology problems on students’ perceptions of computerised examination technology and procedures. Measures included the suitability of the assessment task to computerisation, ease of use of the e-examination (e-exam) software, technical reliability, and the perceived security of the approach. A case study was conducted around the introduction of computerised tests into a second-year undergraduate biochemistry course. A series of three e-exam trial events were conducted at an Australian university in 2019 using laboratory bench computers. All students in the course were required to undertake the series of computerised examinations. Data were gathered using pre-post surveys of students’ perceptions (n = 215) that included qualitative comments and Likert items. This study focuses on the impact of a server slowdown at one of the sessions upon participants’ responses to Likert survey items that included their recommendation of the e-exam approach to peers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Transforming Exams across Australia: Australian Government Department of Education and Training, Grant ID15-4747. http://transformingexams.com. Accessed 24 May 2020
Hillier, M., Lyon, N.: Writing e-Exams in pre-university college. In: Passey, D., Bottino, R., Lewin, C., Sanchez, E. (eds.) OCCE 2018. IAICT, vol. 524, pp. 264–274. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23513-0_26
Hillier, M., Grant, S., Coleman, M.: Towards authentic e-Exams at scale: robust net-worked moodle. In: Proceedings of the Australasian Society for Computers in Learning in Tertiary Education Conference, Geelong, VIC. http://transformingexams.com/files/hillier-grant-coleman-Towards-authentic-e-Exams-at-scale-ASCILITE-2018.pdf. Accessed 24 May 2020
Hillier, M., Lyon, N.: Student experiences with a bring your own laptop e-Exam system in pre-university college. In: Passey, D., Bottino, R., Lewin, C., Sanchez, E. (eds.) OCCE 2018. IAICT, vol. 524, pp. 253–263. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23513-0_25
Hillier, M., Grant, S.: Do-it-yourself e-Exams. In: Proceedings of the Australasian Society for Computers in Learning in Tertiary Education Conference, Geelong, VIC. http://transformingexams.com/files/hillier-grant-diy-eexams-ASCILITE-2018.pdf. Accessed 24 May 2020
Fluck, A., Hillier, M.: eExams: Strength in Diversity. In: Tatnall, A., Webb, M. (eds.) WCCE 2017. IAICT, vol. 515, pp. 409–417. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-74310-3_42
Fluck, A., et al.: eExam symposium: design decisions and implementation experience. In: Paper presented at the IFIP World Conference on Computers in Education, 3–6 July, Dublin, Ireland. http://transformingexams.com/files/Fluck_etal_2017.pdf. Accessed 24 May 2020
Küppers, B., Schroeder, U.: Students’ perceptions of e-Assessment. In: Passey, D., Bottino, R., Lewin, C., Sanchez, E. (eds.) OCCE 2018. IAICT, vol. 524, pp. 275–284. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23513-0_27
Crisp, G.: Towards authentic e-Assessment tasks In: Proceedings of the EdMedia: World Conference on Educational Media and Technology, Honolulu, HI. http://www.editlib.org/p/31689/. Accessed 24 May 2020
Villarroel, V., Bloxham, S., Bruna, D., Bruna, C., Herrera-Seda, C.: Authentic assessment: creating a blueprint for course design. Assess. Eval. High. Educ. 43(5), 840–854 (2018)
Fluck, A., Hillier, M.: Innovative assessment with eExams. In: Proceedings of the Australian Council for Computers in Education Conference, Brisbane, QLD. http://conference.acce.edu.au/index.php/acce/acce2016/paper/view/34/27. Accessed 24 May 2020
Hillier, M., Fluck, A.: Transforming exams - how IT works for BYOD e-Exams. In: Proceedings of the Australasian Society for Computers in Learning in Tertiary Education Conference, pp. 100–105. http://2017conference.ascilite.org/wp-content/uploads/2017/11/Concise-HILLIER.pdf. Accessed 24 May 2020
Hillier, M.: The very idea of e-Exams: student (pre)conceptions. In: Proceedings of the 31st Australasian Society for Computers in Learning in Tertiary Education Conference, Dunedin, New Zealand. http://ascilite.org/conferences/dunedin2014/files/fullpapers/91-Hillier.pdf. Accessed 24 May 2020
Hillier, M.: e-Exams with student owned devices: Student voices. In: Proceedings of the International Mobile Learning Festival: Mobile Learning, MOOCs and 21st Century learning, Hong Kong, China, pp. 582–608. http://transformingexams.com/files/Hillier_IMLF2015_full_paper_formatting_fixed.pdf. Accessed 24 May 2020
Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3), 319–340 (1989)
Farzin, S.: Attitude of students towards e-Examination system: an application of e-Learning. Sci. J. Educ. 4(6), 222–227 (2017)
Lunceford, B.: Reconsidering technology adoption and resistance: observations of a semi-luddite. Explor. Media Ecol. 8(1), 29–47 (2009)
Dermo, J.: E-assessment and the student learning experience: a survey of student perceptions of e-assessment. Br. J. Educ. Technol. 40, 203–214 (2009)
Aubusson, K., Noyes, J.: Burnt-out doctors deeply distressed by botched high-stakes exam. The Sydney Morning Herald, 20 February. https://www.smh.com.au/national/nsw/burnt-out-doctors-deeply-distressed-by-botched-high-stakes-exam-20180220-p4z117.html. Accessed 24 May 2020
Aubusson, J., Noyes, K.: Company behind botched medical exam has track record of failure. The Sydney Morning Herald, 21 February. https://www.smh.com.au/national/company-behind-botched-medical-exam-has-track-record-of-failure-20180221-p4z15a.html. Accessed 24 May 2020
Strauss, V.: Pearson’s history of testing problems—a list. Washington Post, 21 April. https://www.washingtonpost.com/news/answer-sheet/wp/2016/04/21/pearsons-history-of-testing-problems-a-list/. Accessed 24 May 2020
Donovan, D.: Wake forest law grad sues ExamSoft over bar exam debacle. North Carolina Lawyers Weekly, 18 August. https://nclawyersweekly.com/2014/08/18/wake-forest-law-grad-sues-examsoft-over-bar-exam-debacle/. Accessed 24 May 2020
Peregoodoff, R.: Large-scale BYOD wireless LMS midterm and final exams. in: Seminar Presented at the EDUCAUSE Annual Conference. https://events.educause.edu/annual-conference/2015/proceedings/large-scale-byod-wireless-lms-midterm-and-final-exams. Accessed 24 May 2020
LabArchives: Electronic Lab Notebook (software as a service product). https://www.labarchives.com. Accessed 24 May 2020
Jamieson, S.: Likert scales: how to (ab)use them. Med. Educ. 38(12), 1217–1218 (2004)
Mann, H.B., Whitney, D.R.: On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 18(1), 50–60 (1947)
Roberson, P.K., Shema, S.J., Mundfrom, D.J., Holmes, T.M.: Analysis of paired Likert data: how to evaluate change and preference questions. Fam. Med. 27(10), 671–675 (1995)
Wilcoxon, F.: Individual comparisons by ranking methods. Biometrics Bull. 1(6), 80–83 (1945)
Shapiro, S.S., Wilk, M.B.: An analysis of variance test for normality (complete samples). Biometrika 52(3–4), 591–611 (1965)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 IFIP International Federation for Information Processing
About this paper
Cite this paper
Hillier, M., Kumar, N., Wijenayake, N. (2020). e-Examinations: The Impact of Technology Problems on Student Experience. In: Brinda, T., Passey, D., Keane, T. (eds) Empowering Teaching for Digital Equity and Agency. OCCE 2020. IFIP Advances in Information and Communication Technology, vol 595. Springer, Cham. https://doi.org/10.1007/978-3-030-59847-1_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-59847-1_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-59846-4
Online ISBN: 978-3-030-59847-1
eBook Packages: Computer ScienceComputer Science (R0)
