Logging and Visualization of Learner Behaviour in Web-Based E-Testing
In this paper we present a system for the logging and the visualization of the learners’ behavior during the execution of structured tests based on Multiple Choice question type. The system is composed of two main components: a logging framework which, instantiated in e-testing systems, produces an XML formatted log of learners’ interactions with the system during tests and a stand-alone application which visualizes charts containing a chronological review of the tests. By analyzing the charts obtained through an experiment led in our department, we have defined several typical strategies used by the learners to execute tests. The effectiveness of these strategies has been inferred by correlating the strategies with the obtained scores. Further useful applications of our system allow us to detect correlations among questions and cheating attempts by the learners.
KeywordsLearner Behaviour Academic Dishonesty Information Visualization Test Execution Mouse Pointer
Unable to display preview. Download preview PDF.
- 1.Bath, J.A.: Answer-changing behaviour on objective examinations. The Journal of Educational Research (61), 105–107 (1967)Google Scholar
- 3.Johnston, J.J.: Exam taking speed and grades. Teaching of Psychology (4), 148–149 (1977)Google Scholar
- 4.Paul, C.A., Rosenkoetter, J.S.: The relationship between the time taken to complete an examination and the test score received. Teaching of Psychology (7), 108–109 (1980)Google Scholar
- 6.Plaisant, C., Shneiderman, B.: Show me! guidelines for producing recorded demonstrations. vlhcc 00, 171–178 (2005)Google Scholar
- 7.Mazza, R., Dimitrova, V.: Student tracking and personalization: Visualising student tracking data to support instructors in web-based distance education. In: Proceedings of the 13th International World Wide Web conference on Alternate Track papers & posters, pp. 154–161 (2004)Google Scholar
- 8.Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z.: Off-task behavior in the cognitive tutor classroom: when students ”game the system”. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 383–390. ACM Press, New York (2004)Google Scholar
- 10.Costagliola, G., Ferrucci, F., Fuccella, V., Gioviale, F.: A web based tool for assessment and self-assessment. In: Proceedings of ITRE, pp. 131–135 (2004) Google Scholar
- 11.Hibernate: Hibernate framework (2007)Google Scholar
- 12.ECMAScript: Ecmascript language specificationGoogle Scholar
- 15.Harding, T.S., Carpenter, D.D., Montgomery, S.M., Steneck, N.: The current state of research on academic dishonesty among engineering students. In: Proceedings of FIE 2001, vol. 3, pp. 13–18 (2001) Google Scholar
- 16.Mulvenon, S.V., Turner, R.C., Thomas, S.: Techniques for detection of cheating on standardized tests using sas. In: Proceedings of the Twenty-Sixth Annual SAS Users Group International Conference, pp. 1–6 (2001)Google Scholar
- 17.Shao, H., Zhao, H., Chang, G.R.: Applying data mining to detect fraud behavior in customs declaration. In: Proceedings of International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1241–1244 (2002)Google Scholar