Advertisement

Logging and Visualization of Learner Behaviour in Web-Based E-Testing

  • Gennaro Costagliola
  • Vittorio Fuccella
  • Massimiliano Giordano
  • Giuseppe Polese
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4823)

Abstract

In this paper we present a system for the logging and the visualization of the learners’ behavior during the execution of structured tests based on Multiple Choice question type. The system is composed of two main components: a logging framework which, instantiated in e-testing systems, produces an XML formatted log of learners’ interactions with the system during tests and a stand-alone application which visualizes charts containing a chronological review of the tests. By analyzing the charts obtained through an experiment led in our department, we have defined several typical strategies used by the learners to execute tests. The effectiveness of these strategies has been inferred by correlating the strategies with the obtained scores. Further useful applications of our system allow us to detect correlations among questions and cheating attempts by the learners.

Keywords

Learner Behaviour Academic Dishonesty Information Visualization Test Execution Mouse Pointer 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bath, J.A.: Answer-changing behaviour on objective examinations. The Journal of Educational Research (61), 105–107 (1967)Google Scholar
  2. 2.
    Best, J.B.: Item difficulty and answer changing. Teaching of Psychology 6(4), 228–240 (1979)CrossRefGoogle Scholar
  3. 3.
    Johnston, J.J.: Exam taking speed and grades. Teaching of Psychology (4), 148–149 (1977)Google Scholar
  4. 4.
    Paul, C.A., Rosenkoetter, J.S.: The relationship between the time taken to complete an examination and the test score received. Teaching of Psychology (7), 108–109 (1980)Google Scholar
  5. 5.
    McClain, L.: Behavior during examinations: A comparison of ”a”, ”c,” and ”f” students. Teaching of Psychology 10(2), 69–71 (1983)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Plaisant, C., Shneiderman, B.: Show me! guidelines for producing recorded demonstrations. vlhcc 00, 171–178 (2005)Google Scholar
  7. 7.
    Mazza, R., Dimitrova, V.: Student tracking and personalization: Visualising student tracking data to support instructors in web-based distance education. In: Proceedings of the 13th International World Wide Web conference on Alternate Track papers & posters, pp. 154–161 (2004)Google Scholar
  8. 8.
    Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z.: Off-task behavior in the cognitive tutor classroom: when students ”game the system”. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 383–390. ACM Press, New York (2004)Google Scholar
  9. 9.
    (SDN), S.D.N.: Asynchronous javascript technology and xml (ajax) with the java platform (2007)Google Scholar
  10. 10.
    Costagliola, G., Ferrucci, F., Fuccella, V., Gioviale, F.: A web based tool for assessment and self-assessment. In: Proceedings of ITRE, pp. 131–135 (2004) Google Scholar
  11. 11.
    Hibernate: Hibernate framework (2007)Google Scholar
  12. 12.
    ECMAScript: Ecmascript language specificationGoogle Scholar
  13. 13.
    Chen, M.C., Anderson, J.R., Sohn, M.H.: What can a mouse cursor tell us more?: correlation of eye/mouse movements on web browsing. In: CHI 2001 extended abstracts on Human factors in computing systems, pp. 281–282. ACM Press, New York (2001)CrossRefGoogle Scholar
  14. 14.
    Dick, M., Sheard, J., Bareiss, C., Carter, J., Joyce, D., Harding, T., Laxer, C.: Addressing student cheating: definitions and solutions. SIGCSE Bull. 35(2), 172–184 (2003)CrossRefGoogle Scholar
  15. 15.
    Harding, T.S., Carpenter, D.D., Montgomery, S.M., Steneck, N.: The current state of research on academic dishonesty among engineering students. In: Proceedings of FIE 2001, vol. 3, pp. 13–18 (2001) Google Scholar
  16. 16.
    Mulvenon, S.V., Turner, R.C., Thomas, S.: Techniques for detection of cheating on standardized tests using sas. In: Proceedings of the Twenty-Sixth Annual SAS Users Group International Conference, pp. 1–6 (2001)Google Scholar
  17. 17.
    Shao, H., Zhao, H., Chang, G.R.: Applying data mining to detect fraud behavior in customs declaration. In: Proceedings of International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1241–1244 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gennaro Costagliola
    • 1
  • Vittorio Fuccella
    • 1
  • Massimiliano Giordano
    • 1
  • Giuseppe Polese
    • 1
  1. 1.Salerno UniversityFisciano SAItaly

Personalised recommendations