Development and Evaluation of a Web-Based E-Learning System
- 2.3k Downloads
In this contribution the development of a web-based e-learning system is described and a method for evaluation is introduced, whereby the e-learning portal INTEGRAL II will be used as an exemplification. The proposed approach is based on system monitoring of user interaction by data capture in a server-log-file, and it additionally integrates external data. As such it is a user-based approach, which typically applies to prototyping or early stages of the product life-cycle. Due to its non-reactive character, the hypothesized biasing effects are supposed to be minimal. Especially server log-files are means of gathering objective, quantitative data which can not be derived by other means. Additionally the procedure is not very complex, that is, it is easy to conduct and does not take too much time to collect data. Log-files are records that are generated by the system automatically and incorporate information about access to and quitting the system, location of the user, time spent with the system and actions within the system. As illustrated in this contribution, these data can be analyzed and interpreted in seven steps. The analysis reveals specific results for the INTEGRAL II system as well as more abstract suggestions for usability testing in general. Log-file analyses in combination with other measures are powerful means of evaluating a web-based system. What information is provided by log-files? What technical framework must be considered for the interpretation? How can these implicit data be used to evaluate web-based systems? These questions are considered in detail in this contribution.
Unable to display preview. Download preview PDF.
- K. Shuyler and E. Maddox, Evaluating Your SimpleSite with Log File Analysis - How do your students use your site? Is your site effective? Technical Report PETTT-02-CT-01. Program for Educational Transformation through Technology, University of Washington, Seattle (WA), 2002.Google Scholar
- A. Baravalle and V. Lanfranchi, “Remote Web Usability Testing”, Behavior Research Methods, Instruments & Computers 35, Nr. 3, pp. 364-368, 2003.Google Scholar
- L. Paganelli and F. Paternó, “Tools for Remote Usability Evaluation of Web Applications through Browser Logs and Task Models”, Behavior Research Methods, Instruments & Computers 35, Nr. 3, S. 369-378, 2003.Google Scholar
- P. M. Hallam-Baker and B. Behlendorf, Extended Log File Format : W3C Working Draft WD-logfile-960323. http://www.w3.org/TR/WD-logfile.html.Google Scholar
- R. Fuller and J. J. de Graaf, Measuring User Motivation from Server Log Files. http://www.microsoft.com/usability/webconf/fuller/fuller.htm.Google Scholar
- M. Sweeney, M. Maguire M, and B. Shackel, “Evaluating user-computer interaction: a framework”. International Journal of Human-Computer-Interaction 38, pp. 689-711, 1991.Google Scholar