Abstract
Evaluation of online training is a necessity to its future as a viable alternative method to classroom training. The purpose of Study 1 was to evaluate the effectiveness and efficiencies of online training as it compared to current classroom training with Nebraska Law Enforcement Training Center's (NLETC's) Jail Management trainees. Trainees were randomly assigned to receive either online or classroom training. Learning, motivation, and attitudes were measured for instructional effectiveness. Instructional time and cost/benefit calculations were used as measures of efficiencies. Results indicated, as predicted, that online training is as effective an instructional method as classroom training, and more efficient than classroom training. No meaningful learning differences occurred between the two groups, but online training was completed in almost half the time of classroom instruction and at a lesser cost. However, the classroom group reported higher motivation and positive feelings concerning their instruction than did the online group. Study 2 experimentally examined learning, instructional time, motivation, and attitude advantages of multimedia included in the Jail Management online training courses. Although hypothesized that video would enhance learning, motivation, and attitude, there were no differences in UNL student participants' test scores or surveys scores whether they received training with text only, audio with the text, or video with the text. Only instructional time differed among the groups.
Similar content being viewed by others
References
Baek, Y. K., and Layne, B. H. (1988). Color, graphics, and animation in an online-assisted learning tutorial lesson. Journal of Computer-Based Instruction 15: 131-135.
Barron, A. E., and Kysilka, M. L. (1993). The effectiveness of digital audio in online-based training. Journal of Research on Computing in Education 25: 277-289.
Bassi, L. J., and Van Buren, M. E. (1998). The 1998 ASTD state of the industry report. Training & Development 52: 22-43.
Bednar, A., and Levie, W. H. (1993). Attitude-change principles. In Fleming, M., and Levie, W. H. (Eds.), Instructional Message Design: Principles From the Behavioral and Cognitive Sciences, Educational Technology Publications, New Jersey, pp.283-302.
Burton, J. K., Moore, D. M., and Holmes, G. A. (1995). Hypermedia concepts and research: An overview. Computer in Human Behavior 11: 345-369.
Cann, A. J. (1999). Approaches to the evaluation of online learning materials. Innovations in Education and Training International 36: 44-51.
Clark, R. E. (1992). Dangers in the evaluation of instructional media. Academic Medicine 67: 819-820.
Cobb, T. (1997). Cognitive efficiency: Toward a revised theory. Educational Technology Research and Development 45: 21-35.
Department of Labor (1998). Statistics on women in protection management. Available at http://members.xoom.com/XMCM/bgberkman/stat.html.
Dillon, A., and Gabbard, R. (1998). Hypermedia as an educational technology: A review of the quantitative research literature on learner comprehension, control, and style. Review of Educational Research 68: 322-349.
Dillion, N. (1997). Internet-based training passes audit. Computerworld 31: 47-49.
Driscoll, M. (1998). How to pilot web-based training. Training & Development 52: 44-50.
Driscoll, M. P., and Dick, W. (1999). New research paradigms in instructional technology: An inquiry. Educational Technology Research and Development 47: 7-18.
Ehrmann, S. C. (1995). Asking the right questions: What does research tell us about technology and higher learning? Change 3: 20-27.
Fletcher-Flinn, C. M., and Gravatt, V. (1995). The efficacy of online-assisted instruction (CAI): A meta-analysis. Journal of Educational Computing Research 12: 219-242.
Forsyth, D. R., and Archer, C. R. (1997). Technologically assisted instruction and student master, motivation, and matriculation. Teaching of Psychology 24: 207-212.
Jonassen, D. H., Campbell, J. P., and Davidson, M. E. (1994). Learning with media: Restructuring the debate. Educational Technology Research and Design 42: 31-39.
Kaufman, R. (1998). The Internet as the ultimate technology and panacea. Educational Technology 1: 63-64.
Kearsley, G. (1998). Educational Technology: A critique. Educational Technology 2: 47-51.
Keller, J., and Burkman, E. (1993). Motivation principles. In Fleming, M., and Levie, W. H. (Eds.), Instructional Message Design: Principles from the Behavioral and Cognitive Sciences, Educational Technology Publications, Englewood Cliffs, NJ, pp. 3-49.
Kovalik, C. L., and Dalton, D. W. (1998-1999). The process outcome evaluation model: A conceptual framework for assessment. Journal of Educational Technology Systems 27: 183-194.
Kozma, R. B. (1991). Learning with media. Review of Educational Research 61: 179-211.
Kulik, C.-L. C., and Kulik J. A. (1991). Effectiveness of online-based instruction: An updated analysis. Computers in Human Behavior 7: 75-94.
Leh, A. S. C., Sleezer, C. M., and Anderson, V. A. (1998). Measuring the value of educational technology in different contexts. Educational Technology 4: 28-33.
Liao, Y.-K. C. (1998). Effects of hypermedia versus traditional instruction on students' achievement: A meta-analysis. Journal of Educational Computing Research 7: 241-259.
Liao, Y.-K. C. (1999). Gender differences on attitudes toward computers: A meta-analysis. Society for Information Technology and Teacher Education International Conference, San Antonio, TX.
Lookatch, R. P. (1995). Technology for teaching? The research is flawed. Education Digest 11: 4-8.
Martin, B. L., and Briggs, L. J. (1986). The Affective and Cognitive Domains: Integration for Instruction and Research. Educational Technology Pulications, Englewood Cliffs, NJ.
Mathis, A., Smith, T., and Hansen, D. (1970). College students' attitudes toward online-assisted instruction. Journal of Educational Psychology 61: 46-51.
Mayer, R. E., and Anderson, R. B. (1991). Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology 83: 484-490.
McNeil, J. J., and Nelson, K. R. (1991). Meta-analysis of interactive video instruction: A 10-year review of achievement effects. Journal of Computer-Based Instruction 18: 1-6.
McIntyre, D. R., and Wolff, F. G. (1998). An experiment with WWW interactive learning in university education. Computers and Education 31: 255-264.
Merrill, M. D. (1984). What is learner control? In Bass, R. K., and Dills, C. R. (Eds.), Instructional Development: The State of the Art, II, Kendall/Hunt Publishing, Dubuque, IA.
Montazemi, A. R., and Wang, F. (1995). An empirical investigation of CBI in support of mastery learning. Journal of Educational Computing Research 13: 185-205.
Mudge, S. M. (1998). Delivering multimedia-teaching modules via the Internet. Innovations in Education and Training International 36: 11-16.
Najjar, L. J. (1996). The effects of multimedia and elaborative encoding on learning (GIT-GVU-96-05), Georgia Institute of Technology, Atlanta.
Najjar, L. J. (1997). A framework for learning from media: The effects of materials, task, and tests on performance (GIT-GVU-97-21), Georgia Institute of Technology, Graphics, Visualization and Usability Center, Atlanta.
Najjar, L. J. (1998) Principles of educational multimedia user interface design. Human Factors 40: 311-323.
Niemiec, R., and Walberg, H. J. (1987). Comparative effects of online-assisted instruction: A synthesis of reviews. Journal of Educational Computing Research 3: 19-37.
Overbaugh, R. C. (1994). Research-based guidelines for online-based instruction development. Journal of Research on Computing in Education 27: 29-47.
Paivio, A. (1991). Dual-coding theory: Retrospect and current status. Canadian Journal of Psychology Outstanding Contributions Series 45: 255-287.
Pear, J. J., and Novak, M. (1996). Computer-aided personalized system of instruction: A program evaluation. Teaching of Psychology 23: 119-123.
Phillips, J. J. (1998). The return-on-investment (ROI) process: Issues and trends. Educational Technology 4: 7-14.
Pollock, J. C., and Sullivan, J. J. (1990). Practice mode and learner control in online-based instruction. Contemporary Educational Psychology 15: 251-260.
Quealy, J., and Langan-Fox, J. (1998). Attributes of delivery media in online-assisted instruction. Ergonomics 41: 257-290.
Quinones, M. A., and Ehrenstein, A. (1997). Training For a Rapidly Changing Workplace: Application of Psychological Research, APA, Washington, DC.
Ravet, S., and Layte, M. (1997). Technology-Based Training: A Comprehensive Guide to Choosing, Implementing, Managing and Developing New Technologies in Training, Kogan Page, London.
Relan, A. (1995). Promoting better choices: Effects of strategy training on achievement and choice behavior in learner-controlled CBI. Journal of Educational Computing Research 13: 129-149.
Richey, R. C. (1998). The pursuit of useable knowledge in instructional technology. Educational Technology Research and Development 46: 7-22.
Rieber, L. P., (1989). The effects of online animated elaboration strategies and practice on factual and application learning in an elementary science lesson. Journal of Educational Computing Research 5: 431-444.
Robinson, B. (2000, February 25). Officers acquitted of all charges in Diallo shooting. Court TV Online, http://www.courttv.com/national.
Rossi, P. H., Freeman, H. E., and Lipsey, M. W. (1999). Evaluation: A Systematic Approach, Sage, Thousand Oaks, CA.
Salomon SmithBarney (1997). Innovations in Education, New York, NY.
Schaaf, D. (1998). What workers really think about training. Training 9: 59-66.
Schmeeckle, J. M., Bernstein, D. J., and Fudge, M. L. (1998). Evaluation of learning using multimedia online-assisted instruction. (Unpublished Manuscript)
Skinner, M. E. (1990). The effects of online-based instruction of the achievement of college students as a function of achievement status and mode of presentation. Computers in Human Behavior 6: 351-360.
Spitzer, B. R. (1999). Embracing evaluation. Training 7: 42-47.
Sternberg, R. J. (1996). Cognitive Psychology, Harcourt Brace College Publishers, New York.
Stolovitch, H. D., and Maurice, J. G. (1998). Calculating the return on investment in training: A critical analysis and a case study. Performance Improvement 37: 9-20.
Tabachnick, B. G., and Fidell, L. S. (1996). Using Multivariate Statistics, 3rd edn. Harper Collins, New York.
Tennyson, R. D. (1990). A proposed cognitive paradigm of learning for educational technology. Educational Technology 16-19.
Vinsonhaler, J. F., and Bass, R. K. (1972). A summary of ten major studies on CAI drill and practice. Educational Technology 7: 29-32.
Wells, R. C. (1999). Back to the (Internet) classroom. Training 3: 50-54.
Wilson, B. G. (1999). Evolution of learning technologies: From instructional design to performance support to network systems. Educational Technology 2: 32-35.
Worthington, E. L., Jr., Welsh, J. A., Archer, C. R., Mindes, D. J., and Forsyth, D. R. (1996). Computer-assisted instruction as a supplement to lectures in an introductory psychology class. Teaching of Psychology 23: 175-181.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Schmeeckle, J.M. Online Training: An Evaluation of the Effectiveness and Efficiency of Training Law Enforcement Personnel over the Internet. Journal of Science Education and Technology 12, 205–260 (2003). https://doi.org/10.1023/A:1025028806189
Issue Date:
DOI: https://doi.org/10.1023/A:1025028806189