ITADS: A Real-World Intelligent Tutor to Train Troubleshooting Skills
Real-world intelligent tutoring systems are important ambassadors for promoting wide adoption of the technology. Questions about affordability, quality control, operational readiness, training effectiveness, and user acceptance are significant in this context. This paper describes ITADS, an intelligent tutor developed to provide a problem-based, experiential learning tool to complement schoolhouse training. The goal was to train US Navy Information Systems Technology support staff in troubleshooting skills through the use of realistic simulations and automated assessment and feedback. This paper describes the tutoring system and a preliminary validation study of its training effectiveness. The results demonstrate that the system is effective in improving troubleshooting knowledge and skills. The ITADS system was successfully developed in twenty-six months from requirements to validation, following strict systems engineering procedures. The results of the training effectiveness study indicate that the ITS also leads to significantly improved performance among Navy IT recruits in troubleshooting tasks.
KeywordsIntelligent tutoring system Automated performance assessment Troubleshooting skills IT skill training
This work was performed under a contract awarded and administered by the U.S. Navy, Naval Air Warfare Center Training Systems Division (NAWCTSD) in Orlando, FL for the Navy’s Center for Information Warfare Training (CIWT) IT A-School in Pensacola, FL.
- 1.CISCO: IT Essentials 5.0, Chapter 6, Networks, Slides, pp. 63–69 (2012)Google Scholar
- 2.Folsom-Kovarik, J.T., Schatz, S., Nicholson, D.: Return on investment: a practical review of ITS student modeling techniques. M&S J. Winter Edn., 22–37 (2011)Google Scholar
- 3.Lajoie, S.P., Faremo, S.O.N.I.A., Gauthier, G.: Promoting self-regulation in medical students through the use of technology. Technol. Instr. Cognit. Learn. 3(1/2), 81 (2006)Google Scholar
- 4.Jensen, R., Ramachandran, S., Domeshek, E., Tang, K., Marsh, J.: Simulation awareness: assessing performance with limited simulation instrumentation. Submitted to the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC 2016) (2016)Google Scholar