Advertisement

Leveraging Interoperable Data to Improve Training Effectiveness Using the Experience API (XAPI)

  • Jennifer MurphyEmail author
  • Francis Hannigan
  • Michael Hruska
  • Ashley Medford
  • Gabriel Diaz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9744)

Abstract

This paper discusses our research efforts aimed at improving the training effectiveness and efficiency of the U.S. Army’s gunnery and rifle marksmanship curriculum. Soldier assessments, typically in the form of final qualifications scores, are insufficient to conduct experimental comparisons required to evaluate training effectiveness. More importantly, this level of performance assessment does not speak to the root cause of the errors soldiers make during training. Using the Experience API (xAPI) specification, learning experiences are represented in terms of activity statements and can be used to track learning that happens both inside and outside of the classroom, enabling the development of robust, persistent student models. Importantly, xAPI data are interoperable across training systems, allowing a student’s performance to be tracked across multiple platforms. Our research demonstrates the utility of xAPI to improve the effectiveness of Army simulation-based training through improved performance assessment capabilities.

Keywords

Adaptive learning systems Experience API Data interoperability Training effectiveness evaluation 

References

  1. 1.
    U.S. Government Accountability Office. Army and Marine Corps Training: Better Performance and Cost Data Needed to More Fully Assess Simulation-Based EFforts. U.S. Government Accountability Office, Washington (2013)Google Scholar
  2. 2.
    Fletcher, J.D., Chatelier, P.R.: An overview of military training. Institute of Defense Analysis Document D-2514. Institute of Defense Analysis, Alexandria, VA (2000)Google Scholar
  3. 3.
    Knapp, M. I., Orlansky, J.: A cost element structure for defense training. Institute of Defense Analysis Document P-1709. Institute of Defense Analysis, Alexandria, VA (1983)Google Scholar
  4. 4.
    Morrison, J. E., Hammon, C.: On measuring the effectiveness of large-scale training simulations. Institute of Defense Analysis Document P-3570. Institute of Defense Analysis, Alexandria, VA (2000)Google Scholar
  5. 5.
    Simpson, H., Oser, R.L.: Evaluating large-scale training simulations. Mil. Psychol. 15(1), 25–40 (2003)CrossRefGoogle Scholar
  6. 6.
    Salas, E., Bowers, C.A., Rhodenizer, L.: It’s not how much you have but how you use it: toward a rational use of simulation to support aviation training. Int. J. Aviat. Psychol. 8(3), 197–208 (1998)CrossRefGoogle Scholar
  7. 7.
    Kirkpatrick, D.L.: Techniques for evaluating training programs. Training Dev. J. 33(6), 78–92 (1979)Google Scholar
  8. 8.
    Hammond, C., Horowitz, S.A.: Flying hours and aircrew performance (IDA Paper P-2347). Institute for Defense Analyses, Alexandria, VA (1990)Google Scholar
  9. 9.
    Cavaluzzo, L.C.: OPTEMPO and training effectiveness (Professional Paper 427). Center for Naval Analyses, Alexandria, VA (1984)Google Scholar
  10. 10.
    U.S. Department of the Army. The U.S. Army Learning Concept for 2015. TRADOC Pam 525-8-2. Department of the Army, Washington, DC (2011)Google Scholar
  11. 11.
    Durlach, P.J., Ray, J.M.: Designing adaptive instructional environments: insights from empirical evidence (Technical report 1297) (2011). http://www.adlnet.gov/wp-content/uploads/2011/11/TR-1297.pdf
  12. 12.
    Long, R., Murphy, J., Newton, C., Hruska, M., Medford, A., Kilcullen, T., Harvey Jr., R.: Adapting gunnery training using the experience API. In: Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) (2015)Google Scholar
  13. 13.
    Long, R. Murphy, J., Ruprecht, C., Medford, A., Diaz, G., Kilcullen, T., Harvey Jr., R.: Evaluating adaptive training for teams using the experience API. In: Proceedings of the MODSIM World Conference (2016)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Jennifer Murphy
    • 1
    Email author
  • Francis Hannigan
    • 1
  • Michael Hruska
    • 2
  • Ashley Medford
    • 2
  • Gabriel Diaz
    • 2
  1. 1.Quantum Improvements ConsultingOrlandoUSA
  2. 2.Problem SolutionsJohnstownUSA

Personalised recommendations