Abstract
This report concerns use of a digital tutor to accelerate veterans’ acquisition of expertise and improve their preparation for the civilian workforce. As background, it briefly discusses the need to improve veterans’ employability, the technology of digital tutoring, its ability to produce advanced levels of technical expertise, and the design, development, and earlier assessment of a specific digital tutor, which motivated use of this tutor to develop veterans’ technical expertise and employability. The report describes the tutor’s use in an experimental program for veterans, an assessment of its success in preparing veterans for employment, and return on investment from its use compared to other investments in education and training.
Similar content being viewed by others
Notes
Effect size is a descriptive (not inferential) statistic commonly used to estimate the magnitude or practical value of an effect such as an experimental treatment.
Effect sizes for this report were calculated as Hedges g (Hedges 1981). Because discussion continues about the calculation of effect sizes, means reported in this document are followed by their standard deviations in parentheses, allowing readers to use alternate calculations of effect sizes.
In keeping with Navy practice, “IT” in this report refers to Information Systems Technology and to Information Systems Technicians. Context should clarify which reference is intended.
References
Abedi, J., & Herman, J. (2010). Assessing English language learners’ opportunity to learn mathematics: Issues and limitations. Teachers College Record, 112(3), 723–746.
Bloom, B. S. (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13(6), 4–16.
California Economic Strategy Panel. (2009). Using multipliers to measure economic impacts. Sacramento, CA: State of California. (Based on Regional Input-Output Modeling System (RIMS II), Regional Product Division, U.S. Bureau of Economic Analysis.
Carbonell, J. R. (1970). AI in CAI: An artificial intelligence approach to computer-assisted instruction. IEEE Transactions on Man-Machine Systems, 11, 190–202.
Cate, C. A. (2014). Million records project: Research from student veterans of America. Washington, DC: Student Veterans of America.
Chase, W. G., & Simon, H. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.
Chatham, R. E., & Braddock, J. V. (2001). Training superiority and training surprise. Washington, DC: Defense Science Board, Department of Defense.
Clark, R., & Wittrock, M. (2000). Psychological principles in training. In S. Tobias & J. D. Fletcher (Eds.), Training and retraining: A Handbook for business, industry, government, and the military (pp. 51–84). New York, NY: Macmillan.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cohn, J., & Fletcher, J. D. (2010). What is a pound of training worth? In Proceedings of the interservice/industry training, simulation and education annual conference. Arlington, VA: National Training and Simulation Association.
Collins, B., Dilger, R., Dortch, C., Kapp, L., Lowry, S., Perl, L. (2014). Employment for veterans: Trends and programs (R42790). Washington, DC: Congressional Research Service.
Craik, F. I., & Lockhart, R. S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior, 11, 671–684.
Csikszentmihalyi, M. (1990). The psychology of optimal experience. London: Harper Perennial.
Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.). (2006). The Cambridge handbook of expertise and expert performance. New York, NY: Cambridge University Press.
Feurzeig, W. (1969). Computer systems for teaching complex concepts (BBN Report 1742). Cambridge, MA: Bolt Beranek and Newman, Inc. (DTIC AD 684 831).
Fletcher, J. D. (2009). Education and training technology in the military. Science, 323(5910), 72–75.
Fletcher, J. D., & Morrison, J. E. (2014). Accelerating development of expertise: A digital tutor for navy technical training (D-5358). Alexandria, VA: Institute for Defense Analyses.
Fletcher, J. D., & Rockway, M. R. (1986). Computer-based training in the military. In J. A. Ellis (Ed.), Military contributions to instructional technology (pp. 171–222). New York, NY: Praeger Publishers.
Gick, M. L., & Holyoak, K. J. (1980). Analogical problem solving. Cognitive Psychology, 12, 306–355.
Gott, S. P., Kane, R. S., & Lesgold, A. (1995). Tutoring for transfer of technical competence (AL/HR-TP-1995-0002). Brooks AFB, TX: Armstrong Laboratory, Human Resources Directorate.
Gott, S. P., & Lesgold, A. M. (2000). Competence in the workplace: How cognitive performance models and situated instruction can accelerate skill acquisition. In R. Glaser (Ed.), Advances in instructional psychology (pp. 239–327). Hillsdale, NJ: Lawrence Erlbaum Associates.
Graesser, A. C., D’Mello, S. K., & Cade, W. (2011). Instruction based on tutoring. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 408–426). New York, NY: Routledge Press.
Graesser, A. C., Person, N. K., & Magliano, J. P. (1995). Collaborative dialogue patterns in naturalistic one-on-one tutoring. Applied Cognitive Psychology, 9, 495–522.
Healy, A. F., Kole, J. A., & Bourne, L. E. (2014). Training principles to advance expertise. Frontiers in Psychology, 5, 1–4.
Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6(2), 107–128.
Hoffman, R. R., Ward, P. J., Feltovich, L., DiBello, F. S., & Andrews, D. H. (2014). Accelerated expertise: Training for high proficiency in a complex world. New York: Psychology Press.
Kulik, J. A., & Fletcher, J. D. (2016). Effectiveness of intelligent tutoring systems: A meta-analytic review. Review of Educational Research, 86, 42–78.
Lesgold, A. M., Lajoie, S. P., Bunzo, M., & Eggan, G. M. (1992). SHERLOCK: A coached practice environment for an electronics troubleshooting job. In J. Larkin & R. Chabay (Eds.), Computer assisted instruction and intelligent tutoring systems: Shared issues and complementary approaches (pp. 201–238). Hillsdale, NJ: Lawrence Erlbaum Associates.
Lesgold, A., & Nahemow, M. (2001). Tools to assist learning by doing: Achieving and assessing efficient technology for learning. In D. Klahr & S. Carver (Eds.), Cognition and instruction: Twenty-five years of progress (pp. 307–346). Mahwah, NJ: Lawrence Erlbaum Associates.
Levin, H. A. (1983). Cost-effectiveness: A primer. Thousand Oaks, CA: Sage Publications.
MacGintie, W. H., MacGintie, R. K., Maria, K., Dreyer, L. G., & Hughes, K. E. (2007). Gates-MacGintie reading tests level AR forms S&T: Manual for scoring and interpretation. Rolling Meadows, IL: Riverside Publishing.
Mayer, R. E. (2002). Rote versus meaningful learning. Theory into Practice, 41(4), 226–232.
McDaniel, M. A., Cahill, M. J., Robbins, M., & Wiener, C. (2014). Individual differences in learning and transfer: Stable tendencies for learning exemplars versus abstracting rules. Journal of Experimental Psychology: General, 143(2), 668–693.
Moretti, E. (2012). The new geography of jobs. New York, NY: Houghton Mifflin Harcourt.
Quillian, M. R. (1969). The teachable language comprehender: A simulation program and theory of language. Communications of the ACM, 12(8), 459–475.
Salary.com. (2014). Network Administrator II. Retrieved 8 August 2014 from http://swz.salary.com/SalaryWizard/Network-Administrator-II-Salary-Details.aspx?&yearsofexperience=3.5.
Simon, H. A. (1969). The sciences of the artificial. Cambridge, MA: MIT Press.
Sternberg, R., & Hedlund, J. (2002). Practical intelligence, g, and work psychology. Human Performance, 15(1–2), 143–160.
Suppes, P. (1964). Modern learning theory and the elementary-school curriculum. American Educational Research Journal, 1, 79–93.
Tobias, S. (1989). Another look at research on the adaptation of instruction to student characteristics. Educational Psychologist, 24, 213–227.
U.S. Department of Education. What Works Clearinghouse. (2010). WWC intervention report: High school math, Carnegie Learning curricula, and cognitive tutor software. Washington, DC: U.S. Department of Education.
U.S. Department of Labor. (2014). Occupational outlook handbook. Washington, DC: Bureau of Labor Statistics. Retrieved 8 August 2014 from http://www.bls.gov/ooh/management/.
U.S. Office of Management and Budget (OMB). (2013). Circular A-94, guidelines and discount rates for benefit-cost analysis of federal programs: Appendix C, discount rates for cost-effectiveness, lease-purchase, and related analyses. Washington, DC: White House Office of Management and Budget.
VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221.
Wetzel-Smith, S. K., & Wulfeck, W. H. (2010). Training incredibly complex tasks. In J. V. Cohn & P. E. O’Connor (Eds.), Performance enhancement in high risk environments (pp. 74–89). Westport, CN: Praeger.
Acknowledgements
This study was funded by the Department of Veterans Affairs under IDA task AI-2-3599 and by the Office of the Secretary of Defense (P&R/TRS) under IDA Task BE-2-3831.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The author declares no conflict of interest.
Rights and permissions
About this article
Cite this article
Fletcher, J.D. The value of digital tutoring and accelerated expertise for military veterans. Education Tech Research Dev 65, 679–698 (2017). https://doi.org/10.1007/s11423-016-9504-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11423-016-9504-z