Advances in Health Sciences Education

, Volume 21, Issue 4, pp 789–802 | Cite as

E-learning optimization: the relative and combined effects of mental practice and modeling on enhanced podcast-based learning—a randomized controlled trial

  • Fahad Alam
  • Sylvain Boet
  • Dominique Piquette
  • Anita Lai
  • Christopher P. Perkes
  • Vicki R. LeBlanc
Article

Abstract

Enhanced podcasts increase learning, but evidence is lacking on how they should be designed to optimize their effectiveness. This study assessed the impact two learning instructional design methods (mental practice and modeling), either on their own or in combination, for teaching complex cognitive medical content when incorporated into enhanced podcasts. Sixty-three medical students were randomised to one of four versions of an airway management enhanced podcast: (1) control: narrated presentation; (2) modeling: narration with video demonstration of skills; (3) mental practice: narrated presentation with guided mental practice; (4) combined: modeling and mental practice. One week later, students managed a manikin-based simulated airway crisis. Knowledge acquisition was assessed by baseline and retention multiple-choice quizzes. Two blinded raters assessed all videos obtained from simulated crises to measure the students’ skills using a key-elements scale, critical error checklist, and the Ottawa global rating scale (GRS). Baseline knowledge was not different between all four groups (p = 0.65). One week later, knowledge retention was significantly higher for (1) both the mental practice and modeling group than the control group (p = 0.01; p = 0.01, respectively) and (2) the combined mental practice and modeling group compared to all other groups (all ps = 0.01). Regarding skills acquisition, the control group significantly under-performed in comparison to all other groups on the key-events scale (all ps ≤ 0.05), the critical error checklist (all ps ≤ 0.05), and the Ottawa GRS (all ps ≤ 0.05). The combination of mental practice and modeling led to greater improvement on the key events checklist (p = 0.01) compared to either strategy alone. However, the combination of the two strategies did not result in any further learning gains on the two other measures of clinical performance (all ps > 0.05). The effectiveness of enhanced podcasts for knowledge retention and clinical skill acquisition is increased with either mental practice or modeling. The combination of mental practice and modeling had synergistic effects on knowledge retention, but conveyed less clear advantages in its application through clinical skills.

Keywords

Curriculum design E-learning Instructional design Learning strategies Medical education Mental practice Modeling Mobile learning Podcasts Simulation 

Notes

Acknowledgments

The authors thank Roger Chow and Agnes Ryzynski for their great support in the data collection for this study. They have both given written confirmation for this acknowledgement.

Funding

This work was supported by: (1) Education Initiatives in Residency Education Grant (EIRE)—Faculty of Medicine, University of Ottawa, Ottawa, Canada: Funds were used for data collection, specifically to purchase technological equipment such as Apple iPads. Funds were used to cover expenses incurred presenting preliminary results at the annual Association for Medical Education (AMEE) conference in August 2012. (2) Allan Waters Patient Family Simulation Centre, St. Michael’s Hospital, Toronto, Canada, and the Anaesthesia Departments at The University of Toronto, Toronto, Canada and the University of Ottawa, Ottawa, Canada.: Funds provided were used for data collection, specifically for simulation time only.

Author contributions

FA: Study design, conduct, recruitment, data collection, management, analysis and interpretation, first draft of manuscript and subsequent edits. SB: Study design, analysis and interpretation, and manuscript edits. DP: Study design, and manuscript edits. AL: Rating videos and manuscript edits. CP: Rating videos and manuscript edits. VL: Study design, analysis and interpretation, and manuscript edits.

Compliance with ethical standards

Conflict of interests

None of the authors have any interests to declare.

References

  1. Allen, K. L., & Katz, R. V. (2011). Comparative use of podcasts vs. lecture transcripts as learning aids for dental students. Journal of dental education, 75(6), 817–822.Google Scholar
  2. Arora, S., Aggarwal, R., Sevdalis, N., Moran, A., Sirimanna, P., Kneebone, R., & Darzi, A. (2009). Development and validation of mental practice as a training strategy for laparoscopic surgery. Surgical Endoscopy, 24(1), 179–187. doi:10.1007/s00464-009-0624-y.CrossRefGoogle Scholar
  3. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Upper Saddle River: Prentice Hall.Google Scholar
  4. Bensalem-Owen, M., Chau, D. F., Sardam, S. C., & Fahy, B. G. (2011). Education research: Evaluating the use of podcasting for residents during EEG instruction: A pilot study. Neurology, 77(8), e42–e44. doi:10.1212/WNL.0b013e31822b0017.CrossRefGoogle Scholar
  5. Bhatti, I., Jones, K., Richardson, L., Foreman, D., Lund, J., & Tierney, G. (2011). E-learning vs lecture: which is the best approach to surgical teaching? Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland, 13(4), 459–462. doi:10.1111/j.1463-1318.2009.02173.x.CrossRefGoogle Scholar
  6. Cobcroft, R. S., Towers, S. J., Smith, J. E., & Bruns, A. (2006). Mobile learning in review: Opportunities and challenges for learners, teachers, and institutions. Creative Industries Faculty.Google Scholar
  7. Cohen, J. (1988). Statistical power analysis for the behavioral sciencies (2nd ed.). New York: Lawrence Erlbaum.Google Scholar
  8. Cook, D. A. (2005). Learning and cognitive styles in web-based learning: Theory, evidence, and application. Academic Medicine: Journal of the Association of American Medical Colleges, 80(3), 266–278.CrossRefGoogle Scholar
  9. Cook, D. A. (2009). The failure of e-learning research to inform educational practice, and what we can do about it. Medical Teacher, 31(2), 158–162. doi:10.1080/01421590802691393.CrossRefGoogle Scholar
  10. Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., et al. (2011). Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. JAMA: the Journal of the American Medical Association, 306(9), 978–988. doi:10.1001/jama.2011.1234.CrossRefGoogle Scholar
  11. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions. JAMA: the Journal of the American Medical Association, 300(10), 1181–1196.CrossRefGoogle Scholar
  12. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2010). Instructional design variations in internet-based learning for health professions education: A systematic review and meta-analysis. Academic Medicine: Journal of the Association of American Medical Colleges, 85(5), 909–922. doi:10.1097/ACM.0b013e3181d6c319.CrossRefGoogle Scholar
  13. Custers, E., Regehr, G., McCulloch, W., Peniston, C., & Reznick, R. (1999). The effects of modeling on learning a simple surgical procedure: See one, do one or see many, do one? Advances in Health Sciences Education: Theory and Practice, 4(2), 123–143. doi:10.1023/A:1009763210212.CrossRefGoogle Scholar
  14. Decker, P. J. (1980). Effects of symbolic coding and rehearsal in behavior-modeling training. Journal of Applied Psychology, 65(6), 627–634.CrossRefGoogle Scholar
  15. Decker, P. J. (1984). Effects of different symbolic coding stimuli in behavior modeling training. Personnel Psychology, 37(4), 711–720.CrossRefGoogle Scholar
  16. Driskell, J. E., Copper, C., & Moran, A. (1994). Does mental practice enhance performance? Journal of Applied Psychology, 79(4), 481.CrossRefGoogle Scholar
  17. Epstein, M. L. (1980). The relationship of mental imagery and mental rehearsal to performance of a motor task. Journal of Sport Psychology, 2(3), 211–220.CrossRefGoogle Scholar
  18. Feltz, D. L., & Landers, D. M. (1983). The effects of mental practice on motor skill learning and performance: A meta-analysis. Journal of Sport Psychology; Journal of …, 5(1), 25–27.Google Scholar
  19. Feltz, D. L., Landers, D. M., & Becker, B. J. (1988). A revised meta-analysis of the mental practice literature on motor skill learning. Washington, DC: National Academy Press. http://www.nap.edu/openbook.php?record_id=782&page=R1.
  20. Fernandez, V., Sallan, J. M., & Simo, P. (2014). Past, present, and future of podcasting in higher education. In M. Li & Y. Zhao (Eds.), Exploring Learning & Teaching in Higher Education (pp. 305–330). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-55352-3_14.
  21. Friedman, E. E., Karani, R. R., & Fallar, R. R. (2011). Regulation of medical student work hours: A national survey of deans. Academic Medicine: Journal of the Association of American Medical Colleges, 86(1), 30–33. doi:10.1097/ACM.0b013e3181ff9725.CrossRefGoogle Scholar
  22. Fryling, M. J., Johnston, C., & Hayes, L. J. (2011). Understanding observational learning: An interbehavioral approach. The Analysis of Verbal Behavior, 27(1), 191.Google Scholar
  23. Glisky, M., Williams, J., & Kihlstrom, J. (1996). Internal and external mental imagery perspectives and performance on two tasks. Journal of Sport Behaviour, 19(1), 3.Google Scholar
  24. Griffin, D. K., Mitchell, D., & Thompson, S. J. (2009). Podcasting by synchronising PowerPoint and voice: What are the pedagogical benefits? Computers & Education, 53(2), 532–539. doi:10.1016/j.compedu.2009.03.011.CrossRefGoogle Scholar
  25. Hew, K. F. (2009). Use of audio podcast in K-12 and higher education: a review of research topics and methodologies. Educational Technology Research and Development, 57(3), 333–357.CrossRefGoogle Scholar
  26. Hinshaw, K. E. (1991). The effects of mental practice on motor skill performance: Critical evaluation and meta-analysis. Imaginations, Cognition and Personality, 11, 3–35.CrossRefGoogle Scholar
  27. Hodges, N. J., & Williams, A. M. (2007). Current status of observational learning research and the role of demonstrations in sport. Journal of Sports Sciences, 25(5), 495–496. doi:10.1080/02640410600946753.CrossRefGoogle Scholar
  28. Immenroth, M. M., Bürger, T. T., Brenner, J. J., Nagelschmidt, M. M., Eberspächer, H. H., & Troidl, H. H. (2007). Mental training in surgical education: A randomized controlled trial. Annals of Surgery, 245(3), 385–391. doi:10.1097/01.sla.0000251575.95171.b3.CrossRefGoogle Scholar
  29. Jeannerod, M. (1995). Mental imagery in the motor context. Neuropsychologia; Neuropsychologia, 33(11), 1419–1432.CrossRefGoogle Scholar
  30. Jowdy, D. P., & Harris, D. V. (1990). Muscular responses during mental imagery as a function of motor skill level. Journal of Sport & Exercise Psychology, 12(2), 191–201.CrossRefGoogle Scholar
  31. Kay, R. H. (2012). Exploring the use of video podcasts in education: A comprehensive review of the literature. Computers in Human Behavior, 28(3), 820–831. doi:10.1016/j.chb.2012.01.011.CrossRefGoogle Scholar
  32. Kim, J. J., Neilipovitz, D. D., Cardinal, P. P., Chiu, M. M., & Clinch, J. J. (2006). A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Critical Care Medicine, 34(8), 2167–2174. doi:10.1097/01.CCM.0000229877.45125.CC.CrossRefGoogle Scholar
  33. Li, N., Kidziński, Ł., Jermann, P., & Dillenbourg, P. (2015). MOOC video interaction patterns: What do they tell us? In G. Conole, T. Klobuèar, C. Rensing, J. Konert, É. Lavoué (Eds.), Design for teaching and … (Vol. 9307, pp. 197–210). Cham: Springer International Publishing. doi:10.1007/978-3-319-24258-3_15.
  34. Mahoney, M. J., & Avener, M. (1977). Psychology of the elite athlete: An exploratory study. Cognitive Therapy and Research, 1(2), 135–141.CrossRefGoogle Scholar
  35. McCullagh, P., & Weiss, M. R. (2001). Modeling: Considerations for motor skill performance and psychological responses. Handbook of Sport Psychology, 92, 977–984.Google Scholar
  36. McVee, M. B., Dunsmore, K., & Gavelek, J. R. (2005). Schema theory revisited. Review of Educational Research, 75(4), 531–566. doi:10.3102/00346543075004531.CrossRefGoogle Scholar
  37. Morgan, G. E., Mikhail, M. S., & Murray, M. J. (2006). Clinical anesthesiology (4th ed.). New York: Lange Medical Books/McGraw-Hill.Google Scholar
  38. Nasca, T. J., Day, S. H., Amis, E. S., & Force, A. D. H. T. (2010). The new recommendations on duty hours from the ACGME Task Force. New England Journal of Medicine, 363(2), e3. doi:10.1056/NEJMsb1005800.CrossRefGoogle Scholar
  39. Nast, A., Schäfer-Hesterberg, G., Zielke, H., Sterry, W., & Rzany, B. (2009). Online lectures for students in dermatology: A replacement for traditional teaching or a valuable addition? Journal of the European Academy of Dermatology and Venereology, 23(9), 1039–1043. doi:10.1111/j.1468-3083.2009.03246.x.CrossRefGoogle Scholar
  40. NUS/HEFCE (2010) Student perspectives on technology – demand, perceptions and training needs. Report to HEFCE by NUS, England. Available at http://www.hefce.ac.uk/pubs/rdreports/2010/rd18_10/rd18_10.pdf.
  41. Parson, V., Reddy, P., Wood, J., & Senior, C. (2009). Educating an iPodgeneration: Undergraduate attitudes, experiences and understanding of vodcast and podcast use. Learning, Media and Technology, 34(3), 215–228. doi:10.1080/17439880903141497.CrossRefGoogle Scholar
  42. Rainsbury, J. W., & McDonnell, S. M. (2006). Podcasts: An educational revolution in the making? JRSM, 99(9), 481–482. doi:10.1258/jrsm.99.9.481.CrossRefGoogle Scholar
  43. Rosen, M. A., Salas, E., Pavlas, D., Jensen, R., Fu, D., & Lampton, D. (2010). Demonstration-based training: A review of instructional features. Human Factors: the Journal of the Human Factors and Ergonomics Society, 52(5), 596–609. doi:10.1177/0018720810381071.CrossRefGoogle Scholar
  44. Ryan, E. D., & Simons, J. (1983). What is learned in mental practice of motor skills: A test of the cognitive-motor hypothesis. Journal of Sport Psychology; Journal of Sport …, 5(4), 419–426.CrossRefGoogle Scholar
  45. Samkoff, J. S. J., & Jacques, C. H. C. (1991). A review of studies concerning effects of sleep deprivation and fatigue on residents’ performance. Academic Medicine: Journal of the Association of American Medical Colleges, 66(11), 687–693.CrossRefGoogle Scholar
  46. Sanders, C. W. C., Sadoski, M. M., Bramson, R. R., Wiprud, R. R., & Van Walsum, K. K. (2004). Comparing the effects of physical practice and mental imagery rehearsal on learning basic surgical skills by medical students. American Journal of Obstetrics and Gynecology, 191(5), 1811–1814. doi:10.1016/j.ajog.2004.07.075.CrossRefGoogle Scholar
  47. Sanders, C. W., Sadoski, M., van Walsum, K., Bramson, R., Wiprud, R., & Fossum, T. W. (2008). Learning basic surgical skills with mental imagery: Using the simulation centre in the mind. Medical Education, 42(6), 607–612. doi:10.1111/j.1365-2923.2007.02964.x.CrossRefGoogle Scholar
  48. Spiro, R. J., Feltovich, P. J., & Jacobson, M. J. (1992). Cognitive flexibility, constructivism, and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains. Constructivism and the Technology of Instruction.Google Scholar
  49. Start, K. B., & Richardson, A. (2011). Imagery and mental practice. British Journal of Educational Psychology, 34(3), 280–284. doi:10.1111/j.2044-8279.1964.tb00638.x.CrossRefGoogle Scholar
  50. Taylor, P. J., Russ-Eft, D. F., & Chan, D. W. L. (2005). A meta-analytic review of behavior modeling training. Journal of Applied Psychology, 90(4), 692–709. doi:10.1037/0021-9010.90.4.692.CrossRefGoogle Scholar
  51. Welk, A., Immenroth, M., Sakic, P., Bernhardt, O., Eberspächer, H. H., & Meyer, G. (2007). Mental training in dentistry. Quintessence International (Berlin, Germany: 1985), 38(6), 489–497.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2016

Authors and Affiliations

  • Fahad Alam
    • 1
    • 5
  • Sylvain Boet
    • 2
  • Dominique Piquette
    • 3
    • 5
  • Anita Lai
    • 4
  • Christopher P. Perkes
    • 7
  • Vicki R. LeBlanc
    • 6
  1. 1.Department of Anaesthesia, Sunnybrook Health Sciences CentreUniversity of TorontoTorontoCanada
  2. 2.Department of Anaesthesia and Department of Innovation in Medical Innovation, The Ottawa HospitalUniversity of OttawaOttawaCanada
  3. 3.Department of Critical CareSunnybrook Health Sciences CentreTorontoCanada
  4. 4.Department of Emergency Medicine, The Ottawa HospitalUniversity of OttawaOttawaCanada
  5. 5.The Wilson Centre for Research in EducationTorontoCanada
  6. 6.Department of Innovation in Medical Education and University of Ottawa Skills and Simulation Centre, The Ottawa HospitalUniversity of OttawaOttawaCanada
  7. 7.Belleville General HospitalBellevilleCanada

Personalised recommendations