E-learning optimization: the relative and combined effects of mental practice and modeling on enhanced podcast-based learning—a randomized controlled trial

Abstract

Enhanced podcasts increase learning, but evidence is lacking on how they should be designed to optimize their effectiveness. This study assessed the impact two learning instructional design methods (mental practice and modeling), either on their own or in combination, for teaching complex cognitive medical content when incorporated into enhanced podcasts. Sixty-three medical students were randomised to one of four versions of an airway management enhanced podcast: (1) control: narrated presentation; (2) modeling: narration with video demonstration of skills; (3) mental practice: narrated presentation with guided mental practice; (4) combined: modeling and mental practice. One week later, students managed a manikin-based simulated airway crisis. Knowledge acquisition was assessed by baseline and retention multiple-choice quizzes. Two blinded raters assessed all videos obtained from simulated crises to measure the students’ skills using a key-elements scale, critical error checklist, and the Ottawa global rating scale (GRS). Baseline knowledge was not different between all four groups (p = 0.65). One week later, knowledge retention was significantly higher for (1) both the mental practice and modeling group than the control group (p = 0.01; p = 0.01, respectively) and (2) the combined mental practice and modeling group compared to all other groups (all ps = 0.01). Regarding skills acquisition, the control group significantly under-performed in comparison to all other groups on the key-events scale (all ps ≤ 0.05), the critical error checklist (all ps ≤ 0.05), and the Ottawa GRS (all ps ≤ 0.05). The combination of mental practice and modeling led to greater improvement on the key events checklist (p = 0.01) compared to either strategy alone. However, the combination of the two strategies did not result in any further learning gains on the two other measures of clinical performance (all ps > 0.05). The effectiveness of enhanced podcasts for knowledge retention and clinical skill acquisition is increased with either mental practice or modeling. The combination of mental practice and modeling had synergistic effects on knowledge retention, but conveyed less clear advantages in its application through clinical skills.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. Allen, K. L., & Katz, R. V. (2011). Comparative use of podcasts vs. lecture transcripts as learning aids for dental students. Journal of dental education, 75(6), 817–822.

    Google Scholar 

  2. Arora, S., Aggarwal, R., Sevdalis, N., Moran, A., Sirimanna, P., Kneebone, R., & Darzi, A. (2009). Development and validation of mental practice as a training strategy for laparoscopic surgery. Surgical Endoscopy, 24(1), 179–187. doi:10.1007/s00464-009-0624-y.

    Article  Google Scholar 

  3. Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Upper Saddle River: Prentice Hall.

    Google Scholar 

  4. Bensalem-Owen, M., Chau, D. F., Sardam, S. C., & Fahy, B. G. (2011). Education research: Evaluating the use of podcasting for residents during EEG instruction: A pilot study. Neurology, 77(8), e42–e44. doi:10.1212/WNL.0b013e31822b0017.

    Article  Google Scholar 

  5. Bhatti, I., Jones, K., Richardson, L., Foreman, D., Lund, J., & Tierney, G. (2011). E-learning vs lecture: which is the best approach to surgical teaching? Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland, 13(4), 459–462. doi:10.1111/j.1463-1318.2009.02173.x.

    Article  Google Scholar 

  6. Cobcroft, R. S., Towers, S. J., Smith, J. E., & Bruns, A. (2006). Mobile learning in review: Opportunities and challenges for learners, teachers, and institutions. Creative Industries Faculty.

  7. Cohen, J. (1988). Statistical power analysis for the behavioral sciencies (2nd ed.). New York: Lawrence Erlbaum.

    Google Scholar 

  8. Cook, D. A. (2005). Learning and cognitive styles in web-based learning: Theory, evidence, and application. Academic Medicine: Journal of the Association of American Medical Colleges, 80(3), 266–278.

    Article  Google Scholar 

  9. Cook, D. A. (2009). The failure of e-learning research to inform educational practice, and what we can do about it. Medical Teacher, 31(2), 158–162. doi:10.1080/01421590802691393.

    Article  Google Scholar 

  10. Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., et al. (2011). Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. JAMA: the Journal of the American Medical Association, 306(9), 978–988. doi:10.1001/jama.2011.1234.

    Article  Google Scholar 

  11. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions. JAMA: the Journal of the American Medical Association, 300(10), 1181–1196.

    Article  Google Scholar 

  12. Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2010). Instructional design variations in internet-based learning for health professions education: A systematic review and meta-analysis. Academic Medicine: Journal of the Association of American Medical Colleges, 85(5), 909–922. doi:10.1097/ACM.0b013e3181d6c319.

    Article  Google Scholar 

  13. Custers, E., Regehr, G., McCulloch, W., Peniston, C., & Reznick, R. (1999). The effects of modeling on learning a simple surgical procedure: See one, do one or see many, do one? Advances in Health Sciences Education: Theory and Practice, 4(2), 123–143. doi:10.1023/A:1009763210212.

    Article  Google Scholar 

  14. Decker, P. J. (1980). Effects of symbolic coding and rehearsal in behavior-modeling training. Journal of Applied Psychology, 65(6), 627–634.

    Article  Google Scholar 

  15. Decker, P. J. (1984). Effects of different symbolic coding stimuli in behavior modeling training. Personnel Psychology, 37(4), 711–720.

    Article  Google Scholar 

  16. Driskell, J. E., Copper, C., & Moran, A. (1994). Does mental practice enhance performance? Journal of Applied Psychology, 79(4), 481.

    Article  Google Scholar 

  17. Epstein, M. L. (1980). The relationship of mental imagery and mental rehearsal to performance of a motor task. Journal of Sport Psychology, 2(3), 211–220.

    Article  Google Scholar 

  18. Feltz, D. L., & Landers, D. M. (1983). The effects of mental practice on motor skill learning and performance: A meta-analysis. Journal of Sport Psychology; Journal of …, 5(1), 25–27.

  19. Feltz, D. L., Landers, D. M., & Becker, B. J. (1988). A revised meta-analysis of the mental practice literature on motor skill learning. Washington, DC: National Academy Press. http://www.nap.edu/openbook.php?record_id=782&page=R1.

  20. Fernandez, V., Sallan, J. M., & Simo, P. (2014). Past, present, and future of podcasting in higher education. In M. Li & Y. Zhao (Eds.), Exploring Learning & Teaching in Higher Education (pp. 305–330). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-55352-3_14.

  21. Friedman, E. E., Karani, R. R., & Fallar, R. R. (2011). Regulation of medical student work hours: A national survey of deans. Academic Medicine: Journal of the Association of American Medical Colleges, 86(1), 30–33. doi:10.1097/ACM.0b013e3181ff9725.

    Article  Google Scholar 

  22. Fryling, M. J., Johnston, C., & Hayes, L. J. (2011). Understanding observational learning: An interbehavioral approach. The Analysis of Verbal Behavior, 27(1), 191.

    Google Scholar 

  23. Glisky, M., Williams, J., & Kihlstrom, J. (1996). Internal and external mental imagery perspectives and performance on two tasks. Journal of Sport Behaviour, 19(1), 3.

  24. Griffin, D. K., Mitchell, D., & Thompson, S. J. (2009). Podcasting by synchronising PowerPoint and voice: What are the pedagogical benefits? Computers & Education, 53(2), 532–539. doi:10.1016/j.compedu.2009.03.011.

    Article  Google Scholar 

  25. Hew, K. F. (2009). Use of audio podcast in K-12 and higher education: a review of research topics and methodologies. Educational Technology Research and Development, 57(3), 333–357.

    Article  Google Scholar 

  26. Hinshaw, K. E. (1991). The effects of mental practice on motor skill performance: Critical evaluation and meta-analysis. Imaginations, Cognition and Personality, 11, 3–35.

    Article  Google Scholar 

  27. Hodges, N. J., & Williams, A. M. (2007). Current status of observational learning research and the role of demonstrations in sport. Journal of Sports Sciences, 25(5), 495–496. doi:10.1080/02640410600946753.

    Article  Google Scholar 

  28. Immenroth, M. M., Bürger, T. T., Brenner, J. J., Nagelschmidt, M. M., Eberspächer, H. H., & Troidl, H. H. (2007). Mental training in surgical education: A randomized controlled trial. Annals of Surgery, 245(3), 385–391. doi:10.1097/01.sla.0000251575.95171.b3.

    Article  Google Scholar 

  29. Jeannerod, M. (1995). Mental imagery in the motor context. Neuropsychologia; Neuropsychologia, 33(11), 1419–1432.

    Article  Google Scholar 

  30. Jowdy, D. P., & Harris, D. V. (1990). Muscular responses during mental imagery as a function of motor skill level. Journal of Sport & Exercise Psychology, 12(2), 191–201.

    Article  Google Scholar 

  31. Kay, R. H. (2012). Exploring the use of video podcasts in education: A comprehensive review of the literature. Computers in Human Behavior, 28(3), 820–831. doi:10.1016/j.chb.2012.01.011.

    Article  Google Scholar 

  32. Kim, J. J., Neilipovitz, D. D., Cardinal, P. P., Chiu, M. M., & Clinch, J. J. (2006). A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Critical Care Medicine, 34(8), 2167–2174. doi:10.1097/01.CCM.0000229877.45125.CC.

    Article  Google Scholar 

  33. Li, N., Kidziński, Ł., Jermann, P., & Dillenbourg, P. (2015). MOOC video interaction patterns: What do they tell us? In G. Conole, T. Klobuèar, C. Rensing, J. Konert, É. Lavoué (Eds.), Design for teaching and … (Vol. 9307, pp. 197–210). Cham: Springer International Publishing. doi:10.1007/978-3-319-24258-3_15.

  34. Mahoney, M. J., & Avener, M. (1977). Psychology of the elite athlete: An exploratory study. Cognitive Therapy and Research, 1(2), 135–141.

    Article  Google Scholar 

  35. McCullagh, P., & Weiss, M. R. (2001). Modeling: Considerations for motor skill performance and psychological responses. Handbook of Sport Psychology, 92, 977–984.

    Google Scholar 

  36. McVee, M. B., Dunsmore, K., & Gavelek, J. R. (2005). Schema theory revisited. Review of Educational Research, 75(4), 531–566. doi:10.3102/00346543075004531.

    Article  Google Scholar 

  37. Morgan, G. E., Mikhail, M. S., & Murray, M. J. (2006). Clinical anesthesiology (4th ed.). New York: Lange Medical Books/McGraw-Hill.

    Google Scholar 

  38. Nasca, T. J., Day, S. H., Amis, E. S., & Force, A. D. H. T. (2010). The new recommendations on duty hours from the ACGME Task Force. New England Journal of Medicine, 363(2), e3. doi:10.1056/NEJMsb1005800.

    Article  Google Scholar 

  39. Nast, A., Schäfer-Hesterberg, G., Zielke, H., Sterry, W., & Rzany, B. (2009). Online lectures for students in dermatology: A replacement for traditional teaching or a valuable addition? Journal of the European Academy of Dermatology and Venereology, 23(9), 1039–1043. doi:10.1111/j.1468-3083.2009.03246.x.

    Article  Google Scholar 

  40. NUS/HEFCE (2010) Student perspectives on technology – demand, perceptions and training needs. Report to HEFCE by NUS, England. Available at http://www.hefce.ac.uk/pubs/rdreports/2010/rd18_10/rd18_10.pdf.

  41. Parson, V., Reddy, P., Wood, J., & Senior, C. (2009). Educating an iPodgeneration: Undergraduate attitudes, experiences and understanding of vodcast and podcast use. Learning, Media and Technology, 34(3), 215–228. doi:10.1080/17439880903141497.

    Article  Google Scholar 

  42. Rainsbury, J. W., & McDonnell, S. M. (2006). Podcasts: An educational revolution in the making? JRSM, 99(9), 481–482. doi:10.1258/jrsm.99.9.481.

    Article  Google Scholar 

  43. Rosen, M. A., Salas, E., Pavlas, D., Jensen, R., Fu, D., & Lampton, D. (2010). Demonstration-based training: A review of instructional features. Human Factors: the Journal of the Human Factors and Ergonomics Society, 52(5), 596–609. doi:10.1177/0018720810381071.

    Article  Google Scholar 

  44. Ryan, E. D., & Simons, J. (1983). What is learned in mental practice of motor skills: A test of the cognitive-motor hypothesis. Journal of Sport Psychology; Journal of Sport …, 5(4), 419–426.

    Article  Google Scholar 

  45. Samkoff, J. S. J., & Jacques, C. H. C. (1991). A review of studies concerning effects of sleep deprivation and fatigue on residents’ performance. Academic Medicine: Journal of the Association of American Medical Colleges, 66(11), 687–693.

    Article  Google Scholar 

  46. Sanders, C. W. C., Sadoski, M. M., Bramson, R. R., Wiprud, R. R., & Van Walsum, K. K. (2004). Comparing the effects of physical practice and mental imagery rehearsal on learning basic surgical skills by medical students. American Journal of Obstetrics and Gynecology, 191(5), 1811–1814. doi:10.1016/j.ajog.2004.07.075.

    Article  Google Scholar 

  47. Sanders, C. W., Sadoski, M., van Walsum, K., Bramson, R., Wiprud, R., & Fossum, T. W. (2008). Learning basic surgical skills with mental imagery: Using the simulation centre in the mind. Medical Education, 42(6), 607–612. doi:10.1111/j.1365-2923.2007.02964.x.

    Article  Google Scholar 

  48. Spiro, R. J., Feltovich, P. J., & Jacobson, M. J. (1992). Cognitive flexibility, constructivism, and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains. Constructivism and the Technology of Instruction.

  49. Start, K. B., & Richardson, A. (2011). Imagery and mental practice. British Journal of Educational Psychology, 34(3), 280–284. doi:10.1111/j.2044-8279.1964.tb00638.x.

    Article  Google Scholar 

  50. Taylor, P. J., Russ-Eft, D. F., & Chan, D. W. L. (2005). A meta-analytic review of behavior modeling training. Journal of Applied Psychology, 90(4), 692–709. doi:10.1037/0021-9010.90.4.692.

    Article  Google Scholar 

  51. Welk, A., Immenroth, M., Sakic, P., Bernhardt, O., Eberspächer, H. H., & Meyer, G. (2007). Mental training in dentistry. Quintessence International (Berlin, Germany: 1985), 38(6), 489–497.

    Google Scholar 

Download references

Acknowledgments

The authors thank Roger Chow and Agnes Ryzynski for their great support in the data collection for this study. They have both given written confirmation for this acknowledgement.

Funding

This work was supported by: (1) Education Initiatives in Residency Education Grant (EIRE)—Faculty of Medicine, University of Ottawa, Ottawa, Canada: Funds were used for data collection, specifically to purchase technological equipment such as Apple iPads. Funds were used to cover expenses incurred presenting preliminary results at the annual Association for Medical Education (AMEE) conference in August 2012. (2) Allan Waters Patient Family Simulation Centre, St. Michael’s Hospital, Toronto, Canada, and the Anaesthesia Departments at The University of Toronto, Toronto, Canada and the University of Ottawa, Ottawa, Canada.: Funds provided were used for data collection, specifically for simulation time only.

Author contributions

FA: Study design, conduct, recruitment, data collection, management, analysis and interpretation, first draft of manuscript and subsequent edits. SB: Study design, analysis and interpretation, and manuscript edits. DP: Study design, and manuscript edits. AL: Rating videos and manuscript edits. CP: Rating videos and manuscript edits. VL: Study design, analysis and interpretation, and manuscript edits.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Fahad Alam.

Ethics declarations

Conflict of interests

None of the authors have any interests to declare.

Appendix: Mental practice think aloud script

Appendix: Mental practice think aloud script

  1. 1.

    From the perspective that you are holding them in your hand, please describe the types of non-invasive supplemental oxygen therapies and differences between each? What do you see and feel that differentiates them?

  2. 2.

    In the first person, as you approach the patient, take me through your approach and decision making process of an awake patient with stridor?

  3. 3.

    From the perspective that you are holding them in your hand, please describe the types of airway adjuncts and differences between each? When would you choose one over the other?

  4. 4.

    In the first person, please describe how you would insert each airway adjunct from start to finish.

  5. 5.

    You are the medical student on-call, you enter a room and the patient has a pulse but is not responsive. In the first person, describe how you would approach the patient and the decision-making behind your management. Take note of what you see, feel and hear.

  6. 6.

    As if you are physically doing it, describe the correct steps in bag mask ventilation and what you will look to see, feel and hear as feedback for successful technique.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Alam, F., Boet, S., Piquette, D. et al. E-learning optimization: the relative and combined effects of mental practice and modeling on enhanced podcast-based learning—a randomized controlled trial. Adv in Health Sci Educ 21, 789–802 (2016). https://doi.org/10.1007/s10459-016-9666-9

Download citation

Keywords

  • Curriculum design
  • E-learning
  • Instructional design
  • Learning strategies
  • Medical education
  • Mental practice
  • Modeling
  • Mobile learning
  • Podcasts
  • Simulation