Skip to main content
SpringerLink
Log in

E-learning optimization: the relative and combined effects of mental practice and modeling on enhanced podcast-based learning—a randomized controlled trial

Advances in Health Sciences Education Aims and scope Submit manuscript

Cite this article

Abstract

Enhanced podcasts increase learning, but evidence is lacking on how they should be designed to optimize their effectiveness. This study assessed the impact two learning instructional design methods (mental practice and modeling), either on their own or in combination, for teaching complex cognitive medical content when incorporated into enhanced podcasts. Sixty-three medical students were randomised to one of four versions of an airway management enhanced podcast: (1) control: narrated presentation; (2) modeling: narration with video demonstration of skills; (3) mental practice: narrated presentation with guided mental practice; (4) combined: modeling and mental practice. One week later, students managed a manikin-based simulated airway crisis. Knowledge acquisition was assessed by baseline and retention multiple-choice quizzes. Two blinded raters assessed all videos obtained from simulated crises to measure the students’ skills using a key-elements scale, critical error checklist, and the Ottawa global rating scale (GRS). Baseline knowledge was not different between all four groups (p = 0.65). One week later, knowledge retention was significantly higher for (1) both the mental practice and modeling group than the control group (p = 0.01; p = 0.01, respectively) and (2) the combined mental practice and modeling group compared to all other groups (all ps = 0.01). Regarding skills acquisition, the control group significantly under-performed in comparison to all other groups on the key-events scale (all ps ≤ 0.05), the critical error checklist (all ps ≤ 0.05), and the Ottawa GRS (all ps ≤ 0.05). The combination of mental practice and modeling led to greater improvement on the key events checklist (p = 0.01) compared to either strategy alone. However, the combination of the two strategies did not result in any further learning gains on the two other measures of clinical performance (all ps > 0.05). The effectiveness of enhanced podcasts for knowledge retention and clinical skill acquisition is increased with either mental practice or modeling. The combination of mental practice and modeling had synergistic effects on knowledge retention, but conveyed less clear advantages in its application through clinical skills.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  • Allen, K. L., & Katz, R. V. (2011). Comparative use of podcasts vs. lecture transcripts as learning aids for dental students. Journal of dental education, 75(6), 817–822.

    Google Scholar 

  • Arora, S., Aggarwal, R., Sevdalis, N., Moran, A., Sirimanna, P., Kneebone, R., & Darzi, A. (2009). Development and validation of mental practice as a training strategy for laparoscopic surgery. Surgical Endoscopy, 24(1), 179–187. doi:10.1007/s00464-009-0624-y.

    Article  Google Scholar 

  • Bandura, A. (1986). Social foundations of thought and action: A social cognitive theory. Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Bensalem-Owen, M., Chau, D. F., Sardam, S. C., & Fahy, B. G. (2011). Education research: Evaluating the use of podcasting for residents during EEG instruction: A pilot study. Neurology, 77(8), e42–e44. doi:10.1212/WNL.0b013e31822b0017.

    Article  Google Scholar 

  • Bhatti, I., Jones, K., Richardson, L., Foreman, D., Lund, J., & Tierney, G. (2011). E-learning vs lecture: which is the best approach to surgical teaching? Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland, 13(4), 459–462. doi:10.1111/j.1463-1318.2009.02173.x.

    Article  Google Scholar 

  • Cobcroft, R. S., Towers, S. J., Smith, J. E., & Bruns, A. (2006). Mobile learning in review: Opportunities and challenges for learners, teachers, and institutions. Creative Industries Faculty.

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciencies (2nd ed.). New York: Lawrence Erlbaum.

    Google Scholar 

  • Cook, D. A. (2005). Learning and cognitive styles in web-based learning: Theory, evidence, and application. Academic Medicine: Journal of the Association of American Medical Colleges, 80(3), 266–278.

    Article  Google Scholar 

  • Cook, D. A. (2009). The failure of e-learning research to inform educational practice, and what we can do about it. Medical Teacher, 31(2), 158–162. doi:10.1080/01421590802691393.

    Article  Google Scholar 

  • Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., et al. (2011). Technology-enhanced simulation for health professions education: A systematic review and meta-analysis. JAMA: the Journal of the American Medical Association, 306(9), 978–988. doi:10.1001/jama.2011.1234.

    Article  Google Scholar 

  • Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008). Internet-based learning in the health professions. JAMA: the Journal of the American Medical Association, 300(10), 1181–1196.

    Article  Google Scholar 

  • Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2010). Instructional design variations in internet-based learning for health professions education: A systematic review and meta-analysis. Academic Medicine: Journal of the Association of American Medical Colleges, 85(5), 909–922. doi:10.1097/ACM.0b013e3181d6c319.

    Article  Google Scholar 

  • Custers, E., Regehr, G., McCulloch, W., Peniston, C., & Reznick, R. (1999). The effects of modeling on learning a simple surgical procedure: See one, do one or see many, do one? Advances in Health Sciences Education: Theory and Practice, 4(2), 123–143. doi:10.1023/A:1009763210212.

    Article  Google Scholar 

  • Decker, P. J. (1980). Effects of symbolic coding and rehearsal in behavior-modeling training. Journal of Applied Psychology, 65(6), 627–634.

    Article  Google Scholar 

  • Decker, P. J. (1984). Effects of different symbolic coding stimuli in behavior modeling training. Personnel Psychology, 37(4), 711–720.

    Article  Google Scholar 

  • Driskell, J. E., Copper, C., & Moran, A. (1994). Does mental practice enhance performance? Journal of Applied Psychology, 79(4), 481.

    Article  Google Scholar 

  • Epstein, M. L. (1980). The relationship of mental imagery and mental rehearsal to performance of a motor task. Journal of Sport Psychology, 2(3), 211–220.

    Article  Google Scholar 

  • Feltz, D. L., & Landers, D. M. (1983). The effects of mental practice on motor skill learning and performance: A meta-analysis. Journal of Sport Psychology; Journal of …, 5(1), 25–27.

  • Feltz, D. L., Landers, D. M., & Becker, B. J. (1988). A revised meta-analysis of the mental practice literature on motor skill learning. Washington, DC: National Academy Press. http://www.nap.edu/openbook.php?record_id=782&page=R1.

  • Fernandez, V., Sallan, J. M., & Simo, P. (2014). Past, present, and future of podcasting in higher education. In M. Li & Y. Zhao (Eds.), Exploring Learning & Teaching in Higher Education (pp. 305–330). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-55352-3_14.

  • Friedman, E. E., Karani, R. R., & Fallar, R. R. (2011). Regulation of medical student work hours: A national survey of deans. Academic Medicine: Journal of the Association of American Medical Colleges, 86(1), 30–33. doi:10.1097/ACM.0b013e3181ff9725.

    Article  Google Scholar 

  • Fryling, M. J., Johnston, C., & Hayes, L. J. (2011). Understanding observational learning: An interbehavioral approach. The Analysis of Verbal Behavior, 27(1), 191.

    Google Scholar 

  • Glisky, M., Williams, J., & Kihlstrom, J. (1996). Internal and external mental imagery perspectives and performance on two tasks. Journal of Sport Behaviour, 19(1), 3.

  • Griffin, D. K., Mitchell, D., & Thompson, S. J. (2009). Podcasting by synchronising PowerPoint and voice: What are the pedagogical benefits? Computers & Education, 53(2), 532–539. doi:10.1016/j.compedu.2009.03.011.

    Article  Google Scholar 

  • Hew, K. F. (2009). Use of audio podcast in K-12 and higher education: a review of research topics and methodologies. Educational Technology Research and Development, 57(3), 333–357.

    Article  Google Scholar 

  • Hinshaw, K. E. (1991). The effects of mental practice on motor skill performance: Critical evaluation and meta-analysis. Imaginations, Cognition and Personality, 11, 3–35.

    Article  Google Scholar 

  • Hodges, N. J., & Williams, A. M. (2007). Current status of observational learning research and the role of demonstrations in sport. Journal of Sports Sciences, 25(5), 495–496. doi:10.1080/02640410600946753.

    Article  Google Scholar 

  • Immenroth, M. M., Bürger, T. T., Brenner, J. J., Nagelschmidt, M. M., Eberspächer, H. H., & Troidl, H. H. (2007). Mental training in surgical education: A randomized controlled trial. Annals of Surgery, 245(3), 385–391. doi:10.1097/01.sla.0000251575.95171.b3.

    Article  Google Scholar 

  • Jeannerod, M. (1995). Mental imagery in the motor context. Neuropsychologia; Neuropsychologia, 33(11), 1419–1432.

    Article  Google Scholar 

  • Jowdy, D. P., & Harris, D. V. (1990). Muscular responses during mental imagery as a function of motor skill level. Journal of Sport & Exercise Psychology, 12(2), 191–201.

    Article  Google Scholar 

  • Kay, R. H. (2012). Exploring the use of video podcasts in education: A comprehensive review of the literature. Computers in Human Behavior, 28(3), 820–831. doi:10.1016/j.chb.2012.01.011.

    Article  Google Scholar 

  • Kim, J. J., Neilipovitz, D. D., Cardinal, P. P., Chiu, M. M., & Clinch, J. J. (2006). A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Critical Care Medicine, 34(8), 2167–2174. doi:10.1097/01.CCM.0000229877.45125.CC.

    Article  Google Scholar 

  • Li, N., Kidziński, Ł., Jermann, P., & Dillenbourg, P. (2015). MOOC video interaction patterns: What do they tell us? In G. Conole, T. Klobuèar, C. Rensing, J. Konert, É. Lavoué (Eds.), Design for teaching and … (Vol. 9307, pp. 197–210). Cham: Springer International Publishing. doi:10.1007/978-3-319-24258-3_15.

  • Mahoney, M. J., & Avener, M. (1977). Psychology of the elite athlete: An exploratory study. Cognitive Therapy and Research, 1(2), 135–141.

    Article  Google Scholar 

  • McCullagh, P., & Weiss, M. R. (2001). Modeling: Considerations for motor skill performance and psychological responses. Handbook of Sport Psychology, 92, 977–984.

    Google Scholar 

  • McVee, M. B., Dunsmore, K., & Gavelek, J. R. (2005). Schema theory revisited. Review of Educational Research, 75(4), 531–566. doi:10.3102/00346543075004531.

    Article  Google Scholar 

  • Morgan, G. E., Mikhail, M. S., & Murray, M. J. (2006). Clinical anesthesiology (4th ed.). New York: Lange Medical Books/McGraw-Hill.

    Google Scholar 

  • Nasca, T. J., Day, S. H., Amis, E. S., & Force, A. D. H. T. (2010). The new recommendations on duty hours from the ACGME Task Force. New England Journal of Medicine, 363(2), e3. doi:10.1056/NEJMsb1005800.

    Article  Google Scholar 

  • Nast, A., Schäfer-Hesterberg, G., Zielke, H., Sterry, W., & Rzany, B. (2009). Online lectures for students in dermatology: A replacement for traditional teaching or a valuable addition? Journal of the European Academy of Dermatology and Venereology, 23(9), 1039–1043. doi:10.1111/j.1468-3083.2009.03246.x.

    Article  Google Scholar 

  • NUS/HEFCE (2010) Student perspectives on technology – demand, perceptions and training needs. Report to HEFCE by NUS, England. Available at http://www.hefce.ac.uk/pubs/rdreports/2010/rd18_10/rd18_10.pdf.

  • Parson, V., Reddy, P., Wood, J., & Senior, C. (2009). Educating an iPodgeneration: Undergraduate attitudes, experiences and understanding of vodcast and podcast use. Learning, Media and Technology, 34(3), 215–228. doi:10.1080/17439880903141497.

    Article  Google Scholar 

  • Rainsbury, J. W., & McDonnell, S. M. (2006). Podcasts: An educational revolution in the making? JRSM, 99(9), 481–482. doi:10.1258/jrsm.99.9.481.

    Article  Google Scholar 

  • Rosen, M. A., Salas, E., Pavlas, D., Jensen, R., Fu, D., & Lampton, D. (2010). Demonstration-based training: A review of instructional features. Human Factors: the Journal of the Human Factors and Ergonomics Society, 52(5), 596–609. doi:10.1177/0018720810381071.

    Article  Google Scholar 

  • Ryan, E. D., & Simons, J. (1983). What is learned in mental practice of motor skills: A test of the cognitive-motor hypothesis. Journal of Sport Psychology; Journal of Sport …, 5(4), 419–426.

    Article  Google Scholar 

  • Samkoff, J. S. J., & Jacques, C. H. C. (1991). A review of studies concerning effects of sleep deprivation and fatigue on residents’ performance. Academic Medicine: Journal of the Association of American Medical Colleges, 66(11), 687–693.

    Article  Google Scholar 

  • Sanders, C. W. C., Sadoski, M. M., Bramson, R. R., Wiprud, R. R., & Van Walsum, K. K. (2004). Comparing the effects of physical practice and mental imagery rehearsal on learning basic surgical skills by medical students. American Journal of Obstetrics and Gynecology, 191(5), 1811–1814. doi:10.1016/j.ajog.2004.07.075.

    Article  Google Scholar 

  • Sanders, C. W., Sadoski, M., van Walsum, K., Bramson, R., Wiprud, R., & Fossum, T. W. (2008). Learning basic surgical skills with mental imagery: Using the simulation centre in the mind. Medical Education, 42(6), 607–612. doi:10.1111/j.1365-2923.2007.02964.x.

    Article  Google Scholar 

  • Spiro, R. J., Feltovich, P. J., & Jacobson, M. J. (1992). Cognitive flexibility, constructivism, and hypertext: Random access instruction for advanced knowledge acquisition in ill-structured domains. Constructivism and the Technology of Instruction.

  • Start, K. B., & Richardson, A. (2011). Imagery and mental practice. British Journal of Educational Psychology, 34(3), 280–284. doi:10.1111/j.2044-8279.1964.tb00638.x.

    Article  Google Scholar 

  • Taylor, P. J., Russ-Eft, D. F., & Chan, D. W. L. (2005). A meta-analytic review of behavior modeling training. Journal of Applied Psychology, 90(4), 692–709. doi:10.1037/0021-9010.90.4.692.

    Article  Google Scholar 

  • Welk, A., Immenroth, M., Sakic, P., Bernhardt, O., Eberspächer, H. H., & Meyer, G. (2007). Mental training in dentistry. Quintessence International (Berlin, Germany: 1985), 38(6), 489–497.

    Google Scholar 

Download references

Acknowledgments

The authors thank Roger Chow and Agnes Ryzynski for their great support in the data collection for this study. They have both given written confirmation for this acknowledgement.

Funding

This work was supported by: (1) Education Initiatives in Residency Education Grant (EIRE)—Faculty of Medicine, University of Ottawa, Ottawa, Canada: Funds were used for data collection, specifically to purchase technological equipment such as Apple iPads. Funds were used to cover expenses incurred presenting preliminary results at the annual Association for Medical Education (AMEE) conference in August 2012. (2) Allan Waters Patient Family Simulation Centre, St. Michael’s Hospital, Toronto, Canada, and the Anaesthesia Departments at The University of Toronto, Toronto, Canada and the University of Ottawa, Ottawa, Canada.: Funds provided were used for data collection, specifically for simulation time only.

Author contributions

FA: Study design, conduct, recruitment, data collection, management, analysis and interpretation, first draft of manuscript and subsequent edits. SB: Study design, analysis and interpretation, and manuscript edits. DP: Study design, and manuscript edits. AL: Rating videos and manuscript edits. CP: Rating videos and manuscript edits. VL: Study design, analysis and interpretation, and manuscript edits.

Author information

Authors and Affiliations

  1. Department of Anaesthesia, Sunnybrook Health Sciences Centre, University of Toronto, 2075 Bayview Avenue, Room M3200, Toronto, ON, M4N 3M5, Canada

    Fahad Alam

  2. Department of Anaesthesia and Department of Innovation in Medical Innovation, The Ottawa Hospital, University of Ottawa, 501 Smyth Road, Ottawa, ON, K1H 8L6, Canada

    Sylvain Boet

  3. Department of Critical Care, Sunnybrook Health Sciences Centre, 2075 Bayview Avenue, Toronto, ON, M4N 3M5, Canada

    Dominique Piquette

  4. Department of Emergency Medicine, The Ottawa Hospital, University of Ottawa, 1053 Carling Avenue, E-Main, Room EM-206, Box 227, Ottawa, ON, K1Y 4E9, Canada

    Anita Lai

  5. The Wilson Centre for Research in Education, 200 Elizabeth Street, 1ES-565, Toronto, ON, M5G 2C4, Canada

    Fahad Alam & Dominique Piquette

  6. Department of Innovation in Medical Education and University of Ottawa Skills and Simulation Centre, The Ottawa Hospital, University of Ottawa, 451 Smyth Road, RGN 2211, Ottawa, ON, K1H 8M5, Canada

    Vicki R. LeBlanc

  7. Belleville General Hospital, 265 Dundas Street East, Belleville, ON, K8N 5A9, Canada

    Christopher P. Perkes

Authors
  1. Fahad Alam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sylvain Boet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dominique Piquette
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anita Lai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Christopher P. Perkes
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Vicki R. LeBlanc
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fahad Alam.

Ethics declarations

Conflict of interests

None of the authors have any interests to declare.

Appendix: Mental practice think aloud script

Appendix: Mental practice think aloud script

  1. 1.

    From the perspective that you are holding them in your hand, please describe the types of non-invasive supplemental oxygen therapies and differences between each? What do you see and feel that differentiates them?

  2. 2.

    In the first person, as you approach the patient, take me through your approach and decision making process of an awake patient with stridor?

  3. 3.

    From the perspective that you are holding them in your hand, please describe the types of airway adjuncts and differences between each? When would you choose one over the other?

  4. 4.

    In the first person, please describe how you would insert each airway adjunct from start to finish.

  5. 5.

    You are the medical student on-call, you enter a room and the patient has a pulse but is not responsive. In the first person, describe how you would approach the patient and the decision-making behind your management. Take note of what you see, feel and hear.

  6. 6.

    As if you are physically doing it, describe the correct steps in bag mask ventilation and what you will look to see, feel and hear as feedback for successful technique.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alam, F., Boet, S., Piquette, D. et al. E-learning optimization: the relative and combined effects of mental practice and modeling on enhanced podcast-based learning—a randomized controlled trial. Adv in Health Sci Educ 21, 789–802 (2016). https://doi.org/10.1007/s10459-016-9666-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10459-016-9666-9

Keywords

search

Navigation