Abstract
Three-dimensional (3D) printing is increasingly used in medical education and paediatric cardiology. A technology-enhanced learning (TEL) module was designed to accompany 3D printed models of congenital heart disease (CHD) to aid in the teaching of medical students. There are few studies evaluating the attitudes and perceptions of medical students regarding their experience of learning about CHD using 3D printing. This study aimed to explore senior medical students’ experiences in learning about paediatric cardiology through a workshop involving 3D printed models of CHD supported by TEL in the form of online case-based learning. A mixed-methods evaluation was undertaken involving a post-workshop questionnaire (n = 94 students), and focus groups (n = 16 students). Focus group and free-text questionnaire responses underwent thematic analysis. Questionnaire responses demonstrated widespread user satisfaction; 91 (97%) students agreed that the workshop was a valuable experience. The highest-level satisfaction was for the physical 3D printed models, the clinical case-based learning, and opportunity for peer collaboration. Thematic analysis identified five key themes: a variable experience of prior learning, interplay between physical and online models, flexible and novel workshop structure, workshop supported the learning outcomes, and future opportunities for learning using 3D printing. A key novel finding was that students indicated the module increased their confidence to teach others about CHD and recommended expansion to other parts of the curriculum. 3D printed models of CHD are a valuable learning resource and contribute to the richness and enjoyment of medical student learning, with widespread satisfaction.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The technology of three-dimensional (3D) printing has undergone a dramatic evolution in recent years, with rapid uptake across the healthcare industry [1]. 3D printing has been demonstrated to be a valuable educational tool in the teaching of general and cardiac anatomy for both science [2] and medical students [3,4,5]. These studies have demonstrated superiority or non-inferiority to traditional cadaveric or two-dimensional (2D) teaching modalities in the areas of knowledge acquisition and learner satisfaction [6, 7]. A recent systematic review and meta-analysis of the use of 3D printed resources compared to conventional teaching modalities in medical education found that 3D printed resources were superior in terms of learner satisfaction and short-term knowledge acquisition [8]. However, for the sub-group of five studies that specifically looked at cardiac anatomy, there was no significant difference in post-teaching knowledge scores between conventional and 3D printed anatomy teaching. A contemporary survey of Polish medical and health-science students [9] found that a majority (79%) were willing to participate in medical education activities related to 3D printing.
Congenital heart disease (CHD) is the most common congenital anomaly, occurring in 1% of live births [10] and will be encountered by family medicine, emergency, paediatric, and adult physicians across the spectrum of their clinical practice. Adult CHD is estimated to affect 3000 in every 1 million adults and this proportion is likely to increase with increased CHD survival rates [11]. Inadequate clinician knowledge can lead to suboptimal care of these patients for both simple and complex lesions [12], and thus this is an important area of medical education. Recent efforts have been made to introduce 3D printed models of CHD teaching across a spectrum of learners including undergraduate nursing [13] and medical students [6, 7, 14,15,16]; paediatric [17, 18], critical-care [19,20,21], and cardiac surgical and physician trainees [22,23,24]; and adult and paediatric cardiac nurses [25]. These studies have demonstrated the feasibility and some efficacy in the use of 3D printed models of CHD as learning aids, but have not comprehensively explored students’ attitudes and experiences with these novel learning aids. Additionally, there has been little focus on how learners are directed or facilitated to use 3D printed models, and thus how they can be incorporated into new or existing curricula. We have previously demonstrated that students given an unstructured opportunity to explore both waxed cadaveric specimens and 3D printed models of CHD overall spend an equivalent time holding and interacting with both models — and tend to interact more with pipe-cleaners and more robustly handle the 3D models [26]. Medical education has rapidly adopted technology-enhanced learning (TEL) over the past decade [27], especially in the field of anatomy [28]. However, TEL as it pertains to congenital cardiac anatomy has not previously been evaluated.
In late 2019, as part of an interdisciplinary group, the authors designed a cardiac pathology workshop incorporating a self-directed online module with guided exploration of online and 3D printed models of congenital cardiac disease. This self-directed workshop replaced a previous 30 minute in-person session with didactic teaching on paediatric cardiac pathology using waxed cadaveric specimens of CHD. The cadaveric specimens were part of a regular teaching set housed at The Children’s Hospital at Westmead, NSW, Australia, which were at risk of being degraded over time with repeated use. Students at the University of Sydney Medical Program complete their paediatric teaching across metropolitan and regional hospitals, and students at regional hospitals were unable to access these centrally housed specimens. The emergence of the COVID-19 pandemic further provided stimulus for the redevelopment of this practical session due to concerns around adequate cleaning of specimens between all students, and the need to limit large group interactions.
We created a small-group based, self-directed cardiac pathology workshop to enhance student confidence and competence in understanding and applying knowledge related to CHD. This cardiac pathology workshop used online clinical cases and digital 3D models to facilitate a guided exploration of identical hand-held 3D printed models of anatomic specimens. Inspiring confidence and self-efficacy was key, insofar as the complexity of CHD and its perception as difficult or confusing to medical students can lead to disillusionment and abandonment of the subject area. This reflects Bandura’s concept of self-efficacy in social cognitive learning theory, as a student’s conception of their self-efficacy influences goal selection, effort investment, and resilience in the face of adversity and difficulty [29].
This study aimed to explore medical students’ perceptions of the use of 3D printed models of CHD, and assess their self-efficacy and confidence in knowledge about CHD following a self-directed CHD workshop incorporating online and 3D printed models of CHD.
Materials and Methods
Setting
The University of Sydney Medical Program is a graduate entry 4-year medical degree. At the time of the study, students in third or fourth year completed a compulsory 8-week Child and Adolescent Health Specialty Block, which includes curriculum topics focussed on CHD. Cardiac teaching in the Medical Program includes didactic lectures in the first two years and a lecture and interactive cardiac pathology workshop during the Child and Adolescent Health Block. This workshop was delivered four times annually either at the Children’s Hospital at Westmead (a tertiary/quaternary paediatric hospital) or at one of the rural sites (Orange, Dubbo, and Lismore Base Hospitals).
Workshop
The cardiac pathology workshop was designed around four clinical cases of children with CHD. It involved a 45-min in-person self-directed mixed-media session incorporating a digital module and hand-held 3D printed models of CHD, supported by a single facilitator. Facilitators did not have specialist paediatric cardiology expertise, and included junior paediatric trainees and adult cardiologists, in a ratio of 1 facilitator to 25 students. A 5-min online lecture on the fetal circulation was available for students to watch prior to the workshop. The learning objectives of the workshop were for students to be able to identify normal and abnormal features of cardiac anatomy and CHD, and to relate these features to cardiac physiology and their clinical implications.
The digital module was built in collaboration with three computing design under-graduate students at the University of Sydney, supervised by LB. Key features in the design included simple navigation, a capacity to move through individual clinical cases sequentially, and a 3D rendering (i.e. digital 3D image) of the identical hand-held model the students would use in-person. The online module was designed to be 'clicked through' in a way that would guide students to match their hand-held model with the online 3D model, thus providing a semi-structured guided exploration of the 3D models. This online 3D model could be zoomed into and rotated, and have labels removed and added to enhance clarity.
In small self-directed groups of two or three, students worked through the four unfolding clinical cases of CHD in the online module: ventricular septal defect with patent foramen ovale, patent ductus arteriosus, coarctation of the aorta with an atrial septal defect, and tetralogy of Fallot. Each case had three components (see Fig. 1). The first was the clinical case, with details of the presenting symptoms, examination details, and chest radiographs; students were prompted to discuss with their group the relevant cardiac and non-cardiac differential diagnoses as they worked through each stage of the case. The second component of the online module then led the students through a digitally facilitated exploration of the 3D printed model of the specific heart lesion, using pipe-cleaners, paper-clips, and mobile telephone lights to explore and understand the anatomic and physiologic substrate that contributed to the case presentation (see Fig. 2). The online 3D model was identical to the 3D printed model that students held, which aided in students’ orientation and identification of normal and abnormal cardiac anatomy. Finally, students were provided with an explanation of the underlying cardiac physiology of the case. The online module remained available to students after the workshop to revise and consolidate their learning.
Three-dimensional Printing
3D printed heart models were produced from computer tomography (CT) scans (0.4 mm slices, Siemens SOMATOM Force, Munich, Germany) of existing, anonymised, fixed, and waxed cadaveric heart specimens from the Department of Pathology, The Children’s Hospital at Westmead. Four specimens were chosen as representative of simple and complex CHD — ventricular septal defect with patent foramen ovale, patent ductus arteriosus, coarctation of the aorta with an atrial septal defect, and tetralogy of Fallot. CT scans were exported as DICOM files, segmented using Mimics Innovation Suite (v19.0, Materialise, Leuven, Belgium), and 3D printed at scale (see Fig. 3) in acrylonitrile styrene acrylate (ASA) using material extrusion (Fortus 450mc, Stratasys, Israel).
Study Design
This was a concurrent triangulation mixed-methods study [30] involving a questionnaire and focus groups. The questionnaire examined the students’ attitudes and perceptions towards 3D printed models of CHD, the online module, and their self-efficacy in learning about paediatric cardiac pathology. The focus groups further explored students’ experience in using the 3D printed models to identify novel insights into student engagement with 3D printed models of CHD and the digital module.
Recruitment and Participants
Participants were recruited from third and fourth year medical students who attended the cardiac pathology workshop in 2021. Attendance at this non-graded workshop was compulsory, but participation in the study (questionnaires or focus groups) was voluntary. Administrative staff informed students about the study via email before the workshops. The workshop facilitator and focus group interviewers were not involved in student assessment.
Data Collection
At the end of the workshop, students were provided with a hard-copy of the anonymous questionnaire (see Appendix A), which took approximately 10 min to complete. The questionnaire was a modification of the Cook and Ellaway [31] short learner evaluation of TEL. It entailed 14 questions using a 7-point Likert scale (strongly agree to strongly disagree) and five free-text questions regarding engaging aspects of the workshop and suggestions for improvement. Participants were also asked to indicate their gender, age, and location of the workshop (urban or rural).
Two 30-min focus groups were held with small groups of eight students each, within 1 week of the workshop. The audio-recorded focus groups were conducted by two interviewers (JL and KS) via video-conferencing using a series of discussion questions (see Appendix B). JL led the questions and discussion, whilst KS took field notes. Focus groups were repeated until theoretical saturation was achieved (at two).
Data Analysis
Individual questionnaire responses were collated and stored in an Excel spreadsheet. Demographic details were summarised using frequency counts and percentages for categorical variables and mean and standard deviation (SD) for continuous normally distributed variables. Missing responses were excluded listwise from analysis. Analysis was performed with GraphPad Prism v9 (GraphPad Software, San Diego, CA) and figures were created with BioRender.com.
Audio-recordings of the focus groups were transcribed and the recordings then deleted after consultation with field notes. Focus group transcriptions and qualitative questionnaire responses were analysed in duplicate (JL and TC) using thematic analysis [32]. Data were coded line by line to form themes and sub-themes. A coding table was created to classify all data, and differences were discussed amongst the researchers (JL, TC, EN, and KS) until consensus on themes was reached.
Results
Questionnaire Responses
Two-hundred and twenty students attended the cardiac pathology workshop between January 2021 and July 2021. Of these, 94 (43%) submitted a completed questionnaire. There were 47 (50%) females, 43 (46%) males with 4 (4%) respondents not stating a gender. Mean age was 27.7 (SD ± 2.9) years, with five respondents not stating their age. Seventy-five (80%) respondents attended the workshop at The Children’s Hospital at Westmead and 19 (20%) at one of the three regional hospitals. All questions were completely answered except for one missing response to question five. Quantitative responses to the questionnaire are reported in Fig. 4.
Thematic Analysis
Sixteen students participated in two focus groups. Free-text responses to five questions in the questionnaire (Appendix A) were combined with the focus group discussion for thematic analysis. Five major themes were identified from the qualitative data, with twelve sub-themes. Thematic relationships are displayed graphically in Fig. 5. Students brought (A) variable prior knowledge regarding CHD to the workshop, and utilised the (B) interplay between the physical and online models in (C) a flexible and novel workshop structure. The workshop (D) supported their learning outcomes, and students identified (E) opportunities for growth.
Diverse Prior Knowledge
Students had variable knowledge of CHD prior to the workshop, despite having participated in the same early medical school lectures. Some students reported a good pre-existing knowledge, and that “based on the lectures we’d done here and there, we were adequately prepared but I feel like even if in theory you weren’t, you would still be fine”. These prior experiences included more formal didactic pre-clinical lectures, and cadaveric anatomy teaching using normal hearts. However, multiple students felt that previous teaching had left them bewildered, commenting that historically they had received “a lot of very didactic lectures where there’s all this info and trying to remember it”. One student reflected that, unlike their former teaching, the cardiac pathology workshop provided “an opportunity to see the heart defect physically, and not just close your eyes and try to visualise it like in first year”.
Interplay Between Physical and Online Models
Harmony vs. Redundancy
One of the key aims of the online module and use of the virtual 3D heart was to orient and guide the students through the exploration of the 3D printed model, to mitigate the confusion that can otherwise be felt in a self-directed anatomy session. Most students found that the hand-held and online models complemented each other in a harmonious fashion, where the online model facilitated a structured exploration of the physical model. Students said, “We sort of used them together so I think the physical model was great, probably preferred that but then the online one was really helpful to orientate yourself to the physical one”. The labels on the online model “were really good, they were probably the only thing that really helped with orientation”. However, some students struggled to identify the anatomy without the tutor’s assistance, even with the online orientation, commenting that “we spent quite a bit of time on the outflow tracts and I don’t think the labels really helped me. It just took us a long time to find them”. A few students found that there was unnecessary repetition: “there was quite an overlap and the hand-held models would have been enough” or that the models were interesting, but not essential, to their learning: “They were definitely cool, I just think if they were like missing from the session, it wouldn’t really have impacted my learning”.
Model Preference
Some students expressed a clear preference for one modality (hand-held or online) compared to the other, often with significant enthusiasm. One student said, “I liked the hand-held models over the ones on the website just because it was way easier to just hold something and move it exactly how you want it”. This contrasted with another’s suggestion for improvement: “Not making me come play with plastic toys. This could have been done ONLINE”. This reflected unique learning preferences, and students were often clear and articulate about their learning needs, saying “I much preferred the physical models over the virtual – very interesting”. Whilst some students had a clear preference, the availability of both models in the workshop meant that these could be complementary modalities without compromising an individual’s time nor learning preferences, and some students reflected on this: “I prefer the hand-held ones but …if I didn’t have those handy, then I think having it on the website kind of supplements and would supplement my learning”.
Tangible and Tactile Interactions
Medical students voiced significant enthusiasm for the tactile and concrete interactions with the 3D printed models of CHD. Students found that being able to touch, feel, and see the heart defects made it easier to understand both the defects and the relationships between structures, and said “There [were] a couple of things that were easy to appreciate—the relationship between chambers and how big they are and that kind of stuff. It developed us and made us appreciate that better”. The relationship between anatomy, physiology, and pathophysiology was made clearer, and one student commented “I think just having the pipe cleaners and stuff to stick in the different defects was fun, a different way to sort of appreciate it and not just the big gaping holes”. Graduate medical students are mature learners, aware of their learning preferences and able to articulate this, for example: “As a visual learner, I really enjoyed the models”. Some felt they were already confident in the material and subject matter, but that “You get a more detailed perspective on how small the hearts are and how small the defects can be, as well as seeing I guess ventricular hypertrophy or stuff like that in front of you”.
Flexible and Novel Workshop Structure
Small Group Peer-Supported Learning
The structure of the module was built to be largely self-directed, and encourage peer-collaboration without significant specialised instructor knowledge or involvement. Students were broadly positive and found the online learning module well-made and easy to navigate, complementing the case-based learning in small groups. One said “we felt really lucky that we had a small group so we could sort of spend as much time and ask all sorts of questions about things which was good”. The non-didactic workshop format was preferred to traditional lectures: “We found it useful to have it with cases online so that it wasn’t just the normal lecture format we were used to and we could have a more practical component to it”. Despite the intention that the workshop was largely self-driven, students still reported significant interactions with the tutors available: “we did have a tutor run through it with us which was good and probably helped fill in the blanks in terms of what was going on behind the scenes”. Students particularly enjoyed the opportunity for collaboration, with their peers and with the facilitators, as they engaged in the problem-solving of unpacking the clinical case.
Novelty
Students repeatedly described the workshop as fun, and this was reflected in the vigour and enthusiasm of some responses. The theme of play was also repeated in feedback, as students conceived of the cases as games and puzzles to be solved, rather than strictly academic pursuits. Students found the workshop creative and innovative and novel, commenting “It’s novel compared to the other workshops and teaching that we have and it’s like different from going through a textbook or an online resource”. Students reflected that they appreciated things they hadn’t anticipated or understood previously: “We all know we’ve got two atria and two ventricles, like that’s not breaking news, but just sort of seeing how the effects manifest and whatnot was really cool”.
Workshop Supported Learning Outcomes
Learning from Challenge
The workshop challenged the students in a constructive manner to learn from real examples of CHD. Students enjoyed the clinical challenge of deduction, and the puzzle-solving nature of case-based learning and the difficulties entailed in diagnosing CHD. Students appreciated the challenge, for example: “I liked the fact the models weren’t labelled… otherwise I would have just relied on the labels that were there and I wouldn’t really try and figure it out and orientate it”. Despite the challenges, they felt the workshop “helped to guide us on what we didn’t feel so comfortable with”, ensuring there was a safe mechanism to progress learning even when they encountered obstacles.
Clinically Relevant
Students particularly felt that the case-based and clinically oriented aspects of the workshop were rewarding and useful for their learning. Students commented “I liked the human component, like as an actual case, that was very helpful”. They felt this actively challenged them to use their clinical reasoning, think laterally and flexibly, and could imagine real-life situations where they could put this knowledge into practice. One student said, “I think anything that has a clinical focus that is a bit more involved where you’re [using] your hands and you can think in a group is always going to be preferable to didactic learning”. They enjoyed the dynamic of the two models (online and hand-held) as it gave them an “opportunity to diagnose and then re-affirm the diagnosis with the heart model” and predicted that “these sorts of things can present whenever, you know it’s not just baby checks but presenting weeks or a few years later, whether you are working in emergency or general practice or paediatrics”.
Reinforced Knowledge
The practical workshop enabled the students to link in their previous knowledge and understanding of CHD and prepared them for examinations and assessments. One student said “The general style of teaching using models and being able to visualise it helped a lot… anything that is anatomical if you can have a model to visualise it I personally take a lot more out of [it]”. Even students who felt confident could take value from the session, for example: “Even though I felt I had a good understanding, I felt it just solidified and also any activity that we do which is memorable, makes it more likely you are going to recall something and understand it”. The digital module and the physical 3D printed models enhanced the clarity of their understanding, and students liked the opportunity to “access it again at home (no pressure)”. Students felt because of the workshop they had an improved understanding of cardiac anatomy and pathophysiology in relation to CHD.
Student Transitions to Teacher
The adage of 'see one, do one, teach one' is long-standing in clinical medicine, and students volunteered that they felt the workshop had increased their understanding of CHD, and thereby their confidence to act as future educators. One student reflected that “pretty much anywhere you work you are probably expected to have some teaching role for students and junior doctors, and I think having been able to visualise these congenital defects, it makes it much easier to be able to teach it in the future”. Another commented that “If we are ever teaching medical students in a cardiology term about these things, I think we’ve got these models to be able to have a good concept of what they are”. The workshop increased students’ confidence both as learners and future teachers.
Future Opportunities
Model Variety
Whilst students overwhelmingly felt the 3D models were useful and important to their understanding of CHD, some had suggestions for changes to future 3D model learning. There was disagreement between students on the optimal scale and size of the models. Some students appreciated the to-scale replication of the defects “it was cool to be able to see it life-sized and to really appreciate that these septal defects or whatever might not actually be that big, and can be quite subtle” whilst others felt like this was a hurdle they could not surmount “It was hard to see everything sometimes, because obviously, they are very small because the kids are very small, but we were kind of like, ‘Oh – is there a hole there?” Students agreed it might be best to have both, “a big model that’s very obvious and not very challenging and then a life-sized model so you can do that conversion of appreciating the detail”. Some students felt a normal 3D printed heart would be useful to help with orientation and learning to become comfortable with the models. Additional proposals included the idea of colour-coding, to identify normal and abnormal features, and to develop features that reflect blood flows in the abnormal heart models.
Cross-Disciplinary Applications
Students felt the 3D printed models and the workshop had potential to be expanded across disciplines in medicine, and into new audiences. Students felt this “could be applied to any kind of anatomy teaching whether they are pathological or normal”, and listed examples including abdominal pathology “intussusception and malrotation and duodenal atresia”, fractures, “brain lesions – like being able to see midline shift or mass effect lesions and how they’re going to compress different stuff”, spinal malformation, and “surgical anomalies like particularly the inguinal scrotal issues”. In addition, students felt the audience could be expanded to include “junior doctors even, if you were coming into an emergency rotation in areas where you might have kids presenting like this, it would be a good thing to do”.
Discussion
This study found that medical students were overwhelmingly positive about the inclusion of 3D printed models in the teaching of CHD. Ninety-seven percent of questionnaire respondents agreed that the self-directed TEL workshop using 3D printed models of CHD was a valuable learning experience, demonstrating widespread user satisfaction. Sub-components of the workshop that were most favourably reviewed overall included the physical 3D printed models, the clinical and case-based learning structure, and the opportunity for peer collaboration. Close to 60% of students strongly agreed that the physical models were useful and that the workshop encouraged peer collaboration, and improved their knowledge of both simple and complex CHD. These insights from the questionnaire were complemented by focus group discussions that demonstrated that the workshop guided students from a position of relative inexperience through tactile, collaborative, online-guided case-based explorations of congenital heart defects, with outcomes including perceived clinical relevance, increased understanding, and confidence in future teaching. Opportunities were identified for expansion of 3D printed model based learning.
Previously, Stunden et al. [33] published their learning outcomes following development of an optional e-learning course for first year medical students using 3D models of CHD. Medical students’ knowledge regarding CHD significantly improved on pre–/post–multiple choice questions, and the majority (88%) were highly motivated to learn with the course structure. Free-text responses suggested an enthusiastic uptake within the medical student body; however, the quantitative analysis suggesting improved knowledge acquisition was limited by the study’s use of identical pre-/post-course test questions, and a post-course test median score of 100% which represents both a response bias and a ceiling effect. Whilst we have not assessed academic performance regarding knowledge of CHD in the present study, we have demonstrated high-level acceptability of this e-learning resource and the 3D printed models. Additionally, students surveyed by Stunden et al. [33] raised concerns about social isolation in independently completing the module asynchronously online, rather than with peers, which is relevant given that students completing our workshop strongly rated the collaborative and peer-supported learning as a valuable feature. This suggests it may not be as effective to wholly digitalise pathology teaching, even with online 3D models.
Students reported increased confidence following the workshop with their knowledge about both simple and more complex CHD, and improved self-efficacy regarding their capacity to recognise the signs of CHD. Self-efficacy is a key concept in Bandura’s social cognitive learning theory, insofar as a student’s confidence in their capacity to achieve desired goals contributes to their competence in utilising their skills within their environment to do so [29]. It has previously been shown that increased self-efficacy relates to increased competence in practical anatomy and clinical examination skills [34, 35], though this has been an inconsistent finding [36, 37]. Particularly in high-stakes and complex areas of medicine, such as CHD, reducing student disinterest and disempowerment and increasing motivation and confidence in identifying signs of CHD are likely to stimulate further interest in the subject. Indeed, Bandura’s concept of self-efficacy suggests that even a slight over-estimation of one’s abilities increases an individual’s capacity to increase effort and persistence during difficult tasks [38]. Low self-efficacy is self-limiting, insofar as an individual perceives themselves as unable and likely to fail, and thus is more likely to cease efforts in the face of struggle [39]. The strongest contribution to increased self-efficacy is enactive mastery — the capacity for an individual to demonstrate to themselves that they are competent, and the self-directed case-based discovery of complex CHD with 3D models is an example of this. Enactive mastery leads to more sustained and substantial self-efficacy, compared to conventional didactic teaching, vicarious experiences (e.g. watching another student interpret the model) or verbal persuasion (e.g. facilitator delivered feedback regarding the student’s performance). This is significant as children with CHD are increasingly surviving into adulthood [11], and thus there is a need for increased generalist understanding of CHD beyond paediatric cardiac services.
Since its inception, our workshop has been expanded horizontally for teaching graduate paediatric nurses, and vertically to second year medical students. This demonstrates its scalable and reproducible design. We have re-printed the smallest models in double scale to improve appreciation of complex anatomical detail. Whilst the cost of 3D printed materials is likely to cheapen over time, and 3D printed models are more durable than waxed or plastinated cadaveric specimens, there are educational concerns that they may be perceived as less realistic than cadaveric specimens. This perception was not evident in our focus groups, and although we did not directly compare 3D models with cadaveric specimens, we have previously demonstrated equivalent medical student usage of both cadaveric and 3D printed models when given the option of both [26]. The uptake of the workshop in peripheral and rural clinical schools has increased educational equity by facilitating access to these priceless learning resources. By building a digital learning resource around the use of the 3D models, a workshop was built that could be exported to different settings and facilitated at all sites without the requirement for specialist paediatric cardiology expertise. This resource also empowers students to revise and consolidate their learning following the workshop. We have demonstrated the possibility of responding to a global call to action to preserve these specimens that are at risk of degradation over time and build a library of 3D printed congenital heart defects [40] that can be 3D printed at any location. In doing so, this study builds on previous evidence of the feasibility of 3D printed models of CHD [6, 7, 14], by demonstrating that they are an efficacious and acceptable learning aid which students are excited to learn from, that satisfies different learning preferences.
Future educators and researchers should be aware that students desire a range of sizes of 3D printed models (rather than making them universally bigger and easier), and should consider the possibility of colour-coding defects to enhance understanding, which other groups have trialled previously [3]. Students agreed least strongly with the statement that the digital models were intuitive to use, which suggests ongoing work is required to integrate the digital models to maximise their ease of use for all students. This may require improvements in relation to the software used to manipulate the online models, the labelling, and the structured exploration via TEL.
Limitations of the present study include the possibility of selection bias, where students who had a positive experience with the workshop may have been more likely to submit completed questionnaires or participate in the focus groups. This is mitigated against by evidence of occasional negative feedback amongst those surveyed and that there was no formal incentive for questionnaire completion to induce a response bias. Additionally, social desirability bias may have complicated students’ questionnaire feedback and focus group participation, although the focus group facilitators were not involved in the delivery of the workshop to the students who participated in the focus groups. As the workshop directly replaced the previous workshop due to COVID-19 restrictions, there was no opportunity to compare our workshop to the existing tutorial using cadaveric specimens. In addition, as the material was considered examinable, we were not able to provide the learning material to one group and deny it to another for the sake of comparison. Future studies may be able to directly relate the use of 3D printed models of CHD to academic performance, and compare the use of exclusively digital with hand-held 3D models or cadaveric specimens.
Conclusions
3D printed models of CHD are efficacious learning aids in the setting of a collaborative case-based TEL module. Their use is associated with widespread medical student satisfaction and high levels of resulting self-efficacy in recognising and understanding simple and more complex CHD. The self-directed nature of the online module, which guides learning as students work through the unfolding clinical cases and explore the 3D printed models, reduces the need for specialist facilitation and encourages peer collaboration. 3D printing has the potential to facilitate scalable and equitable education innovations in the setting of CHD and other congenital anomalies.
Data Availability
The dataset generated during and analysed during the current study is available from the corresponding author on reasonable request.
References
Paul GM, Rezaienia A, Wen P, Condoor S, Parkar N, King W, et al. Medical applications for 3D printing: recent developments. Mo Med. 2018;115(1):75–81.
Garas M, Vaccarezza M, Newland G, McVay-Doornbusch K, Hasani J, et al. 3D-Printed specimens as a valuable tool in anatomy education: A pilot study. Annals of Anatomy - Anatomischer Anzeiger. 2018;219:57–64.
Lim KHA, Loo ZY, Goldie SJ, Adams JW, McMenamin PG, et al. Use of 3D printed models in medical education: a randomized control trial comparing 3D prints versus cadaveric materials for learning external cardiac anatomy. Anat Sci Educ. 2016;9(3):213–21.
Smith CF, Tollemache N, Covill D, Johnston M, et al. Take away body parts! An investigation into the use of 3D-printed anatomical models in undergraduate anatomy education. Anat Sci Educ. 2018;11(1):44–53.
Wang Z, Liu Y, Luo H, Gao C, Zhang J, Dai Y, et al. Is a three-dimensional printing model better than a traditional cardiac model for medical education? A pilot randomized controlled study. Acta Cardiologica Sinica. 2017;33(6):664–9.
Karsenty C, Guitarte A, Dulac Y, Briot J, Hascoet S, Vincent R, et al. The usefulness of 3D printed heart models for medical student education in congenital heart disease. BMC Med Educ. 2021;21(1):480.
Su W, Xiao Y, He S, Huang P, Deng X, et al. Three-dimensional printing models in congenital heart disease education for medical students: a controlled comparative study. BMC Med Educ. 2018;18(1):178.
Ye Z, Dun A, Jiang H, Nie C, Zhao S, Wang T, et al. The role of 3D printed models in the teaching of human anatomy: a systematic review and meta-analysis. BMC Med Educ. 2020;20(1):335.
Wilk R, Likus W, Hudecki A, Sygula M, Rozycka-Nechoritis A, Nechoritis K, et al. What would you like to print? Students’ opinions on the use of 3D printing technology in medicine. PLoS ONE. 2020;15(4):e0230851.
Hoffman JIE, Kaplan S. The incidence of congenital heart disease. J Am Coll Cardiol. 2002;39(12):1890–900.
Nicolae M, Gentles T, Strange G, Tanous D, Disney P, Bullock A, et al. Adult congenital heart disease in Australia and New Zealand: a call for optimal care. Heart Lung Circ. 2019;28(4):521–9.
Cordina R, Nasir Ahmad S, Kotchetkova I, Eveborn G, Pressley L, Ayer J, et al. Management errors in adults with congenital heart disease: prevalence, sources, and consequences. Eur Heart J. 2018;39(12):982–9.
Tan H, Huang E, Deng X, Ouyang S, et al. Application of 3D printing technology combined with PBL teaching model in teaching clinical nursing in congenital heart surgery: A case-control study. Medicine (Baltimore). 2021;100(20):e25918.
Smerling J, Marboe CC, Lefkowitch JH, Pavlicova M, Bacha E, Einstein AJ, et al. Utility of 3D printed cardiac models for medical student education in congenital heart disease: across a spectrum of disease severity. Pediatr Cardiol. 2019;40(6):1258–65.
Costello JP, Olivieri LJ, Krieger A, Thabit O, Marshall MB, Yoo S-J, et al. Utilizing three-dimensional printing technology to assess the feasibility of high-fidelity synthetic ventricular septal defect models for simulation in medical education. World J Pediatr Congenit Heart Surg. 2014;5(3):421–6.
Lau I, Sun Z. The role of 3D printed heart models in immediate and long-term knowledge acquisition in medical education. Rev Cardiovasc Med. 2022;23(1):22.
Loke Y-H, Harahsheh AS, Krieger A, Olivieri LJ, et al. Usage of 3D models of tetralogy of Fallot for medical education: impact on learning congenital heart disease. BMC Med Educ. 2017;17(1):54.
White SC, Sedler J, Jones TW, Seckeler M, et al. Utility of three-dimensional models in resident education on simple and complex intracardiac congenital heart defects. Congenit. 2018;13(6):1045–9.
Costello JP, Olivieri LJ, Su L, Krieger A, Alfares F, Thabit O, et al. Incorporating three-dimensional printing into a simulation-based congenital heart disease and critical care training curriculum for resident physicians. Congenit. 2015;10(2):185–90.
Lee C, Lee JY. Utility of three-dimensional printed heart models for education on complex congenital heart diseases. Cardiol Young. 2020;30(11):1637–42.
Olivieri LJ, Su L, Hynes CF, Krieger A, Alfares FA, Ramakrishnan K, et al. “Just-in-time” simulation training using 3-D printed cardiac models after congenital cardiac surgery. World J Pediatr Congenit Heart Surg. 2016;7(2):164–8.
Nam JG, Lee W, Jeong B, Park EA, Lim JY, Kwak Y, et al. Three-dimensional printing of congenital heart disease models for cardiac surgery simulation: evaluation of surgical skill improvement among inexperienced cardiothoracic surgeons. Korean J Radiol. 2021;22(5):706–13.
Valverde I, Gomez G, Byrne N, Anwar S, Silva MA, Martin Talavera M, et al. Criss-cross heart three-dimensional printed models in medical education: a multi-center study on their value as a supporting tool to conventional imaging. Anat Sci Educ. 2021;18.
Brunner BS, Thierij A, Jakob A, Tengler A, Grab M, Thierfelder N, et al. 3D-printed heart models for hands-on training in pediatric cardiology - the future of modern learning and teaching? GMS J Med Educ. 2022;39(2):23.
Biglino G, Capelli C, Koniordou D, Robertshaw D, Leaver L-K, Schievano S, et al. Use of 3D models of congenital heart disease as an education tool for cardiac nurses. Congenit. 2017;12(1):113–8.
Nusem E, Bray L, Lillia J, Schofield L, Scott KM, Gunasekera H, et al. Utility of 3D printed models versus cadaveric pathology for learning: challenging stated preferences. Med Sci Educ. 2022;32(6):1513–20.
Lin H-C, Hwang G-J. Research trends of flipped classroom studies for medical courses: a review of journal publications from 2008 to 2017 based on the technology-enhanced learning model. Interact Learn Environ. 2019;27(8):1011–27.
Clunie L, Morris NP, Joynes VCT, Pickering JD, et al. How comprehensive are research studies investigating the efficacy of technology-enhanced learning resources in anatomy education? A systematic review Anatomical sciences education. 2018;11(3):303–19.
Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Adv Behav Res Ther. 1978;1(4):139–61.
Cresswell JPC, Clark VL, Gutmann ML, Hanson WE, et al. Advances in mixed methods research designs. In: Tashakkori AT, Teddlie C, editor. Handbook of mixed methods in social and behavioral research. Thousand Oaks, CA: SAGE; 2003. p. 209–40.
Cook DA, Ellaway RH. Evaluating technology-enhanced learning: a comprehensive framework. Med Teach. 2015;37(10):961–70.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Stunden C, Zakani S, Martin A, Moodley S, Jacob J, et al. Replicating anatomical teaching specimens using 3D modeling embedded within a multimodal e-learning course: pre-post study exploring the impact on medical education during COVID-19. JMIR Med Educ. 2021;7(4):e30533.
Burgoon JM, Meece JL, Granger NA, et al. Self-efficacy’s influence on student academic achievement in the medical anatomy curriculum. Anat Sci Educ. 2012;5(5):249–55.
Mavis B. Self-Efficacy and OSCE performance among second year medical students. Adv Health Sci Educ. 2001;6(2):93–102.
Barnsley L, Lyon PM, Ralston SJ, Hibbert EJ, Cunningham I, Gordon FC, et al. Clinical skills in junior medical officers: a comparison of self-reported confidence and observed competence. Med Educ. 2004;38(4):358–67.
Morgan PJ, Cleave-Hogg D. Comparison between medical students’ experience, confidence and competence. Med Educ. 2002;36(6):534–9.
Artino AR. Academic self-efficacy: from educational theory to instructional practice. Perspect Med Educ. 2012;1(2):76–85.
Klassen RM, Klassen JRL. Self-efficacy beliefs of medical students: a critical review. Perspect Med Educ. 2018;7(2):76–82.
Seslar SP, Shepard CW, Giroud JM, Aiello VD, Cook AC, Spicer DE, et al. Lost treasures: a plea for the systematic preservation of cadaveric heart specimens through three-dimensional digital imaging. Cardiol Young. 2015;25(8):1457–9.
Acknowledgements
The authors wish to acknowledge Andrew Nguyen Le, Claire Say, and Viswajith Unnikrishnan who built the e-learning module, and Jacqueline Askwith, Elizabeth Cavanan, Kate Edwards, and Alix Thoeming who contributed to the inter-professional module design group. The authors thank the Children’s Hospital Westmead Clinical School administrative staff for transcription services, the medical students who gave their time to contribute to this research, the Department of Histopathology at the Children’s Hospital Westmead Clinical School, and the parents and children who generously donated cardiac specimens that we continue to learn from to this day.
Funding
Open Access funding enabled and organized by CAUL and its Member Institutions Partial financial support was received from the University of Sydney (Small Educational Innovation Grant (2020)).
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by JL, TC, EN, and KS. The first draft of the manuscript was written by JL and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics Approval
This study was performed in line with the principles of the Declaration of Helsinki. Ethics approval was granted by the Sydney Children’s Hospitals Network Human Research Ethics Committee (2020/ETH03319).
Consent to Participate
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Luxford, J.C., Cheng, T.L., Mervis, J. et al. An Opportunity to See the Heart Defect Physically: Medical Student Experiences of Technology-Enhanced Learning with 3D Printed Models of Congenital Heart Disease. Med.Sci.Educ. 33, 1095–1107 (2023). https://doi.org/10.1007/s40670-023-01840-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40670-023-01840-w