Abstract
Introduction
3D printing contributes to a better understanding of the surgical approach, reduction and fixation of complex fractures. It is unclear how a 3D-printed model relates to a human bone. The accuracy of 3D-printed models is important to pre-bend plates and fit of surgical guides. We conduct a validation study in which we compare human cadavers with 3D-printed models to test the accuracy of 3D printing.
Methods
Nine specimens were scanned, volume rendered into 3D reconstructions and saved as STL data. All models were in a ratio of 1:1 printed on the Ultimaker 3 and Makerbot Replicator Z18. Two independent observers measured all distances between the K-wires on the human cadavers, 2DCT, 3D reconstruction, Meshlab and both printers. A paired Samples T test was used to compare the measurements between the different modalities.
Results
The least decrease in average distance in millimetres was seen in “the 3D printed pelvis 1”, − 0.3 and − 0.8% on respectively the Ultimaker and Makerbot when compared with cadaver Pelvis (1) The 3D model of “Hand 2” showed the most decrease, − 2.5 and − 3.2% on the Ultimaker and Makerbot when compared with cadaver hand (2) Most significant differences in measurements were found in the conversion from 3D file into a 3D print and between the cadaver and 3D-printed model from the Makerbot.
Conclusion
Our 3D printing process results in accurate models suitable for preoperative workup. The Ultimaker 3 is slightly more accurate than the Makerbot Replicator Z18. We advise that medical professionals should perform a study that tests the accuracy of their 3D printing process before using the 3D-printed models in medical practice.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Avoid common mistakes on your manuscript.
Introduction
Complex fractures are difficult to characterise and analyse preoperatively, even with computed tomography (CT) [1, 3]. Surgeons generally need years of practice to transform a two-dimensional (2D) image into a three-dimensional (3D) image in their mind in order to get a proper understanding of the fracture patterns. CT software however easily enables volume rendering of 2DCT into a 3D reconstruction.4.
3D printing has become increasingly utilized in the preoperative planning of clinical orthopaedics, trauma orthopaedics and other disciplines over the past decade [2]. 3D-printed models are readily accessible due to the wide availability of 3D printing techniques and 3D printers [2]. 3D printing contributes to a better understanding of the surgical approach, reduction and fixation of fractures, especially in complex fractures such as acetabular fractures [3, 4,6,6]. Zeng et al. [7] describe the combination of a 3D-printed model and a computer-assisted virtual surgical program for preoperative planning. This combination resulted in improved patient-specific preoperative planning. Furthermore, more accurate reduction and shorter operation times can be achieved [8, 9].
Mallepree et al. [10] concluded that the accuracy of a medical print was mostly influenced by scan parameters and not by the process of converting CT data into 3D prints. The process from scanning the patient to the final 3D-printed model will result in loss of data. However, it is unclear how a 3D-printed model relates to a human bone. To our knowledge, there is no literature that validates the accuracy of 3D-printed models in a preoperative planning strategy when applied to real human bones. The accuracy of 3D-printed models is important to pre-bend plates and fit of surgical guides. We have conducted a validation study in which we compare human cadavers with 3D-printed models to test the accuracy of 3D printing.
Methods
Study preparations
Three fresh frozen human cadavers were obtained from the Department of Anatomy. The pelvis, hands and feet were dissected and freed from all soft tissue exposing the bony structures. The ligamentous structures on the bone were left intact. Nine anatomic specimens − 3 pelvis, 3 hands and 3 feet—were used (Fig. 1).
Titanium Kirschner (K-) wires were inserted to mark anatomical landmarks (Fig. 2).
Pelvic landmarks were defined as the left and right: (1) tubercle on the pubic bone, (2) anterior superior iliac spine (ASIS), (3) posterior superior iliac spine (PSIS), (4) sacroiliac (SI) joint and (5) distance between the SI-joint and pubic bone on the right side of the pelvic bone.
Hand landmarks were defined as: (1) the radial styloid process and distal radioulnar articulation, (2) base and head of the second metacarpal bone and (3) base and head of the fifth metacarpal bone. Figure 3 shows a hand of a cadaver with these marker points.
Foot landmarks were defined as: (1) the distal medial malleolus, (2) between base and head of the first metatarsal bone and (3) base and head of the fifth metatarsal bone. Figure 4 shows a foot with the marker points. The distances between all landmarks were subsequently measured by two independent observers using a Vernier caliper. The point of intersection was defined as the intersection between bone and K wire.
Process of creating 3D prints from CT data
In order to create a 3D print, a standard tessellation language (STL) file is needed. This is a specific file format used by 3D software to generate 3D prints. Converting CT scans in digital imaging and communication (DICOM) file format to STL occurs in three stages [11]: image acquisition, [12] image post-processing [13] and 3D printing.
Image acquisition
The nine specimens were scanned using a Siemens Somatom Definition AS 64-slice CT (Siemens Healthcare, Forchheim, Germany). Slice thickness of 0.6 mm and soft reconstruction filters were used for our protocol in order to generate high resolution images and minimalize soft tissue image noise.
DICOM data of all cadavers were saved in Picture Archiving and Communication System (PACS). The two independent reviewers used the hospital’s integrated Philips Intellispace Portal® software to measure the distance between the markers in two-dimensional views.
Image post-processing
The image post processing was divided into three phases:
Phase 1: creating a volume-rendered model of the object
We used Philips Intellispace Portal software to volume render the DICOM data into 3D reconstructions and to ascertain measurements of the 3DCT landmarks by the two independent observers. Figure 5 shows a 3DCT of the pelvis and a hand with respectively the 5 and 3 anatomical landmarks.
Phase 2: cleaning of the model and creating an STL file from the volume-rendered model
The 3D reconstruction was digitally cleaned from all surrounding artifacts and remnants of the soft tissue in the Philips Intellispace Portal and then saved as an STL file. The landmarks in the STL file were measured by the two independent reviewers using Meshlab, an open-source program (Fig. 6).
Phase 3: importing the STL file in 3D print software and generating the print code
Our hospital uses both the Makerbot Replicator Z18 (Makerbot Industries, USA)—a high end consumer extrusion 3D printer with a large build volume and the Ultimaker 3 (Ultimaker B.V., the Netherlands) a desktop 3D printer with a dual extruder. These printers use Polylactic Acid (PLA), a thermoplastic polyester, to extrude the plastic on a build platform where it solidifies.
The print code (G-code) for the Makerbot was generated using Simplify 3D and the print code for the Ultimaker was generated using Cura. The following process settings were standardized: extruder temperature 215 °C, chamber temperature 24 °C, primary layer height 0.2 mm, infill 2% (the outer side of bone exists of cortical bone, therefore the model supports itself and less infill can be used), support infill 20%, maximum overhang without support 60%.
3D printing
The 3D models of the cadavers were printed in a ratio of 1:1. A 3D-printed model of a hand and the cadaver hand can be seen in Fig. 7. The amount of material used, PLA and support, printing time and filament costs were also noted. The two independent observers measured all distances on all 3D-printed models.
Two observers
All of the measurements described above were undertaken by two independent observers. In summary, they measured the distances between the anatomical landmarks on the human cadavers (cadaver), 2DCT (Port_2D), 3D reconstructions (Port_3D), Meshlab (Mesh_3D) and 3D-printed models on the Ultimaker and Makerbot (Print_UM, Print_MB).
After 1 month, both observers were asked to measure all distances again to measure the inter-observer and intra-observer agreement. The distances between the K-wires on the fresh human cadavers were only measured once, because the cadavers had to be disposed of after two days.
Data analysis
Descriptive statistics were calculated to provide an overview of the print process settings. Observer data were analyzed and expressed in terms of intra- and inter-observer agreement. We used Pearson’s correlation to calculate the correlation coefficient r and to analyse the relationship between the measurements of both observers.
The measurements between both 3D printers and cadavers were also expressed as a percentage of cadavers. A Paired Samples T test was used to compare the measurements between cadavers, 2DCT, 3DCT, Meshlab and both 3D printers. A p value of 0.05 was determined as significant. IBM SPSS Statistics 24 was used for the database (Statistical Package for the Social Sciences, Chicago, IL, USA).
Results
Table 1 shows an overview of the print process settings of both 3D printers. The mean raw material costs for printing a pelvis, foot and hand were respectively 25, 6 and 4 euro for the Makerbot and 34, 13 and 6 euro for the Ultimaker.
Table 2 shows the correlation of the measurements between the observers—the inter-observer agreement. The Pearson correlation coefficient of 1 for each measurement shows that both observers had exact agreement in measuring the distances in all objects.
The intra-observer agreements of both observers are shown in Table 3. All Pearson correlations here too are 1, indicating absolute agreements for each observer.
Table 4 shows the mean distances of the objects measured on all modalities. The average distance in millimetres was calculated of each of the five marker points on the pelvis and three marker points on each foot and hand. For example; the mean distance measured on the cadaver of pelvis 1 was 129.90 mm, 2DCT: 130.17 mm, 3DCT: 130.40 mm, Meshlab: 130.07 mm, Ultimaker: 129.50 mm and Makerbot: 128.80 mm. Furthermore, in Table 4 the measurements of both 3D printers and the cadavers are compared and the difference in percentage between both modalities in calculated. In general, a decrease in measured distances can be seen in all specimens. The least decrease can be seen in “the 3D-printed pelvis 1”, − 0.3 and − 0.8% on respectively the Ultimaker and Makerbot when compared with cadaver Pelvis 1. The 3D model of “Hand 2” shows the most decrease, − 2.5 and − 3.2% on the Ultimaker and Makerbot when compared with cadaver hand 2.
Table 5 shows the P values of the differences in measurements between cadavers, 2DCT, 3DCT, Meshlab and both 3D printers. Most significant differences in measurements were found in the conversion from 3D file into a 3D print and between the cadaver and 3D-printed model from the Makerbot.
Discussion
3D-printed anatomical models have to be accurate, especially for pre-bending plates in complex fracture surgery [6, 14]. This validation study investigated the accuracy of our 3D printing process. To the best of our knowledge, the accuracy of 3D-printed anatomical models has not been investigated [5, 6, 15, 16]. In this study we validated the 3D printing process for our clinical setting.
The literature we reviewed on the clinical use of 3D printing in daily practice did not clarify the validation of their 3D printing process [17–20]. Mallepree et al. [10] reported in their study that accuracy of medical 3D models was mainly affected by scan parameters and not the printing process itself. However, our study highlighted different results. Table 4 highlights that step 1 (cadaver—2DCT) showed smaller differences in measured distances when compared with differences measured in step 4 (i.e. Meshlab—3D printers). In step 1, only “foot 1” showed a difference of > 1 mm between the measurements on the cadaver and 2DCT. In step 4, a difference of > 1 mm between the measurements using Meshlab and both printers was found in: pelvis 1, pelvis 2, pelvis 3, foot 1, foot 2 and hand 2 (Table 4). This observation is confirmed by the results in Table 5, which show a significant decrease in measured millimetres when both 3D printers are compared with Meshlab. No significant differences were found between the cadavers and CT and CT and Meshlab. Additionally, this table also shows that there are more significant differences between the cadaver and Makerbot, than between the cadaver and Ultimaker. Therefore, it seems that the Ultimaker is more accurate than the Makerbot.
We measured a decrease in distance between the landmarks when comparing the actual 3D prints with the digital files. However, on closer inspection of the 3D-printed models, we noticed that the 3D-printed K-wires were more flattened than the actual K-wires (Fig. 8). This resulted in a shorter distance when measuring on 3D-printed models. A reason for this difference in shape could be that scanning titanium wires cause artifacts on the digital files which lead to small measurement errors on the 3D-printed objects.
Even though the differences between the cadavers and 3D-printed models are statistically significant (Table 5), we find the clinical importance less significant. We believe that these small differences will neither affect the position of the pre-bended plate nor the anatomy of the bone irrespective of the location or type of fracture.
Our study has some limitations. A small sample size (n = 9) was used. Nevertheless, a clear trend can be seen between the different modalities. In analysing 3D models, a volumetric analysis would be more accurate and is in fact the gold standard. We did not perform a volumetric analysis of the cadavers and the printed models, for this we would need a fluid displacement method [21, 22]. This in theory is an easy method but not feasible in our study. Utilising a fluid displacement model makes removal of all the soft tissue of the cadaver models essential. This however was not possible in our study design. Also, the PLA filament in use is permeable and hydrophilic. Therefore, a fluid displacement measurement comparison with a 3D-printed model would be unreliable as the model would absorb water. Another limitation of this study is that we used specific software to convert and modify the files and the results cannot be extrapolated to other software. Our results are only applicable for Philips software (Royal Philips N.V., the Netherlands) and the open source software we used. We only validated our 3D printing process and cannot say anything about 3D printing with other types of software and 3D printers.
Conclusion
We can conclude that our 3D printing process results in accurate models suitable for preoperative workup. The Ultimaker 3 is slightly more accurate than the Makerbot Replicator Z18. Medical professionals must be aware that titanium can give artifacts on 3D-printed models. We advise that medical professionals should perform a study that tests the accuracy of their 3D printing process before using the 3D-printed models in medical practice.
References
Tack P, Victor J, Gemmel P, Annemans L. 3D-printing techniques in a medical setting: a systematic literature review. BioMed Eng Online. 2016;15(1):115.
Bagaria V, Deshpande S, Rasalkar DD, Kuthe A, Paunipagar BK. Use of rapid prototyping and three-dimensional reconstruction modeling in the management of complex fractures. Eur J Radiol. 80(3):814–20.
Hurson C, Tansey A, O’donnchadha B, Nicholson P, Rice J, McElwain J. Rapid prototyping in the assessment, classification and preoperative planning of acetabular fractures. Injury. 2007;38(10):1158–62.
Mitsouras D, Liacouras P, Imanzadeh A, et al. Medical 3D printing for the radiologist. Radiographics. 2015;35(7):1965–88.
Borrelli J, Goldfarb C, Catalano L, Evanoff BA. Assessment of articular fragment displacement in acetabular fractures: a comparison of computerized tomography and plain radiographs. J Orthop Trauma. 2002;16(7):449 – 56. (discussion 456-7).
Kim HN, Liu XN, Noh KC. Use of a real-size 3D-printed model as a preoperative and intraoperative tool for minimally invasive plating of comminuted midshaft clavicle fractures. J Orthop Surg Res. 2015;10(1):91.
Huang H, Hsieh M, Zhang G, et al. Improved accuracy of 3D-printed navigational template during complicated tibial plateau fracture surgery. Australas Phys Eng Sci Med. 2015;38(1):109–17.
Zeng C, Xing W, Wu Z, Huang H, Huang W. A combination of three-dimensional printing and computer-assisted virtual surgical procedure for preoperative planning of acetabular fracture reduction. Injury. 2016;47(10):2223–7.
Chen XJ, Yuan JB, Wang CT, Huang YL, Kang L. Modular preoperative planning software for computer-aided oral implantology and the application of a novel stereolithographic template: a pilot study. Clin Implant Dent Relat Res. 2010;12:181–93.
Upex P, Jouffroy P, Riouallon G. Application of 3D printing for treating fractures of both columns of the acetabulum: benefit of pre-contouring plates on the mirrored healthy pelvis. Orthop Traumatol Surg Res. 2017;103(3):331–4.
Mallepree T, Bergers D. Accuracy of medical RP models. Rapid Prototyp J. 2009;15(5):325–32.
Mandrekar JN. Measures of interrater agreement. Rapid Prototyp J. 2011;6(1):6–7.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.
Dai K, Yan M, Zhu Z, Sun Y. Computer-aided custom-made hemipelvic prosthesis used in extensive pelvic lesions. J Arthroplasty. 2007;22(7):981–6.
Wu XB, Wang JQ, Zhao CP, et al. Printed three-dimensional anatomic templates for virtual preoperative planning before reconstruction of old pelvic injuries: Initial results. Chin Med J (Engl). 2015;128(4):477–82.
Chen X, Chen X, Zhang G, et al. Accurate fixation of plates and screws for the treatment of acetabular fractures using 3D-printed guiding templates: an experimental study. Injury. 48(6):1147–54.
Izatt MT, Thorpe PLPJ., Thompson RG, D’Urso PS, Adam CJ, Earwaker JWS. The use of physical biomodelling in complex spinal surgery. Eur Spine J. 2007;16:1507–18.
Modabber A, Legros C, Rana M, Gerressen M, Riediger D, Ghassemi A. Evaluation of computer-assisted jaw reconstruction with free vascularized fibular flap compared to conventional surgery: a clinical pilot study. Int J Med Robot. 2012;8:215–20.
Ayoub N, Ghassemi A, Rana M, Gerressen M, Riediger D, Holzle F. Evaluation of computer-assisted mandibular reconstruction with vascularized iliac crest bone graft compared to conventional surgery: a randomized prospective clinical trial. Trials. 2014;15:114.
Wilde F, Winter K, Kletsch K, Lorenz K, Schramm A. Mandible reconstruction using patient-specific pre-bent reconstruction plates: comparison of standard and transfer key methods. Int J Comput Assist Radiol Surg. 2014;10:129–40. https://doi.org/10.1007/s11548-014-1065-1.
Partik BL, Stadler AF, Schamp SF, et al. 3D versus 2D ultrasound: Accuracy of volume measurement in human cadaver kidneys. Invest Radiol. 2002;37(9):489–95.
Bakker J, Olree M, Kaatee R, de Lange E,E, Beek FJA. In vitro measurement of kidney size: comparison of ultrasonography and MRI. Ultrasound Med Biol. 24(5):683–8.
Funding
Brouwers, Teutelink, van Tilborg, de Jongh, Lansink and Bemelman did not receive funding for this study, neither were there financial or personal relationships with a third party.
Author information
Authors and Affiliations
Contributions
AL, Department of Anatomy, Radboud UMC, and his team: VG, DC, F, JZ, JP, BE; LB, curator, anatomical museum Radboud UMC; RO, BB, Department of Radiology, Elisabeth-Tweesteden Hospital; RB, reviewing English manuscript.
Corresponding author
Ethics declarations
Ethical approval
An approval by an ethics committee was not applicable.
Conflict of interest
Brouwers, Teutelink, van Tilborg, De Jongh, Lansink and Bemelman declare that they have no conflict of interest.
Additional information
Lars Brouwers and Arno Teutelink are joint first authors of this manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Brouwers, L., Teutelink, A., van Tilborg, F.A.J.B. et al. Validation study of 3D-printed anatomical models using 2 PLA printers for preoperative planning in trauma surgery, a human cadaver study. Eur J Trauma Emerg Surg 45, 1013–1020 (2019). https://doi.org/10.1007/s00068-018-0970-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00068-018-0970-3