Abstract
Radiologists interprets X-ray samples by visually inspecting them to diagnose the presence of fractures in various bones. Interpretation of radiographs is a time-consuming and intense process involving manual examination of fractures. In addition, clinician’s shortage in medically under-resourced areas, unavailability of expert radiologists in busy clinical settings or fatigue caused due to demanding workloads could lead to false detection rate and poor recovery of the fractures. A comprehensive study is imparted here covering fracture diagnosis with the aim to assist investigators in developing models that automatically detects fracture in human bones. The paper is presented in five folds. Firstly, we discuss data preparation stage. Second, we present various image-processing techniques used for fracture detection. Third, we analyze conventional and deep learning based techniques for diagnosing bone fractures. Fourth, we make comparative analysis of existing techniques. Fifth, we discuss different issues and challenges faced by researches while dealing with fracture detection.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Al-Ayyoub M, Hmeidi I, Rababah H (2013) Detecting hand bone fractures in X-ray images. J Multimed Process Technol (JMPT) 4(3):155–168. https://doi.org/10.13140/RG.2.1.2645.8327
Al-Ayyyoub M, Al-Zghool D (2013) Determining the type of long bone fractures in X-ray images. WSEAS Trans Inf Sci Appl 10(6):261–270
Andreas T, Jahrer M, Bell RM, Park F (2009) The BigChaos solution to the Netflix Grand Prize
Antipov G, Berrani S, Dugelay J (2016) Minimalistic CNN-based ensemble model for gender prediction from face images. Pattern Recognit Lett. https://doi.org/10.1016/j.patrec.2015.11.011
Bandyopadhyay O, Biswas A, Chanda B, Bhattacharya BB (2013) Bone contour tracing in digital X-ray images based on adaptive thresholding. In: Proceedings, 5th international conference on pattern recognition and machine intelligence, volume LNCS 8251, pp 465–473. https://doi.org/10.1007/978-3-642-45062-4_64
Bandyopadhyay O, Biswas A, Bhattacharya BB (2016a) Automatic segmentation of bones in X-ray images based on entropy measure. Int J Image Graph. https://doi.org/10.1142/s0219467816500017
Bandyopadhyay O, Biswas A, Bhattacharya BB (2016b) Long-bone fracture detection in digital X-ray images based on digital-geometric techniques. Comput Methods Programs Biomed 123:2–14. https://doi.org/10.1007/978-3-319-07148-0_19
Bandyopadhyay O, Biswas A, Bhattacharya BB (2016c) Classification of long-bone fractures based on digital-geometric analysis of X-ray images. Pattern Recognit Image Anal 26(4):742–757. https://doi.org/10.1134/S1054661816040027
Birks JS, L’Allier PL, Gingras MA (2016) Convolutional neural networks for medical image analysis: full training or fine tuning? IEEE Trans Med Imaging 35(5):1299–1313. https://doi.org/10.1109/TMI.2016.2535302
Brownlee J (2014) Classification accuracy is not enough: more performance measures you can use. https://machinelearningmastery.com/classification-accuracy-is-not-enough-more-performance-measures-you-can-use. Accessed 22 Apr 2019
Cao Y, Wang H, Moradi M, Prasanna P, Syeda-Mahmood TF (2015) Fracture detection in X-ray images through stacked random forests feature fusion. In: Proceedings—international symposium on biomedical imaging, pp 801–805. https://doi.org/10.1109/isbi.2015.7163993
Cardoso JR et al (2014) What is gold standard and what is ground truth? Dental Press J Orthod 19(5):27–30. https://doi.org/10.1590/2176-9451.19.5.027-030.ebo
Chai HY, Wee LK, Swee TT, Hussain S (2011) Gray-level co-occurrence matrix bone fracture detection. WSEAS Trans Syst 10(1):7–16. https://doi.org/10.3844/ajassp.2011.26.32
Chung SW, Han SS, Lee JW (2018) Automated detection and classification of the proximal humerus fracture by using deep learning algorithm. Acta Orthop 89(4):468–473. https://doi.org/10.1080/17453674.2018.1453714
Cliffe H et al (2016) Summary of The Royal College of Radiologists’ (RCR) reporting backlog surveys and assessment of potential causes and solutions. Clin Radiol 71:1–30. https://doi.org/10.1016/j.crad.2016.06.060
Deng J, Dong W, Socher R, Li L, Li K, Fei-fei L (2009) ImageNet: a large-scale hierarchical image database. In: IEEE conference on computer vision and pattern recognition, 20–25 June 2009, Miami, FL, USA. https://doi.org/10.1109/cvpr.2009.5206848
Dimililer K (2017) IBFDS: intelligent bone fracture detection system. Procedia Comput Sci 120:260–267. https://doi.org/10.1016/j.procs.2017.11.237
Ding C, Tao D (2017) Trunk-Branch Ensemble Convolutional Neural Networks for Video-based Face Recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/TPAMI.2017.2700390
Dormehl L (2019) What is an artificial neural network? Here’s everything you need to know. https://www.digitaltrends.com/cool-tech/what-is-an-artificial-neural-network. Accessed 13 Feb 2019
Gale W, Oakden-Rayner L, Carneiro G, Bradley AP, Palmer LJ (2017) Detecting hip fractures with radiologist-level performance using deep neural networks. Comput Vis Pattern Recognit. arXiv:1711.06504
Greenspan H, Ginneken BV, Summers RM (2016) Guest editorial deep learning in medical imaging: overview and future promise of an exciting new technique. IEEE Trans Med Imaging 35(5):1153–1159. https://doi.org/10.1109/TMI.2016.2553401
Guly H (2001) Diagnostic errors in an accident and emergency department. Emerg Med J (EMJ) 18(4):263–269. https://doi.org/10.1136/emj.18.4.263
Haralick RM, Shanmugam K (1973) Textural features for image classification. IEEE Trans Syst Man Cybern 3(6):610–621. https://doi.org/10.1109/TSMC.1973.4309314
Hari CV, Jojish JV, Gopi S, Felix VP (2010) Mid-point Hough transform: a fast line detection method. In: Annual IEEE India conference, 18–20 Dec. 2009. https://doi.org/10.1109/indcon.2009.540945
He JC, Leou WK, Howe TS (2007) Hierarchical classifiers for detection of fractures in X-ray images. In: Kropatsch WG, Kampel M, Hanbury A (eds) Computer analysis of images and patterns. CAIP 2007. Lecture Notes in Computer Science, vol 4673. Springer, Berlin. https://doi.org/10.1007/978-3-540-74272-2_119
How to organize data labeling for machine learning: approaches and tools (2018). https://www.altexsoft.com/blog/datascience/how-to-organize-data-labeling-for-machine-learning-approaches-and-tools. Accessed 26 Jan 2019
Huang G, Liu Z, Maaten LVD, Weinberger KQ (2017) Densely connected convolutional networks. In: IEEE conference on computer vision and pattern recognition (CVPR), 21–26 July 2017, Honolulu, HI, USA, IEEE, pp 2261–2269. http://doi.org/10.1109/CVPR.2017.243
Jacob NE, Wyawahare MV (2013) Survey of bone fracture detection techniques. Int J Comput Appl 71(17):31–34. https://doi.org/10.5120/12452-9342
Jurie F, Dhome M (2001) A simple and efficient template matching algorithm. In: Eighth IEEE international conference on computer vision, 7–4 July 2001, Vancouver, BC, Canada, IEEE, pp 544–549. http://doi.org/10.1109/ICCV.2001.937673
Khashman A, Dimililer K (2008) Image compression using neural networks and Haar wavelet. WSEAS Trans Signal Process 4(5):330–339
Khatik I (2017) A study of various bone fracture detection techniques. Int J Eng Comput Sci 6(5):21418–21423. https://doi.org/10.18535/ijecs/v6i5.38
Kim KG (2016) Book review: Deep learning, healthcare informatics. Research 22(4):351–354. https://doi.org/10.4258/hir.2016.22.4.351
Kim DH, MacKinnon T (2018) Artificial intelligence in fracture detection: transfer learning from deep convolutional neural networks. Clin Radiol 73(5):439–445. https://doi.org/10.1016/j.crad.2017.11.015
Kingma D, Ba J (2015) A method for stochastic optimization. In: International conference on learning representations, San Diego
Kinnari P, Dangar Y (2017) A survey for fracture detection in hand bone X-ray images. Int J Adv Res Innov Ideas Educ 3(1):1529–1533. ISSN(O)-2395-4396
Koehrsen W (2018) Beyond accuracy: precision and recall. https://towardsdatascience.com/beyond-accuracy-precision-and-recall-3da06bea9f6c. Accessed 9 Apr 2019
Kohli M, Prevedello LM, Filice RW, Geis JR (2017) Implementing machine learning in radiology practice and research. Am J Roentgenol 208(4):754–760. https://doi.org/10.2214/ajr.16.17224
Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 60(6):84–90. https://doi.org/10.1145/3065386
Krupinski EA, Berbaum KS, Caldwell RT, Schartz KM, Kim J (2010) Radiology workdays reduce detection and accommodation accuracy. J Am Coll Radiol 7(9):698–704. https://doi.org/10.1016/j.jacr.2010.03.004
Kumar A et al (2017) An ensemble of fine-tuned convolutional neural networks for medical image classification. IEEE J Biomed Health Inform 21(1):31–40. https://doi.org/10.1109/JBHI.2016.2635663
Kuncheva L, Whitaker E (2001) Ten measures of diversity in classifier ensembles: limits for two classifiers. In: Proceedings of IEEE workshop on intelligent sensor processing, Birmingham, vol 10, pp 1–10
Laan MJVD, Polley EC, Hubbard AE (2007) Super Learner. https://doi.org/10.2202/15446115.1309
Lai V, Lum F, Leow WK, Chen Y (2005) Combining classifiers for bone fracture detection in X-ray images. In: IEEE international conference on image processing 2005, Genova, Italy, IEEE. https://doi.org/10.1109/icip.2005.1529959
Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284(2):574–582
Lampert CH, Blaschko MB, Hofmann T (2008) Beyond sliding windows: object localization by efficient subwindow search. In: IEEE conference on computer vision and pattern recognition, 23–28 June 2008, Anchorage, AK, USA. https://doi.org/10.1109/cvpr.2008.4587586
LeCun Y et al (1998) Gradient based learning applied to document recognition. Proc IEEE 86(11):2278–2324. https://doi.org/10.1109/5.72679
Lim SE, Xing Y, Chen Y, Leow WK, Howe TS, Png MA (2004) Detection of femur and radius fractures in X-ray images. In: Second international conference on advances in medical signal and information processing, pp 399–404
Linda H, Jiji GW (2011) Crack detection in X-ray images using fuzzy index measure. Appl Soft Comput 11:3571–3579. https://doi.org/10.1016/j.asoc.2011.01.029
Linda H, Jiji GW (2017) Hairline breakage detection in X-ray images using data fusion. Multimedia Tools and Applications. 77(6):1–16. https://doi.org/10.1007/s11042-017-5286-5
Linda CH, Jiji GW (2018) Hierarchical approach to detect fractures in CT DICOM images, section C: computational intelligence, machine learning and data analytics. Comput J 61(7):1099–1108. https://doi.org/10.1093/comjnl/bxy023
Lindsey R, Daluiski A, Chopra S et al (2018) Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci 115(45):11591–11596. https://doi.org/10.1073/pnas.1806905115
Lowe DG (2004) Distinctive image features from scale-invariant keypoints David. Int J Comput Vision 60(2):91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
Mahendran SK, Baboo SS (2011a) Automatic fracture detection using classifiers: a review. Int J Comput Sci Issues 8(6):340–345
Mahendran SK, Baboo SS (2011b) An enhanced Tibia fracture detection tool using image processing and classification fusion techniques in X-ray images. Global J Comput Sci Technol 11(14):23–28
Mahmoodi S (2011) Anisotropic diffusion for noise removal of band pass signals. Elsevier Signal Process 91(5):1298–1307. https://doi.org/10.1016/j.sigpro.2010.12.018
Mansoory MS, Ashtiyani M, Sarabadani H (2012) Automatic crack detection in eggshell based on SUSAN edge detector using fuzzy thresholding. World Appl Sci J 18(11):1602–1608. https://doi.org/10.5539/mas.v5n6p117
Mayne R (2013) How to identify fracture types. https://allthingsaafs.com/tag/how-to-identify-fracture-types. Accessed 7 Apr 2019
McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med (Zagreb) 22(3):276–282. https://doi.org/10.11613/BM.2012.031
Mendrik M, Vonken EJ, Rutten A, Viergever MA, Ginneken BV (2009) Noise reduction in computed tomography scans using 3D anisotropic hybrid diffusion with continuous switch. IEEE Trans Med Imaging 28(10):1585–1594. https://doi.org/10.1109/TMI.2009.2022368
Meyer P et al (2018) Survey on deep learning for radiotherapy. Comput Biol Med 98:126–146. https://doi.org/10.1016/j.compbiomed.2018.05.018O
Minetto R, Segundo MP, Sarkar S (2018) Hydra: an ensemble of convolutional neural networks for geospatial land classification. Comput Vis Pattern Recognit. arXiv:1802.03518
Müller ME, Koch P, Nazarian S, Schatzker J (1990) The comprehensive classification of fractures of long bones. Springer, Berlin. 73(4):202. https://doi.org/10.1007/978-3-642-61261-9
Myint WW, Tun KS, Tun HM (2018) Analysis on leg bone fracture detection and classification using X-ray. Mach Learn Res 3(3):49–59. https://doi.org/10.11648/j.mlr.20180303.11
Neer CS (1970) Displaced proximal humeral fractures. I. Classification and evaluation. J Bone Joint Surg 52(6):1077–1089
Pisano ED et al (1998) Contrast limited adaptive histogram equalization image processing to improve the detection of simulated spiculations in dense mammograms. J Digit Imag 11(4):193–200. https://doi.org/10.1007/BF03178082
Polikar R (2009) Ensemble learning. Scholarpedia 4(1):2776. https://doi.org/10.4249/scholarpedia.2776
Prabhu (2018) Understanding of convolutional neural network (CNN)—deep learning. https://medium.com/@RaghavPrabhu/understanding-of-convolutional-neural-network-cnn-deep-learning-99760835f148. Accessed 7 Dec 2018
Rajan J, Kaimal MR (2006) Image denoising using wavelet embedded anisotropic diffusion (WEAD). In: IET international conference on visual information engineering, pp 26–28. https://doi.org/10.1049/cp:20060597
Rajpurkar P et al (2017) MURA: large dataset for abnormality detection. In: 1st conference on medical imaging with deep learning, MIDL 2018 (2017). arXiv:1712.06957
Russakovsky O, Deng J et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252. https://doi.org/10.1007/s11263-015-0816-y
Sathik MM, Mehaboobathunnisa R, Thasneem AAH, Arumugam S (2015) Ray casting for 3D rendering—a review. Int J Innov Eng Technol 5:121–124
Schulze MA, Pearce JA (1993) Linear combinations of morphological operators: the midrange, pseudomedian, and loco filters. In: Proceedings of IEEE international conference on acoustics, 27–30 April, Minneapolis, USA, IEEE, pp 1520–6149. https://doi.org/10.1109/icassp.1993.319746
Shah T (2017) About train, validation and test sets in machine learning. https://tarangshah.com/blog/2017-12-03/train-validation-and-test-sets. Accessed 27 Dec 2018
Sharan V, Keshari N, Mondal T (2014) Biomedical image denoising and compression in wavelet using MATLAB. Int J Innov Sci Mod Eng (IJISME) 2(6):9–13
Shen D, Wu G, Suk HI (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19(1):221–248. https://doi.org/10.1146/annurev-bioeng-071516-044442
Sim J, Wright CC (2005) The Kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther 85(3):257–268. https://doi.org/10.1093/ptj/85.3.257
Singh TR, Roy S, Singh OI, Sinam T, Singh KM (2012) A new local adaptive thresholding technique in binarization. Int J Comput Sci 8(6):271–277 arXiv:1201.5227
Stec N, Arje D, Moody A, Krupinski E, Tyrrell P (2018) A systematic review of fatigue in radiology: is it a problem? Am J Roentgenol 210(4):799–806. https://doi.org/10.2214/AJR.17.18613
Stephanie (2016) C-statistic: definition, examples, weighting and significance. https://www.statisticshowto.datasciencecentral.com/c-statistic. Accessed 12 Apr 2019
Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. In: IEEE conference on computer vision and pattern recognition (CVPR), IEEE, pp 2818–2826. https://doi.org/10.1109/cvpr.2016.308
Teixeira L, Celes W, Gattass M (2008) Accelerated corner-detector algorithms. In: Proceedings of the British machine vision conference. http://doi.org/10.5244/C.22.62
Tian D, Ha M (2004) Applications of wavelet transform in medical image processing. In: Proceedings of 2004 international conference on machine learning and cybernetics (IEEE Cat. No.04EX826), pp 26–29. https://doi.org/10.1109/icmlc.2004.1382071
Tian TP et al (2003) Computing neck-shaft angle of femur for X-ray fracture detection. In: Petkov N, Westenberg MA (eds) Computer analysis of images and patterns. CAIP 2003. Lecture Notes in Computer Science, vol 2756. Springer, Berlin
Umadevi N, Geethalakshmi SN (2012) Multiple classification system for fracture detection in human bone X-ray images. In: Third international conference on computing, communication and networking technologies (ICC-CNT’12), 26–28 July 2012, Coimbatore, India, IEEE. https://doi.org/10.1109/icccnt.2012.6395889
Waite S, Scott J, Gale B, Fuchs T, Kolla S, Reede D (2017) Interpretive error in radiology. Am J Roentgenol 208(4):739–749. https://doi.org/10.2214/ajr.16.16963
Wang H et al (2017) Deep learning based ensemble approach for probabilistic wind power forecasting. Appl Energy 188:56–70. https://doi.org/10.1016/j.apenergy.2016.11.111
Whang J, Baker SR, Patel R, Luk L, Castro A (2013) The causes of medical malpractice suits against radiologists in the United States. Radiology 266(2):548–554. https://doi.org/10.1148/radiol.12111119
Wolpert DH (1992) Stacked generalization. Neural Netw 5(2):241–259. https://doi.org/10.1016/S0893-6080(05)80023-1
World Health Organization (2019). https://www.who.int/nutrition/topics/5_population_nutrient/en/index25.html. Accessed 14 Mar 2019
X-rays, CT Scans and MRIs- OrthoInfo-AAOS (2019). https://orthoinfo.aaos.org/en/treatment/x-rays-ct-scans-and-mris. Accessed 14 Jan 2019
Yap DWH et al (2004) Detecting femur fractures by texture analysis of trabeculae. In: Proceedings—international conference on pattern recognition 3, pp 730–733. http://doi.org/10.1109/ICPR.2004.1334632
Zhang Y, Brady M, Smith S (2001) Segmentation of brain MR images through a hidden Markov random field model and the expectation maximization algorithm. IEEE Trans Med Imaging 20:45–57. https://doi.org/10.1109/42.906424
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Joshi, D., Singh, T.P. A survey of fracture detection techniques in bone X-ray images. Artif Intell Rev 53, 4475–4517 (2020). https://doi.org/10.1007/s10462-019-09799-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10462-019-09799-0