Skip to main content

Advertisement

SpringerLink
Log in

Automatic tooth instance segmentation and identification from panoramic X-Ray images using deep CNN

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Due to deep learning’s success in many medical applications, it is regarded as a significant technique for use in the area of dentistry, where several panoramic X-ray images are frequently used to assess oral health and identify disorders that damage the teeth and bones (e.g., cavities). In order to give diagnostic information for the management of dental problems and diseases, automatic segmentation is a crucial role in medical image processing and analysis. There are just a few datasets for panoramic radiograph images now accessible, according to the state of the art. For this endeavor we present a real dataset composed of 107 panoramic x-ray image were collected from two dental clinics and annotated. A Convolutional Neural Network (CNN) was trained using the annotated data for identification and instance segmentation. which enables the development of deep learning-based automatic tooth detection systems to segment teeth and assess oral status. Mask-RCNN is a deep CNN model for object detection, object localization, and object instance segmentation of medical images. In this paper, we demonstrate that Mask-RCNN can be used to perform highly effective and efficient automatic segmentation and identification of the tooth from panoramic radiographs images. The performance of the implemented networks is 90% of mean average precision (mAP), 63% of F1-sores and 96% of precision.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

107 panoramic x-ray images from two dental clinics were collected for an actual dataset that was then annotated. http://data.mendeley.com/datasets/73n3kz2k4k, https://doi.org/10.17632/73n3kz2k4k.2

References

  1. Farhan ALAS (2022) The modern x-ray imaging manners for diagnosis of the dental diseases. Eurasian J Phys, Chem Math 7:138–148

    Google Scholar 

  2. Jdey I, Hcini G, Ltifi H (2023) Deep learning and machine learning for malaria detection: overview, challenges and future directions. https://doi.org/10.1142/S0219622023300045

  3. Varshni D, Thakral K, Agarwal L, Nijhawan R, Mittal A (2019) Pneumonia detection using cnn based feature extraction. In: 2019 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp. 1–7

  4. Jeyaraj PR, Samuel Nadar ER (2019) Computer-assisted medical image classification for early diagnosis of oral cancer employing deep learning algorithm. J Cancer Res Clin Oncol 145(4):829–837

    Article  Google Scholar 

  5. Mahdi, F.P., Yagi, N., Kobashi, S. (2020): Automatic teeth recognition in dental xray images using transfer learning based faster r-cnn. In: 2020 IEEE 50th International Symposium on Multiple-Valued Logic (ISMVL), pp. 16–21. IEEE

  6. Muresan MP, Barbura AR, Nedevschi S (2020) Teeth detection and dental problem classification in panoramic x-ray images using deep learning and image processing techniques. In: 2020 IEEE 16th International Conference on Intelligent Computer Communication and Processing (ICCP), pp. 457–463. IEEE

  7. Lakshmi MM, Chitra P (2020) Classification of dental cavities from x-ray images using deep cnn algorithm. In: 2020 4th International Conference on Trends in Electronics and Informatics (ICOEI)(48184), pp. 774–779. IEEE

  8. Sukegawa S, Yoshii K, Hara T, Yamashita K, Nakano K, Yamamoto N, Nagatsuka H, Furuki Y (2020) Deep neural networks for dental implant system classification. Biomolecules 10(7):984

    Article  Google Scholar 

  9. Cha J-Y, Yoon H-I, Yeo I-S, Huh K-H, Han J-S (2021) Panoptic segmentation on panoramic radiographs: Deep learning-based segmentation of various structures including maxillary sinus and mandibular canal. J Clin Med 10(12):2577

    Article  Google Scholar 

  10. Lee J-H, Han S-S, Kim YH, Lee C, Kim I (2020) Application of a fully deep convolutional neural network to the automation of tooth segmentation on panoramic radiographs. Oral Surg, Oral Med, Oral Pathol Oral Radiol 129(6):635–642

    Article  Google Scholar 

  11. Jader G, Fontineli J, Ruiz M, Abdalla K, Pithon M, Oliveira L (2018) Deep instance segmentation of teeth in panoramic x-ray images. In: 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 400–407. IEEE

  12. Walid JI (2023) Panoramic Dental Xray Dataset, Mendeley Data, V2. =http://data.mendeley.com/datasets/73n3kz2k4k. https://doi.org/10.17632/73n3kz2k4k.2

  13. Hcini G, Jdey I, Ltifi H (2022) Improving malaria detection using l1 regularization neural network. JUCS: J Univ Comput Sci 285(10)

  14. Kaur D, Kaur Y (2014) Various image segmentation techniques: a review. Int J Comput Sci Mob Comput 3(5):809–814

    Google Scholar 

  15. Galler KM, Weber M, Korkmaz Y, Widbiller M, Feuerer M (2021) Inflammatory response mechanisms of the dentine-pulp complex and the periapical tissues. Int J Mol Sci 22(3):1480

    Article  Google Scholar 

  16. Singh NK, Raza K (2022) Progress in deep learning-based dental and maxillofacial image analysis: A systematic review. Expert Systems with Applications 116968

  17. Hcini G, Jdey I, Heni A, Ltifi H (2021) Hyperparameter optimization in customized convolutional neural network for blood cells classification. J Theor Appl Inf Technol 99:5425–5435

    Google Scholar 

  18. Sheng C, Wang L, Huang Z, Wang T, Guo Y, Hou W, Xu L, Wang J, Yan X (2022) Transformer-based deep learning network for tooth segmentation on panoramic radiographs. J Syst Sci Complex 1–16

  19. Zhao Y, Li P, Gao C, Liu Y, Chen Q, Yang F, Meng D (2020) Tsasnet: Tooth segmentation on dental panoramic x-ray images by two-stage attention segmentation network. Knowledge-Based Systems 206:106338

    Article  Google Scholar 

  20. Zhu, H., Cao, Z., Lian, L., Ye, G., Gao, H., Wu, J.: Cariesnet: a deep learning approach for segmentation of multi-stage caries lesion from oral panoramic x-ray image. Neural Comput Applic 1–9 (2022)

  21. Wirtz A, Mirashi SG, Wesarg S (2018) Automatic teeth segmentation in panoramic x-ray images using a coupled shape model in combination with a neural network. In: Medical Image Computing and Computer Assisted Intervention-MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, 2018, Proceedings, Part IV 11, pp. 712–719. Springer

  22. Krois J, Garcia Cantu A, Chaurasia A, Patil R, Chaudhari PK, Gaudin R, Gehrung S, Schwendicke F (2021) Generalizability of deep learning models for dental image analysis. Sci Rep 11(1):1–7

    Article  Google Scholar 

  23. Yang Y, Xie R, Jia W, Chen Z, Yang Y, Xie L, Jiang B (2021) Accurate and automatic tooth image segmentation model with deep convolutional neural networks and level set method. Neurocomputing 419:108–125

    Article  Google Scholar 

  24. Zanjani FG, Pourtaherian A, Zinger S, Moin DA, Claessen F, Cherici T, Parinussa S, With PH (2021) Mask-mcnet: tooth instance segmentation in 3d point clouds of intra-oral scans. Neurocomputing 453:286–298

    Article  Google Scholar 

  25. Sultana F, Sufian A, Dutta P (2020) Evolution of image segmentation using deep convolutional neural network: A survey. Knowledge-Based Systems 201:106062

    Article  Google Scholar 

  26. Singla A (2017) Mask-R-CNN-on-Custom-Dataset. https://github.com/AarohiSingla/Mask-R-CNN-on-Custom-Dataset

  27. Dutta A, Zisserman A (2019) The via annotation software for images, audio and video. In: Proceedings of the 27th ACM International Conference on Multimedia, pp. 2276–2279

  28. Russell BC, Torralba A, Murphy KP, Freeman WT (2008) Labelme: a database and web-based tool for image annotation. Int J Comput Vis 77(1):157–173

    Article  Google Scholar 

  29. Lin T (2019) Labelimg: Graphical Image Annotation Tool and Label Object Bounding Boxes in Images. Accessed

  30. Skalski P (2019) Make Sense. https://github.com/SkalskiP/make-sense/

  31. Titarev D, Korostelyov D, Titarev V, Kopeliovich D (2021) Intelligent image labeling system for recognizing traffic violations. Graphicon Conferences on Computer Graphics and Vision 31:994–1004

    Article  Google Scholar 

  32. Aljabri M, AlAmir M, AlGhamdi M, Abdel-Mottaleb M, Collado-Mesa F (2022) Towards a better understanding of annotation tools for medical imaging: a survey. Multimed Tools Applic 1–35

  33. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587

  34. He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In: Computer VisionECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 1114, 2016, Proceedings, Part IV 14, pp. 630–645 Springer

  35. Ioffe S, Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456. pmlr

  36. Hu C-S, Lawson A, Chen J-S, Chung Y-M, Smyth C, Yang S-M (2021) Toporesnet: A hybrid deep learning architecture and its application to skin lesion classification. Mathematics 9(22):2924

    Article  Google Scholar 

  37. Özdemír R, Mehmet K (2019) Yeni bir veri kümesi (ridnet) kullanarak kontrolsüz ortamda yüz ifadesi tanimanin derin öǧrenme yöntemleri ile iyileştirilmesi. Bilecik Şeyh Edebali Üniversitesi Fen Bilimleri Dergisi 6(2):384–396

    Article  Google Scholar 

  38. Shehzadi T, Hashmi KA, Pagani A, Liwicki M, Stricker D, Afzal MZ (2022) Mask-aware semi-supervised object detection in oor plans. Appl Sci 12(19):9398

    Article  Google Scholar 

  39. Zhang X, Wu K, Ma Q, Chen Z (2021) Research on object detection model based on feature network optimization. Processes 9(9):1654

    Article  Google Scholar 

  40. NVIDIA CC (2018) NVIDIA Turing GPU Architecture: Graphics reinvented

  41. Anwar A (2022) What is Average Precision in Object Detection & Localization Algorithms and how to calculate it? =https://towardsdatascience.com/whatis-average-precision-in-object-detection-localization-algorithms-and-how-tocalculate-it-3f330efe697b

  42. Everingham M, Eslami SA, Van Gool L, Williams CK, Winn J, Zisserman A (2015) The pascal visual object classes challenge: A retrospective. Int J Comput Vis 111:98–136

    Article  Google Scholar 

  43. Zhu H, Wei H, Li B, Yuan X, Kehtarnavaz N (2020) A review of video object detection: Datasets, metrics and methods. Appl Sci 10(21):7834

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of sciences and techniques of Sidi Bouzid, University of Kairouan, Kairouan, Tunisia

    Walid Brahmi & Imen Jdey

  2. ReGIM-Lab. REsearch Groups in Intelligent Machines (LR11ES48), National Engineering School of Sfax (ENIS), University of Sfax, Sfax, Tunisia

    Walid Brahmi & Imen Jdey

Authors
  1. Walid Brahmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Imen Jdey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Walid Brahmi.

Ethics declarations

Conflict of Interest

There is no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brahmi, W., Jdey, I. Automatic tooth instance segmentation and identification from panoramic X-Ray images using deep CNN. Multimed Tools Appl 83, 55565–55585 (2024). https://doi.org/10.1007/s11042-023-17568-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17568-z

Keywords

Search

Navigation