Automated 3D Ultrasound Biometry Planes Extraction for First Trimester Fetal Assessment

  • Hosuk RyouEmail author
  • Mohammad Yaqub
  • Angelo Cavallaro
  • Fenella Roseman
  • Aris Papageorghiou
  • J. Alison Noble
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10019)


In this paper, we present a fully automated machine-learning based solution to localize the fetus and extract the best fetal biometry planes for the head and abdomen from 11–13+6days week 3D fetal ultrasound (US) images. Our method to localize the whole fetus in the sagittal plane utilizes Structured Random Forests (SRFs) and classical Random Forests (RFs). A transfer learning Convolutional Neural Network (CNNs) is then applied to axial images to localize one of three classes (head, body and non-fetal). Finally, the best fetal head and abdomen planes are automatically extracted based on clinical knowledge of the position of the fetal biometry planes within the head and body. Our hybrid method achieves promising localization of the best biometry fetal planes with 1.6 mm and 3.4 mm for head and abdomen plane localization respectively compared to the best manually chosen biometry planes.


3D ultrasound First-trimester scan Random Forests Convolutional Neural Networks Fetal plane localization 

Supplementary material

432536_1_En_24_MOESM1_ESM.avi (6 mb)
Supplementary material 1 (AVI 6143 kb)


  1. 1.
    Salomon, L., et al.: ISUOG practice guidelines: performance of first-trimester fetal ultrasound scan. Ultrasound Obstet. Gynecol. 41(1), 102–113 (2013)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Abu-Rustum, R.S., Daou, L., Abu-Rustum, S.E.: Role of first-trimester sonography in the diagnosis of aneuploidy and structural fetal anomalies. J. Ultrasound Med. 29(10), 1445–1452 (2010)Google Scholar
  3. 3.
    Bartlett, L.A., et al.: Risk factors for legal induced abortion–related mortality in the United States. Obstet. Gynecol. 103(4), 729–737 (2004)CrossRefGoogle Scholar
  4. 4.
    Dyson, R., et al.: Three-dimensional ultrasound in the evaluation of fetal anomalies. Ultrasound Obstet. Gynecol. 16(4), 321–328 (2000)CrossRefGoogle Scholar
  5. 5.
    Chen, H., et al.: Standard plane localization in fetal ultrasound via domain transferred deep neural networks. IEEE J. Biomed. Health Inform. 19(5), 1627–1636 (2015)CrossRefGoogle Scholar
  6. 6.
    Maraci, M.A., Napolitano, R., Papageorghiou, A., Noble, J.: Searching for structures of interest in an ultrasound video sequence. In: Wu, G., Zhang, D., Zhou, L. (eds.) MLMI 2014. LNCS, vol. 8679, pp. 133–140. Springer, Heidelberg (2014)Google Scholar
  7. 7.
    Rahmatullah, B., Papageorghiou, A.T., Noble, J.: Integration of local and global features for anatomical object detection in ultrasound. In: Ayache, N., Delingette, H., Golland, P., Mori, K. (eds.) MICCAI 2012, Part III. LNCS, vol. 7512, pp. 402–409. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  8. 8.
    Chen, H., Dou, Q., Ni, D., Cheng, J.-Z., Qin, J., Li, S., Heng, P.-A.: Automatic fetal ultrasound standard plane detection using knowledge transferred recurrent neural networks. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015, Part I. LNCS, vol. 9349, pp. 507–514. Springer, Heidelberg (2015). doi: 10.1007/978-3-319-24553-9_62 Google Scholar
  9. 9.
    Zitnick, C.L., Dollár, P.: Edge boxes: locating object proposals from edges. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014, Part V. LNCS, vol. 8693, pp. 391–405. Springer, Heidelberg (2014)Google Scholar
  10. 10.
    Dollár, P., Zitnick, C.: Structured forests for fast edge detection. In: Proceedings of the IEEE International Conference on Computer Vision (2013)Google Scholar
  11. 11.
    Yaqub, M., et al.: Investigation of the role of feature selection and weighted voting in random forests for 3-D volumetric segmentation. IEEE Trans. Med. Imaging 33(2), 258–271 (2014)CrossRefGoogle Scholar
  12. 12.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems (2012)Google Scholar
  13. 13.
    Gao, Y., Maraci, M.A., Noble, J.A.: Describing ultrasound video content using deep convolutional neural networks. In: 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI) (2016)Google Scholar
  14. 14.
    Papageorghiou, A.T., et al.: International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project. Lancet 384(9946), 869–879 (2014)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Hosuk Ryou
    • 1
    Email author
  • Mohammad Yaqub
    • 1
  • Angelo Cavallaro
    • 2
  • Fenella Roseman
    • 2
  • Aris Papageorghiou
    • 2
  • J. Alison Noble
    • 1
  1. 1.Institute of Biomedical Engineering, Department of Engineering ScienceUniversity of OxfordOxfordUK
  2. 2.Nuffield Department of Obstetrics and GynaecologyUniversity of OxfordOxfordUK

Personalised recommendations