Abstract
Ultrasound image segmentation plays an important role in computer-aided diagnosis of breast cancer. Existing approaches focused on extracting the tumor tissue to characterize the tumor class. However, other tissues are also helpful for providing the references. In this paper, a multi-target semantic segmentation approach is proposed based on the fully convolutional network for segmenting the breast ultrasound image into different target tissue regions. For handling the uncertain affiliation of pixels in blurry boundaries, the certain outputs of pixel characteristics in AlexNet are transformed into the fuzzy decision expression. For improving the image detail representation, the AlexNet network structure of fully convolutional network is optimized with fully connected skip structure. In addition, the output of net model is optimized with fully connected conditional random field to improve the characterization of spatial consistency and pixels’ correlation of the image. Moreover, a data training optimization method is developed for improving the efficiency of network training. In the experiment, 325 ultrasound images and four error metrics are utilized for validating the segmentation performance. Comparing with existing methods, experimental results show that the proposed approach is effective for handling the breast ultrasound images accurately and reliably.
Similar content being viewed by others
References
Cheng HD, Shan J, Ju W, Guo YH, Zhang L (2010) Automated breast cancer detection and classification using ultrasound images: a survey [J]. Pattern Recogn 43(1):299–317
Liu Y, Cheng HD, Huang JH, Zhang YT, Tang XL (2012) An effective approach of lesion segmentation within the breast ultrasound image based on cellular automata. J Digit Imaging 25(5):580–590
Cheng HD, Shi XJ, Min R, Hu LM, Cai XR, Du HN (2006) Approaches for automated detection and classification of masses in mammograms. Pattern Recogn 39:646–668
Liu Y, Cheng HD, Huang JH, Zhang YT, Tang XL, Tian JW, Wang H (2012) Computer-aided diagnosis system for breast cancer using B-mode and color Doppler flow images. Opt Eng 51(4):1–9
Liu B, Cheng HD, Huang JH, Tian JW, Tang XL, Liu JF (2010) Fully automatic and segmentation-robust classification of breast tumors based on local texture analysis of ultrasound images. Pattern Recogn 43:280–298
Zhang Y, Cheng HD, Tian J, Huang J, Tang X (2010) Fractional subpixel diffusion and fuzzy logic approach for ultrasound speckle reduction. Pattern Recogn 43(8):2962–2970
Zhang Y, Cheng HD, Chen Y, Huang J (2010) A novel noise removal method based on fractional anisotropic diffusion and subpixel approach. New Math Nat Comput 07(1):173–185
Liu Y, Cheng HD, Huang JH, Zhang YT, Tang XL, Tian JW, Wang Y (2012) Computer aided diagnosis system for breast cancer based on color doppler flow imaging. J Med Syst 36(6):3975–3982
Liu Y, Cheng HD, Huang JH, Zhang YT, Tang XL, Tian YW (2013) An effective non-rigid registration approach for ultrasound image based on demons algorithm. J Digit Imaging 26(3):521–529
Liu B, Cheng HD, Huang JH, Tian JW, Tang XL, Liu JF (2010) Probability density difference-based active contour for ultrasound image segmentation. Pattern Recogn 43:2028–2042
Xian M, Huang J, Zhang Y, Tang X (2012) Multiple-domain knowledge based MRF model for tumor segmentation in breast ultrasound images. IEEE ICIP:2021–2024
Xian M, Zhang Y, Cheng HD (2015) Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains. Pattern Recogn 48:485–497
Chen CM, Lu HH, Lin YC (2000) An early vision-based snake model for ultrasound image segmentation. Ultrasound Med Biol 26(2):273–285
Hua QH, Luo YZ, Zhang QZ (2017) Breast ultrasound image segmentation: a survey. Int J Comput Assist Radiol Surg 12(3):493–507
Noble JA (2010) Ultrasound image segmentation and tissue characterization. Proc Inst Mech Eng H J Eng Med 224(2):307–316
Moschidis E, Graham J (2010) A systematic performance evaluation of interactive image segmentation methods based on simulated user interaction. 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, pp 928–931
Bakas S, Chatzimichail K, Hoppe A, Galariotis V, Hunter G, Makris D (2012) Histogram-based motion segmentation and characterisation of focal liver lesions in CEUS. Annals of the BMVA 2012(7):1–4
Bakas S, Chatzimichail K, Hunter G, Labbé B, Sidhu PS, Makris D (2017) Fast semi-automatic segmentation of focal liver lesions in contrast-enhanced ultrasound, based on a probabilistic model. Comput Methods Biomech Biomed Eng Imaging Vis 5(5):329–338
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. NIPS, pp:1097–1105
Robinson AE, Hammon PS (2007) Explaining brightness illusions using spatial filtering and local response normalization. Vis Res 47(12):1631–1644
Shao H, Zhang Y, Xian M, Cheng HD, Xu F, Ding J (2015) A saliency model for automated tumor detection in breast ultrasound images. IEEE ICIP, pp 1424–1428
Shalev S, Singer YP (2011) Primal estimated sub-gradient solver for SVM. Math Program 127(1):3–30
Madabhushi A, Metaxas DN (2003) Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions. IEEE Trans Med Imaging 22(2):155–169
Shan J, Cheng HD, Wang YX (2012) Completely automated segmentation approach for breast ultrasound images using multiple-domain features. Ultrasound Med Biol 38:262–275
Liu B, Cheng HD, Huang JH, Tian JW, Liu JF, Tang XL (2009) Automated segmentation of ultrasonic breast lesions using statistical texture classification and active contour based on probability distance. Ultrasound Med Biol 35(8):1309–1324
Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Conference on Computer Vision and Pattern Recognition, IEEE Computer Society, pp 3431–3440
Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. International Conference on Neural Information Processing Systems. Curran Associates Inc, pp 1097–1105
Stavros AT, Thickman D, Rapp CL, Dennis MA, Parker SH, Sisney GA (1995) Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology. 196(1):123–134
Li J, Zhang Y, Tang X (2017) Automatic tumor segmentation via saliency detection in breast ultrasound images. ICPCSEE
Kaiming H, Georgia G, Piotr D, Ross G (2017) Mask R-CNN. Comput Vis Pattern Recognit:1–12
Funding
This work was supported by the program for Innovation Research of Harbin City (Grant No. 2017RALXJ006), Key Project of National Natural Science Foundation (Grant No. 81630048), and Open Project from the Key Laboratory of Intelligent Perception and Advanced Control of State Ethnic Affairs Commission (MD-IPAC-2019101).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Highlights
For overcoming the deficiency of sample set, this paper chooses the AlexNet network structure as the basic network structure of the full convolution network and proposes to enhance the image and enlarge the size of dataset by using the wavelet transform and expanding the dataset by rotating and turning operation. In addition, this paper utilizes the idea of jumping structure in the convolution network to improve the original AlexNet structure, which is beneficial for representing the image details more accurately. Furthermore, the fully connected conditional random field is utilized to optimize convolutional network, which is beneficial for considering the spatial consistency and the relationship of pixels.
Rights and permissions
About this article
Cite this article
Zhang, Y., Liu, Y., Cheng, H. et al. Fully multi-target segmentation for breast ultrasound image based on fully convolutional network. Med Biol Eng Comput 58, 2049–2061 (2020). https://doi.org/10.1007/s11517-020-02200-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11517-020-02200-1