Image segmentation based on fuzzy clustering with cellular automata and features weighting
- 90 Downloads
Aiming at the sensitivity of fuzzy C-means (FCM) method to the initial clustering center and noise data, and the single feature being not able to segment the image effectively, this paper proposes a new image segmentation method based on fuzzy clustering with cellular automata (CA) and features weighting. Taking the gray level as the object and combining fully the image feature and the spatial feature weighting and FCM, this paper quickly realizes the fuzzy clustering of the images segmentation by the CA’s self-iteration function and finally discusses the effectiveness and feasibility of the proposed method in long-term sequences satellite remote sensing image segmentation. Our experiments show that the proposed method not only has fast convergence speed, strong anti-noise property, and robustness, but also can effectively segment common images and long-term sequence satellite remote sensing images and has good applicability.
KeywordsCellular automata (CA) Features weighting Fuzzy clustering Image segmentation Satellite remote sensing
Aerosol absorption index
Kernel fuzzy C-means
Peak signal noise ratio
In recent years, as an important technology of pattern recognition and computer vision, image segmentation has been focused by researchers all over the world [1, 2, 3]. The image segmentation types can be divided into four categories from different angles, such as feature space clustering, edge-based, region-based, and model-driven [4, 5]. At present, the feature space clustering method (e.g., K-means clustering method) is the most popular image segmentation method due to the simple principle, easy calculation, and good segmentation effect.
The cellular automata (CA) are a dynamic model in which the object’s time, space, and state are discrete. It has powerful parallel computing ability and high dynamic and space concept and can effectively simulate the spatiotemporal dynamic evolution process of complex system [6, 7]. Since the introduction of CA concept in the late 1940s, it has been widely used in traffic problems, population migration, environmental monitoring, etc. [8, 9, 10, 11]. However, its application in the field of image processing is still less, and the achievements are still inadequate . Feature weighting is completely different from the traditional idea of image classification . In the conventional image classification methods, multiple image features are treated in the same way and have equal importance. However, the actual situation is that not every contribution of image feature is the same to the image classification, that is, feature weighting [14, 15]. Fuzzy C-means (FCM) can realize image segmentation by maximizing the similarity among objects divided into the same cluster and minimizing similarity among the different clusters. It has the characteristics of simple calculation and fast speed and is able to effectively overcome the uncertainty and ambiguity in image processing [16, 17, 18, 19]. What is more, due to the similarity of the gray level among the image regions and the sensitivity of FCM to the sample data, when the images is segmented only by a single FCM method, it is easy to get trapped in a local optimum, the boundary is blurred and it shows the untidy boundaries and the poor visual effect.
Work in this study is focused on the image segmentation algorithm based on fuzzy clustering with CA and features weighting. The rest of the paper is constructed as follows: Section 2 describes the proposed method. Section 3 presents the experiments of our study including resolutions, efficiency, and anti-noise property. Section 4 devotes and explores the satellite remote sensing image segmentation by the proposed method. Finally, conclusions are drawn in Section 5.
2 Proposed method
2.1 Basic theory
(1) CA model
Corresponding to the digital image, each image pixel can be regarded as a cell in CA model, and then the entire image is a cell space. It often contains cell space, cell state, cellular neighbor, and evolutionary rule. Cellular neighbor can be defined as a cell adjacent to a cellular in space, and the region composed of all neighboring cells is called its neighborhood. Evolutionary rule means the rules that determine the cell’s state at the next moment according to the current cell and its neighborhood and further update and evolve by the interaction among cells. Sometimes, it is also called state transfer function and is the key to the whole CA model.
(2) Feature weighting
Color features are less affected by image size, orientation, and viewing angle and have strong robustness and objectivity. At present, it has been widely applied in image processing. And color features are usually represented by a color histogram.
where q is color histogram; I(x, y) is the pixel point of the coordinate(x, y); Bc is the interval number of the color histogram; b is constant, b = 1, 2, …, n; and the similarity measure is Bhattacharyya distance.
(3) FCM method
The objective function J is the sum of squares of the weighted distances from the image pixel points to the respective cluster centers. The smaller the value, the closer the pixel points are to cluster center, and the better the clustering effect is [22, 23, 24, 25, 26].
2.2 Proposed method based on fuzzy clustering with CA and features weighting
(1) Enhancement and extraction of subject area by CA model
Firstly, expand the binary image to a grayscale image. The grayscale value of the image pixel is extended from 0 to 255 (namely L = 256), and correspondingly, the CA model is also extended from the binary state to the multi-value state.
Secondly, define the cell as the gray level of the image to be separated. The basic idea is to keep the pixel values of the boundary region constant, and the pixel value of the image’s uniform region gradually approaches 0 instead of being directly equal to 0.
Thirdly, continuously update the state of the central cell, improving the classification accuracy of the central cell and further enhancing the contrast of image. And the calculation process can be described as the following: when θt(p) ≤ θmax − θmin, the result θt(p) is regarded as the result θt + 1(p), that is, θt + 1(p) = θt(p). Otherwise, θt + 1(p) = θmax − θmin, where θmaxand θmin are the maximum and minimum values of cell morphology in its neighborhood at time t, respectively.
(2) Segmentation based on fuzzy clustering by feature weighting
The membership function in FCM only describes the similarity measure between the intensity feature and the cluster center and does not consider the spatial feature among the pixel points [27, 28, 29]. To overcome the limitation, according to the contribution, the color features and spatial features are assigned separately different weight values in this study, and further fused in terms of the certain rules.
Finally, the segmentation experiment based on fuzzy clustering is performed on the enhanced image. The membership function of fuzzy clustering and cluster center in FCM is continuously updating with the comprehensive weighting features, and finally, the high-precision image segmentation is realized.
In this section, the validity and feasibility of the proposed algorithm is evaluated from the points of different resolutions image, segmentation results and efficiency of the different algorithm, and anti-noise ability. The experimental data tested in the study are selected from the Berkeley image segmentation dataset. Test experiments are performed on PC with Intel (R) Core (TM) email@example.com GHz CPU and 4GB memory in MATLAB R2009a environment.
3.1 Segmentation experiments with different image resolution
Taking the three photographer images with different resolution as the test images, the image segmentation is performed by the proposed fuzzy clustering image segmentation method based on fuzzy clustering with CA and feature weighting and then further recorded the corresponding segmented time. In this test, the specific parameters of the setting environment include that the number of clusters is 3, the fuzzy weighting index is 2, the gray level of the test image is from 0 (the darkest) to 255 (the brightest), and the iteration threshold is 10−5.
Consuming time of different resolution images in Fig. 1
Consuming time (s)
64 × 64
128 × 128
256 × 256
It can be clearly seen from Table 1 that the consuming time taken by the proposed method rapidly decreases with the decreases of the image resolution, and the segmentation speed is also gradually getting faster and the operation effect is better. This is mainly because the proposed method makes full use of image color features and spatial features. The method can enhance the image object’s brightness and greatly accelerate the calculation speed by weighting features and CA’s self-iteration and further significantly improve the image segmentation efficiency.
3.2 Segmentation results and efficiency of different algorithm
As can be seen from Fig. 5, the four methods basically implement the segmentation of Lena image. Whereinto, the proposed method not only effectively eliminates some independent plaque information, but also significantly improves the segmentation image quality and has better robustness. The visual effect of segmentation image is obviously better than by other methods. In addition, the segmentation images by FCM, K-means, and KFCM methods have discontinuous edge points. That is, some independent plaque and points are regarded as edge information was extracted, and to blur the image edges, it cannot detect the complete edge information due to the serious misclassification. In contrast, the image enhancement can be performed by the proposed method with CA and feature weightings, and it can get better segmentation image.
Consuming time comparison of different methods
Number of iterations
Consuming time (s)
As can be seen from Table 2, the average consuming time of FCM, K-means, and KFCM reached 47.85 s, 35.84 s, and 26.98 s respectively. Compared to the above three methods, the average consuming time of the proposed method in this study is relatively small and is only with 19.88 s. This is mainly because the FCM, K-means, and KFCM methods have to run 125, 102, and 74 times iterations to converge respectively and increase the computation time to some extent with the same cluster center number. However, the proposed method can realize convergence based on 52 times of iterations and greatly accelerates the computation speed. Therefore, in the case of the same number of experiments, the proposed method in this paper can significantly reduce the number of iteration times and speed up the image segmentation.
3.3 Anti-noise property analysis
It can be seen from Fig. 6, the coordinate origin is in the upper left corner of the window, the high frequency components are distributed in the middle of window, and the low frequency components are distributed on the four corners of the window. In contrast, in the frequency spectrogram of noisy image, the coordinate origin moves to the central portion of the window, the low frequency component is distributed around the coordinate origin and high frequency component in the peripheral region, and it is also shown in Fig. 6.
It can be clearly seen from Fig. 7 that the traditional FCM and K-means methods were obviously interfered by the noise information. This is because the background information in the images was mixed with noises, which affected the features of the obtained images and led to the obvious misclassifications, and resulted in the poor segmentation effect. In contrast, KFCM method can reduce the influence of the noise by introducing the kernel function and improve the image segmentation effect. In this paper, the proposed method finally realizes the image segmentation based on fuzzy clustering by the CA and image color-spatial feature weighting, eliminates the influence of partial noise on image quality to some extent, and further enhances the anti-noise property and robustness.
Performance evaluation of different methods
CPU consuming time (s)
As can be seen from Table 3:
(1) From the perspective of PSNR, the PSNR value of proposed method reached 22.52, which is followed by the KFCM method, and the FCM and K-means methods have the smallest ones. It indicates that the proposed means has the best anti-noise property and the best image segmentation quality, followed by the KFCM method, while the traditional FCM and K-means methods have the relatively poor anti-noise property.
(2) From the perspective of CPU consuming time, the overall change is consistent with the PSNR’s. The proposed method takes the least time and reached 12.55 s, which is followed by KFCM and reaching 18.4 s, while the FCM and K-means methods are time-consuming and relatively computationally inefficient.
(3) In terms of comprehensive PSNR and CPU consuming time, the proposed method is superior to the other methods. It has not only high anti-noise property and image quality, but also less time-consuming and relatively higher segmentation efficiency, and can quickly realize high-precision image segmentation based on the fuzzy clustering by the CA and image color-spatial feature weighting.
4 Results and discussion in satellite image segmentation
In this section, taking moderate resolution imaging spectroradiometer (MODIS) satellite remote sensing image as the data source, we used the images on 19 April 2010 and 11 May 2010 to segment the volcanic ash cloud information by proposed image segmentation method which is based on fuzzy clustering by the CA and image color-spatial feature weighting.
4.1 Image segmentation results of volcanic ash cloud
It can be clearly seen from Fig. 9 that the Eyjafjallajökull volcanic ash cloud distribution of long-term sequence on 19 April 2010 and 11 May 2010 was accurately identified by the proposed image segmentation method. And what is more, the image quality and the visual effect of the segmented volcanic ash cloud are good; meanwhile, the broken spots are fewer. However, the proposed image segmentation method has certain disadvantage, such as the scope of identified volcanic ash cloud is very narrow; it is also shown in Fig. 9. This is mostly because of the ignored weak information of volcanic ash cloud in the fuzzy clustering with CA and features weighting.
(1) Thematic information extraction of volcanic ash cloud
Accuracy evaluation of MODIS image
Total precision (%)
April 19, 2010
May 11, 2010
Table 4 depicts the accuracy evaluation of MODIS satellite remote sensing images by proposed method in this study, and it clearly shows that the proposed image segmentation method based on fuzzy clustering by the CA and image color-spatial feature weighting has achieved a good identification of Eyjafjallajökull volcanic ash cloud from the long-term sequence satellite remote sensing images. The total accuracy of volcanic ash cloud segmentation on 19 April 2010 and 11 May 2010 reached 87.50% and 89.25% respectively, and the Kappa coefficient reached 0.8014 and 0.8154, respectively. This is also consistent with the above volcanic ash cloud segmentation results (Fig. 9). The volcanic ash cloud from long-term sequence satellite images segmented by the proposed method does not show obvious fragmentation and misclassification, and the segmentation image quality is good. That is, the proposed method in this study basically achieves better segmentation accuracy and visual effects in different development stages of the typical Eyjafjallajökull volcanic ash cloud case.
(2) The existing research results
It can be seen from Fig. 10 that volcanic ash cloud distribution segmented by proposed method from long-term sequence satellite remote sensing images is basically consistent with the existing research results and the relevant information released by the Volcanic Ash Advisory Centre (VAAC). It partially indicates that the proposed image segmentation method based on fuzzy clustering by the CA and image color-spatial feature weighting is effective and feasible in satellite remote sensing image segmentation at various stages of volcanic ash cloud.
This paper has proposed a new image segmentation method based on fuzzy clustering by the CA and image color-spatial feature weighting. Combining image color-spatial feature weighting and the CA’s self-iteration, it speeds up the convergence of image segmentation and further improves the accuracy of initial clustering center and segmentation efficiency. Experiments show that the proposed method not only effectively achieves image segmentation, but also significantly improves the anti-noise property and robustness by CA and image color-spatial feature weighting. Then the image segmentation of long-term sequence satellite remote sensing image has been implemented and discussed by the proposed method and has achieved good identification results of volcanic ash cloud.
Fuzzy clustering can effectively solve the general uncertainty in image segmentation because of the powerful fuzzy description ability and has great advantages in the field of image processing. However, in fact, the image has multiple features. Meanwhile, it may also have different combinations in accordance with the detail application. Meanwhile, the FCM method is sensitive to the initial clustering center and noisy data. Therefore, in the follow-up work, we will try to extract more image features, find out the optimal feature combination, improve the segmentation speed and efficiency, and further apply to the satellite remote sensing image classification.
The authors thank the editor and anonymous reviewers for their helpful comments and valuable suggestions. I would like to acknowledge all our team members, especially Lan Liu. these authors contributed equally to this work.
About the authors
Chengfan Li was born in Nanyang City, Henan Province, China, in 1981. He received the Ph.D. degree in computer science from the Shanghai University, China, in 2012. Now he is currently a senior engineer in the School of Computer Engineering and Science of Shanghai University. His main research interests are in the areas of data mining and satellite remote sensing image processing. He has hosted and participated in several national and provincial research projects, and published several books and articles at present.
LAN LIU was born in Jining City, Shandong Province, China, in 1982. She received the Ph. D degree in computer science from the Shanghai University, China, in 2018. Now she is currently an engineer in the Shanghai University of Engineering Science. Her major is computer application. Her main research interests are in the areas of clustering classification and spatial image processing.
Xiankun Sun was born in Jinan City, Shandong Province, China, in 1972. Now he is an associate professor in College of Electronic and Electrical Engineering in Shanghai University of Engineering Science. He received the M.S. degree in computer science from the East China Normal University, China, in 2001. Now he is the Ph. D student of School of Computer Engineering and Science in Shanghai University, China. Her major is computer application. His main research interests are in the areas of data mining and satellite remote sensing image processing. He has hosted and participated in several national and provincial research projects, and published several articles at present.
Junjuan Zhao received the B.S. and M.S. degrees in solid earth physics from the East China Normal University, China, in 2001 and 2004, and Ph.D. degree in Communication and Information System from the Shanghai University, China, in 2013, respectively. Now she is currently an Engineer in Shanghai University. Her main research interests are in the areas of parallel computing and image processing.
Jingyuan Yin received the B.S. and M.S. degrees in physical geography from the Nankai University, China, in 1982 and 1987, and Ph.D. degrees in physical geography from the Louis Pasteur University of Strasbourg, France. Now he is currently a full professor in Shanghai University and Earthquake Administration of Shanghai Municipality. His main research interests are in the areas of computer application, disaster monitoring and spatial information processing.
This research was supported by the National Natural Science Foundation of China under Grant No. 41404024, Graduate Innovation and Entrepreneurship Program in Shanghai University in China under Grant No. 2019GY04, Science and Technology Development Foundation of Shanghai in China under Grant No. 16dz1206000 and 16142203000.
Availability of data and materials
We can provide the data.
All authors take part in the discussion of the work described in this paper. These authors contributed equally to this work and should be considered co-first authors. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 2.L. Yunlong, B. Lin, Fuzzy clustering image segmentation algorithm with high validity optimized by artificial immune algorithm. Contr Decis. 25(11), 1679–1683 (2010)Google Scholar
- 3.Z. Bin, G. Li, Z. Shengchao, Q. Min, H. Chongyang, Fuzzy clustering image segmentation based on improved genetic algorithm. J. Projectiles Rockets Missiles Guid. 28(4), 190–−192 (2008)Google Scholar
- 6.H. Wang, Z. Wenting, S. He, Y. Deng, An image segmentation method based on cellular automata and fuzzy C-means. Geomat. Inform. Sci. Wuhan Univ. 35(11), 1288–1291 (2010)Google Scholar
- 7.Y. Quan, H. Liao, A software based on cellular automata used to simulate time and space dynamic change in geography. J. Nanjing Univ. (Natural Sciences) 41(3), 857–861 (2005)Google Scholar
- 8.Z. Yihan, L. Xia, L. Xiaoping, Q. Jigang, H. Zhiqian, Urban expansion simulation by coupling remote sensing observations and cellular automata. J. Remote. Sens. 17(4), 872–886 (2015)Google Scholar
- 10.L. Yuan, E. Yao, G. Tan, Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput. Syst. Sci. Eng. 33(2) 105-114 (2018)Google Scholar
- 11.L. Zheyan, Z. Sulan, H. Lihua, Z. Jifu, A method flower image classification based on cellular automata and weighted feature fusion. J. Taiyuan Univ. Sci. Technol 39(3), 203–209 (2018)Google Scholar
- 12.H. Zhiqiang, L. Wang, J. Guo, C. Peng, An object tracking algorithm based on color, space and texture information. Opt. Eng. 45(4), 1–8 (2018)Google Scholar
- 13.X. Yu, L. Bin, C. Wufan, A new algorithm for magnetic resources image segmentation based on fuzzy kernel clustering. J. South Med. Univ. 28(4), 555–557 (2008)Google Scholar
- 14.T. Xiaolin, J. Lichen, G. Shuiping, SAR image segmentation using FCM with weighted spatial function. J. Xidian Univ. 35(5), 846–851 (2008)Google Scholar
- 15.G. Xin, Wang Haitao, Wang Lingfeng, et al. Fusing multiple features for objects tracking based on uncertainty measurement. Acta Autom. Siniaca 37(5), 550–−559 (2011)Google Scholar
- 29.F. Yufang, H. Lu, Y. Hong, Fuzzy C-means clustering image segmentation method based on multi-chain quantum bee colony algorithm. Comput. Eng. Appl. 53(24), 8–14 (2017)Google Scholar
- 31.M. Caihong, H. Lili, L. Yi, L. Ruochen, J. Licheng, Change detection for remote sensing images based on wavelet fusion and PCA-kernel fuzzy clustering. Acta Electron. Sin. 43(7), 1675–1381 (2015)Google Scholar
- 32.M. Luo, L. Dongbo, N. Wang, C. Xinhai, Clothing image segmentation based on improved kernel fuzzy C-means clustering algorithm. J. Hunan Inst. Eng. 28(2), 40–43 (2018)Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.