Skip to main content
Log in

Comparative Study and Development of Two Contour-Based Image Segmentation Techniques for Coronal Hole Detection in Solar Images

  • Published:
Solar Physics Aims and scope Submit manuscript

Abstract

The study of solar coronal holes (CHs) is important in the understanding of solar physics and the prediction of space weather events, which have significant impact on space-based instruments, communication and navigation systems. With the availability of the multi-wavelength Atmospheric Imaging Assembly (AIA) instrument on board Solar Dynamics Observatory (SDO) satellite, a large volume of high-resolution solar images are produced continuously. Proper detection of CHs from AIA images is an important issue and recently, a few contour and machine learning-based techniques are found to be promising for such purpose. However, accuracy, time complexity and the requirement of human intervention are some of the critical issues with such methods. In this paper, to address these challenging issues, two contour-based approaches are developed, namely i) the Hough transformed simulated parameterized online region-based active contour method (POR-ACM) and ii) fast fuzzy c-means clustering followed by Hough transformed simulated static contour method (FFCM-SCM). The major issues that are addressed here are automated initialization of contour, reducing time complexity and avoidance of non-coronal hole inside a coronal hole region during contour evolution. The proposed techniques have been tested on three benchmark solar disk images and compared with the existing active contour without edge- (ACWE) based method and fuzzy energy-based dual contour method (FEDCM) of CHs segmentation. The results indicate the capability of the proposed techniques in detection and extraction of CHs in solar disk image with higher accuracy and reduced time complexity.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Algorithm 1
Algorithm 2
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9

Similar content being viewed by others

Notes

  1. The data has been collected from http://jsoc.stanford.edu/How_toget_data.html.

  2. Details about the outcome obtained after applying the circular Hough transform are discussed in the Appendix.

  3. Synoptic map has been collected from https://www.swpc.noaa.gov/products/solar-synoptic-map.

  4. Corresponding code for POR-ACM and FFCM-SCM are available on github https://github.com/sanmoy1985/CoronalHolesContour.

  5. Code of FEDCM is available in https://github.com/sanmoy1985/CoronalHolesFuzzyContour.

  6. Original text available in https://www.uclan.ac.uk/sdo/assets/sdo_primer_V1.2.pdf.

  7. Details about SDO/AIA 193 Å visualization can be found in https://www.nasa.gov/content/goddard/sdo-aia-193-angstrom/.

  8. Code for SDO/AIA image pre-processing is available in https://github.com/sanmoy1985/CoronalHolesContour/blob/master/Fits2Image.m.

  9. Data on Carrington rotation can be found in http://umtof.umd.edu/pm/crn/.

  10. SDO/HMI data has been collected from http://jsoc.stanford.edu/data/hmi/fits/.

References

  • Bandyopadhyay, S., Das, S., Datta, A.: 2020, Fuzzy energy-based dual contours model for automated coronal hole detection in sdo/aia solar disk images. Adv. Space Res. 65, 2435. DOI. http://www.sciencedirect.com/science/article/pii/S0273117720301046.

    Article  ADS  Google Scholar 

  • Barra, V., Delouille, V., Kretzschmar, M., Hochedez, J.-F.: 2009, Fast and robust segmentation of solar euv images: Algorithm and results for solar cycle 23. Astron. Astrophys. 505, 361.

    Article  ADS  Google Scholar 

  • Bezdek, J.C., Ehrlich, R., Full, W.: 1984, Fcm: The fuzzy c-means clustering algorithm. Comput. Geosci. 10, 191. DOI. http://www.sciencedirect.com/science/article/pii/0098300484900207.

    Article  ADS  Google Scholar 

  • Boucheron, L.E., Valluri, M., McAteer, R.T.J.: 2016, Segmentation of coronal holes using active contours without edges. Solar Phys. 291, 2353. DOI.

    Article  ADS  Google Scholar 

  • Bresenham, J.E.: 1965, Algorithm for computer control of a digital plotter. IBM Syst. J. 4, 25.

    Article  Google Scholar 

  • Caplan, R.M., Downs, C., Linker, J.A.: 2016, Synchronic coronal hole mapping using multi-instrument euv images: Data preparation and detection method. Astrophys. J. 823, 53. DOI.

    Article  ADS  Google Scholar 

  • Caselles, V., Kimmel, R., Sapiro, G.: 1997, Geodesic active contours. Int. J. Comput. Vis. 22, 61. DOI.

    Article  MATH  Google Scholar 

  • Chan, T.F., Vese, L.A.: 2001, Active contours without edges. IEEE Trans. Image Process. 10, 266. DOI.

    Article  ADS  MATH  Google Scholar 

  • Ciecholewski, M.: 2015, Automated coronal hole segmentation from solar euv images using the watershed transform. J. Vis. Commun. Image Represent. 33, 203. DOI. http://www.sciencedirect.com/science/article/pii/S1047320315001856.

    Article  Google Scholar 

  • Darolti, C., Mertins, A., Bodensteiner, C., Hofmann, U.G.: 2008, Local region descriptors for active contours evolution. IEEE Trans. Image Process. 17, 2275. DOI.

    Article  ADS  MathSciNet  MATH  Google Scholar 

  • Delouille, V., Hofmeister, S.J., Reiss, M.A., Mampaey, B., Temmer, M., Veronig, A.: 2018, Coronal holes detection using supervised classification. In: Machine Learning Techniques for Space Weather 365, 978. ISBN 978-0-12-811788-0. DOI. http://www.sciencedirect.com/science/article/pii/B9780128117880000159.

    Chapter  Google Scholar 

  • Duda, R.O., Hart, P.E.: 1972, Use of the Hough transformation to detect lines and curves in pictures. Commun. ACM 15, 11. DOI.

    Article  MATH  Google Scholar 

  • Gombosi, T.I.: 1998, Physics of the Space Environment, Cambridge Atmospheric and Space Science Series. Cambridge University Press, Cambridge. DOI.

    Book  Google Scholar 

  • Harvey, K.L., Recely, F.: 2002, Polar coronal holes during cycles 22 and 23. Solar Phys. 211, 31. DOI.

    Article  ADS  Google Scholar 

  • Hough, P.V.: 1962, Method and means for recognizing complex patterns. Google Patents. US Patent 3,069,654.

  • Huang, C., Zeng, L.: 2015, An active contour model for the segmentation of images with intensity inhomogeneities and bias field estimation. PLoS ONE 10, e0120399.

    Article  Google Scholar 

  • Illarionov, E.A., Tlatov, A.G.: 2018, Segmentation of coronal holes in solar disc images with a convolutional neural network. Mon. Not. Roy. Astron. Soc. 481, 5014. DOI.

    Article  ADS  Google Scholar 

  • Kirk, M.S., Pesnell, W.D., Young, C.A., Webber, S.H.: 2009, Automated detection of euv polar coronal holes during solar cycle 23. Solar Phys. 257, 99.

    Article  ADS  Google Scholar 

  • Krinidis, S., Chatzis, V.: 2009, Fuzzy energy-based active contours. IEEE Trans. Image Process. 18, 2747. DOI.

    Article  ADS  MathSciNet  MATH  Google Scholar 

  • Krista, L.D., Gallagher, P.T.: 2009, Automated coronal hole detection using local intensity thresholding techniques. Solar Phys. 256, 87. DOI.

    Article  ADS  Google Scholar 

  • Lowder, C., Qiu, J., Leamon, R., Liu, Y.: 2014, Measurements of euv coronal holes and open magnetic flux. Astrophys. J. 783, 142.

    Article  ADS  Google Scholar 

  • Minot, A.D., Lee, J., Sun, X.: 2018, Analysis of coronal holes in the descending phase of cycles 23 and 24 using EUV and magnetic field data. In: AGU Fall Meeting Abstracts 2018, SH43F. ADS.

    Google Scholar 

  • Munro, R.H., Withbroe, G.L.: 1972, Properties of a coronal “hole” derived from extreme-ultraviolet observations. Astrophys. J. 176, 511.

    Article  ADS  Google Scholar 

  • Nieniewski, M.: 2004, Extraction of diffuse objects from images by means of watershed and region merging: Example of solar images. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 34, 796. DOI.

    Article  Google Scholar 

  • Reiss, M.A., Hofmeister, S.J., De Visscher, R., Temmer, M., Veronig, A.M., Delouille, V., Mampaey, B., Ahammer, H.: 2015, Improvements on coronal hole detection in sdo/aia images using supervised classification. J. Space Weather Space Clim. 5, A23. DOI.

    Article  Google Scholar 

  • Reiss, M., Temmer, M., Rotter, T., Hofmeister, S., Veronig, A.: 2014, Identification of coronal holes and filament channels in sdo/aia 193Å images via geometrical classification methods. Cent. Eur. Astrophys. Bull. 38, 95.

    ADS  Google Scholar 

  • Rotter, T., Veronig, A.M., Temmer, M., Vršnak, B.: 2012, Relation between coronal hole areas on the sun and the solar wind parameters at 1 au. Solar Phys. 281, 793. DOI.

    Article  ADS  Google Scholar 

  • Semechko, A.: 2019, Fast fuzzy c-means image segmentation. GitHub.

  • Talu, M.F.: 2013, Oracm: Online region-based active contour model. Expert Syst. Appl. 40, 6233. DOI. http://www.sciencedirect.com/science/article/pii/S0957417413003540.

    Article  Google Scholar 

  • Verbeeck, C., Delouille, V., Mampaey, B., De Visscher, R.: 2014, The spoca-suite: Software for extraction, characterization, and tracking of active regions and coronal holes on euv images. Astron. Astrophys. 561, A29.

    Article  ADS  Google Scholar 

  • Wang, Y.-M., Sheeley, J.N.R.: 1993, Understanding the rotation of coronal holes. Astrophys. J. 414, 916. DOI. ADS.

    Article  ADS  Google Scholar 

  • Wang, L., Chang, Y., Wang, H., Wu, Z., Pu, J., Yang, X.: 2017, An active contour model based on local fitted images for image segmentation. Inf. Sci. 418–419, 61. DOI. http://www.sciencedirect.com/science/article/pii/S0020025516308556.

    Article  Google Scholar 

  • Xie, X., Mirmehdi, M.: 2010, Initialisation-free active contour segmentation. In: 2010 20th International Conference on Pattern Recognition, 2318. DOI.

    Chapter  Google Scholar 

  • Xingfei, G., Jie, T.: 2002, An automatic active contour model for multiple objects. In: Object Recognition Supported by User Interaction for Service Robots 2, 881.

    Chapter  Google Scholar 

  • Yuen, H., Princen, J., Illingworth, J., Kittler, J.: 1990, Comparative study of hough transform methods for circle finding. Image Vis. Comput. 8, 71.

    Article  Google Scholar 

  • Zhang, K., Zhang, L., Song, H., Zhou, W.: 2010, Active contours with selective local or global segmentation: A new formulation and level set method. Image Vis. Comput. 28, 668. DOI. http://www.sciencedirect.com/science/article/pii/S0262885609002303.

    Article  Google Scholar 

Download references

Acknowledgements

The financial support received under the DST INSPIRE Faculty grant is thankfully acknowledged. We would also like to thank Dr. Laura Boucheron, Associate Professor, Klipsch School of Electrical and Computer Engineering, New Mexico State University, for her continuous support in this work. The authors thankfully acknowledge the use of data courtesy of NASA/SDO and the AIA and HMI science teams. The authors also thankfully acknowledge NOAA\(\backslash \)SWPC. AD would like to acknowledge the support of EMR-II under CSIR No. 03(1461)/19.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sanmoy Bandyopadhyay.

Ethics declarations

Disclosure of Potential Conflicts of Interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix: Contour Initialization and Limb Correction

Appendix: Contour Initialization and Limb Correction

The elimination of solar limbs in the process of CHs region detection is also a vital problem. The presence of solar limbs leads to the misclassification of the CHs region. The stated issue has been handled by introducing the circular Hough transform and the corresponding outcome is shown in Figures 11 and 12.

1.1 A.1 Contour Initialization in POR-ACM

An experiment has also been conducted for different contour initialization and using different ACM under various conditions. Among ACM, here mainly POR-ACM has been considered for its fastness in segmenting the image. After initializing the contour near the object boundary of the solar image, as shown in Figure 10b, then implementing POR-ACM without eliminating off-disk pixels for segmenting out CHs, it has been found that the method fails for the purpose. The method plotted the contour on the boundary of the CHs region and on the boundary of solar disk along with the portion of the solar limb. As such, regions outside the bigger contour having low-intensity value also have been selected as the CHs regions (as shown in Figure 10c). But as a piece of prior information, it is to be considered as a non-CH region. Also, in the upper portion of the solar disk in the image located in the first row of Figure 10c it can be seen that the low-intensity region has been considered as the background. This is due to the fact that when POR-ACM forces the contour to move towards the boundary of the RoI, it considers the intensity homogeneity information for evolving the contour, and in this case, the intensities of CHs region and solar image background are homogeneous. The same output can be found for the contour initialized within the solar disk and inside the RoI, as shown in Figures 10d–10g.

Figure 10
figure 12

Different contour initialization and corresponding outputs obtained using POR-ACM without eliminating off-disk region have been shown, where original images are given in (a), contour initialization near image boundary shown in (b), and corresponding outputs have been shown in (c), contour initialization inside the solar disk has been displayed in (d) and corresponding outputs are given in (e), (f) show the contour set-up within the RoI and related outcomes are displayed in (g).

Now, after initializing the circular contour using the Hough transform (shown in Figure 11a), then applying POR-ACM without eliminating solar-limb and image background will generate the same results as shown in Figure 10c. This is due to the presence of the off-disk region (solar-limb and solar image background). Now, eliminating the off-disk region after initializing contour, as highlighted in Figure 11d, then again applying POR-ACM has failed to reach the boundary of the CHs. The corresponding results can be seen in Figure 11e. This is due to the property of ACM, which finds the minima in a local manner and as such the contour gets stuck on the edge of the solar disk. The force at the solar disk edge is high due to the huge change in intensity value at the edge of solar disk. This force is preventing the contour to move further towards the CHs regions present inside the solar disk. However, after the application of the proposed POR-ACM, it can be found that the contour is able to reach the boundary of the CHs region as highlighted in Figures 2d and 11f. This is because the parameters in the introduced POR-ACM provide an extra force that overcomes the force extort by the change of intensity values at the edge of solar disk.

Figure 11
figure 13

Various stages of POR-ACM-based CHs segmentation and contour initialization, where (a) original image, (b) initial contour, (c) results without eliminating off-disk region (d) elimination of off-disk region (e) output using OR-ACM after elimination and (f) final output using POR-ACM after elimination have been shown.

1.2 A.2 Contour Initialization in FFCM-SCM

From the second column of Figure 12, it can be seen easily that without the application of the solar-limb correction technique lead to the misclassification of the CHs region. The non-coronal holes regions present outside the solar disk region are also considered as CHs. Meanwhile, in the fourth column of the same figure it can be noticed easily that after the application of SCM employing a circular Hough transform based on the original image (as shown in Figure 12c) one has eliminated the problem of misclassification due to the presence of the off-disk region and has detected only the CHs region. This can also be established by the final outcome of the proposed technique shown in the last column of Figure 12. Basically, after the application of SCM the off-disk region is transformed into background or non-CHs region as given in Figure 12d. Thus, during this stage, the total image is left with only CHs regions (foreground) and non-CHs regions (background). As a consequence, the boundary of the CHs regions gets detected in the image. The final result can be seen in Figures 2e and 12e.

Figure 12
figure 14

Various stages of FFCM-SCM-based CHs segmentation, where (a) original image, (b) output using FFCM, (c) static contour generation on FFCM results (d) Limb elimination and (e) final output have been shown.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bandyopadhyay, S., Das, S. & Datta, A. Comparative Study and Development of Two Contour-Based Image Segmentation Techniques for Coronal Hole Detection in Solar Images. Sol Phys 295, 110 (2020). https://doi.org/10.1007/s11207-020-01674-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11207-020-01674-4

Keywords

Navigation