Skip to main content
SpringerLink
Log in

Real-time automatic multilevel color video thresholding using a novel class-variance criterion

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Color image segmentation is a crucial preliminary task in robotic vision systems. This paper presents a novel automatic multilevel color thresholding algorithm to address this task efficiently. The proposed algorithm consists of a learning process and a multi-threshold searching process. The learning process learns the color distribution of an input video sequence in HSV color space, and the multi-threshold searching process automatically determines the optimal multiple thresholds to segment all colors-of-interest in the video based on a novel class-variance criterion. For the learning process, a simple and efficient color-distribution learning algorithm operating with a color-pixel extraction method is proposed to learn a color distribution model of all colors-of-interest in the video images, which simplifies the search for optimal thresholds for the colors-of-interest through a conventional multilevel thresholding method. For the multi-threshold searching process, a nonparametric multilevel color thresholding algorithm with an extended within-class variance criterion is proposed to automatically find the optimal upper bound and lower bound threshold values of each color channel. Experimental results validate the performance and computational efficiency of the proposed method by comparing with three existing methods, both visually and quantitatively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Yang, A.Y., Wright, J., Ma, Y., Sastry, S.S.: Unsupervised segmentation of natural images via lossy data compression. Comput. Vis. Image Underst. 110(2), 212–225 (2008)

    Article  Google Scholar 

  2. Cheng, H.D., Jiang, X.H., Sun, Y., Wang, J.: Color image segmentation: advances and prospects. Pattern Recognit. 34(12), 2259–2281 (2001)

    Article  MATH  Google Scholar 

  3. Kin, W.S., Park, R.H.: Color image palette construction based on the HSI color system for minimizing the reconstruction error. In: IEEE International Conference on Image Processing, Lausanne, Switzerland, pp. 1041–1044 (1996)

  4. Abutaleb, A.S.: Automatic thresholding of gray-level pictures using two-dimensional entropy. Comput. Vis. Graph. Image Process. 47(1), 22–32 (1989)

    Article  Google Scholar 

  5. Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)

    Article  MathSciNet  Google Scholar 

  6. Liao, P.-S., Chen, T.-S., Chung, P.-C.: A fast algorithm for multilevel thresholding. J. Inf. Sci. Eng. 17(5), 713–727 (2001)

    Google Scholar 

  7. Huang, D.-Y., Wang, C.-H.: Optimal multi-level thresholding using a two-stage Otsu optimization approach. Pattern Recognit. Lett. 30(3), 275–284 (2009)

    Article  MATH  Google Scholar 

  8. Gao, H., Xu, W., Sun, J., Tang, Y.: Multilevel thresholding for image segmentation through an improved quantum-behaved particle swarm algorithm. IEEE Trans. Instrum. Meas. 59(4), 934–945 (2010)

    Article  Google Scholar 

  9. Cheng, H.D., Sun, Y.: A hierarchical approach to color image segmentation using homogeneity. IEEE Trans. Image Process. 9(12), 2071–2082 (2000)

    Article  Google Scholar 

  10. Cheng, H.D., Jiang, X.H., Wang, J.: Color image segmentation based on homogram thresholding and region merging. Pattern Recognit. 35(2), 373–393 (2002)

    Article  MATH  Google Scholar 

  11. Wu, Y., Liu, Q., Huang, T.S.: An adaptive self-organizing color segmentation algorithm with application to robust real-time human hand localization. In: Proceedings of the Asian Conference on Computer Vision, Taiwan, pp. 1106–1111 (2000)

  12. Haghighatdoost, V., Safabakhsh, R.: Automatic multilevel color image thresholding by the growing time adaptive self organizing map. In: 2nd IEEE International Conference on Information and Communication Technologies, Damascus, Syria, pp. 1768–1772 (2006)

  13. Chaabane, S.B., Sayadi, M., Fnaiech, F., Brassart, E.: Color image segmentation using automatic thresholding and the fuzzy C-means techniques. In: 14th IEEE Mediterranean Electrotechnical Conference, Ajaccio, France, pp. 857–861 (2008)

  14. Yu, Z., Au, O.C., Zou, R., Yu, W., Tian, J.: An adaptive unsupervised approach toward pixel clustering and color image segmentation. Pattern Recognit. 43(5), 1889–1906 (2010)

    Article  MATH  Google Scholar 

  15. Harrabi, R., Braiek, E.B.: Color image segmentation using multi-level thresholding approach and data fusion techniques: application in the breast cancer cells images. EURASIP J. Image Video Process. 2012(11), 1–11 (2012)

    Google Scholar 

  16. Ben Chaabane, S., Fnaiech, F., Sayadi, M., Brassart, E.: Estimation of the mass function in the Dempster–Shafer’s evidence theory using automatic thresholding for color image segmentation. In: 2nd International Conference on Signals, Circuits and Systems, Nabeul, Tunisia, pp. 1–5 (2008)

  17. Du, Y., Chang, C.-I., Thouin, P.D.: Unsupervised approach to color video thresholding. Opt. Eng. 43(2), 282–289 (2004)

    Article  Google Scholar 

  18. Rotaru, C., Graf, T., Zhang, J.: Color image segmentation in HSI space for automotive applications. J. Real Time Image Process. 3(4), 311–322 (2008)

    Article  Google Scholar 

  19. Tsai, C.-Y., Liu, T.-Y., Chen, W.-C.: A novel histogram-based multi-threshold searching algorithm for multilevel color thresholding. Int. J. Adv. Robot. Syst. 9(223), 1–13 (2012)

    Google Scholar 

  20. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. Prentice-Hall, New Jersey (2002)

    Google Scholar 

  21. Enjarini, B., Gräser, A.: Planar segmentation from depth images using gradient of depth feature. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal, pp. 4668–4674 (2012)

  22. Erdogan, C., Paluri, M., Dellaert, F.: Planar segmentation of RGBD images using fast linear fitting and Markov Chain Monte Carlo. In: 9th Conference on Computer and Robot Vision, Toronto, Canada, pp. 32–39 (2012)

  23. Ren, X., Bo, L., Fox, D.: RGB-(D) scene labeling: features and algorithms. In: IEEE Conference on Computer Vision and Pattern Recognition, Providence, USA, pp. 2759–2766 (2012)

  24. Gupta, S., Arbeláez, P., Malik, J.: Perceptual organization and recognition of indoor scenes from RGB-D images. In: IEEE Conference on Computer Vision and Pattern Recognition, Portland, USA, pp. 564–571 (2013)

  25. The experimental results website: [Online]. http://www.ee.tku.edu.tw/~RVLab/_Experiments/MultiThres/MultiThres_Results.htm

Download references

Acknowledgments

This work was supported by the National Science Council of Taiwan, ROC under Grant NSC 102-2221-E-032-050.

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Tamkang University, 151 Ying-zhuan Road, Tamsui Dist., New Taipei City, 25137, Taiwan, ROC

    Chi-Yi Tsai & Tsung-Yen Liu

Authors
  1. Chi-Yi Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tsung-Yen Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chi-Yi Tsai.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tsai, CY., Liu, TY. Real-time automatic multilevel color video thresholding using a novel class-variance criterion. Machine Vision and Applications 26, 233–249 (2015). https://doi.org/10.1007/s00138-014-0655-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-014-0655-9

Keywords

Search

Navigation