Skip to main content
SpringerLink
Log in

On the Utility of Different Entropy Measures in Image Thresholding

  • Chapter
Entropy Measures, Maximum Entropy Principle and Emerging Applications

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 119))

Abstract

Over last few years, several methods have been proposed for image thresholding based on entropy maximization. Some of these methods use gray level histogram, while others use entropy associated with the two-dimensional histogram or the co-occurrence matrix. Few recent methods use the cross entropy or divergence also. But most of these attempts are based on Shannon’s entropy except a few which use the exponential entropy or quadratic entropy. There are many other measures of information or entropy definitions whose utility in image processing has not been explored. This paper attempts to review some of these non-Shannon entropic measures and investigates their usefulness in image segmentation. Most of these “non-Shannonian” entropy measures have some parameters whose influence on the performance of the thresholding algorithms is investigated. In this regard we consider two types of algorithms, one based on global image information (or histogram) and the other based on local image information (co-occurrence or two dimensional histogram). Our findings are: (i) the co-occurrence based entropy methods perform better than histogram based methods for image thresholding; (ii) some of the entropy measures are not very sensitive to their parameters and a few of them are not at all useful at least for histogram based thresholding; and (iii) maximization of the histogram entropy of a partitioned image, at least the way it is being used in the literature, is not a good principle for image segmentation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. K. S. Fu and J. K. Mui, “A survey on image segmentation”, Pattern Recognition, vol. 13, no. 1, pp. 3–16, 1981.

    Article  MathSciNet  Google Scholar 

  2. R. M. Haralick and L. G. Shapiro, “Survey: image segmentation techniques”, Computer Vision Graphics Image Processing, vol. 29, no. 1, pp. 100–132, 1985.

    Article  Google Scholar 

  3. P. K. Sahoo, S. Soltani and A. K. C. Wong, “A survey of thresholding techniques”, Computer Vision Graphics Image Processing, vol. 41, no. 2, pp. 233260, 1988.

    Google Scholar 

  4. N. R. Pal and S. K. Pal, “A review on image segmentation techniques”, Pattern Recognition, vol. 26, no. 9, pp. 1277–1294, 1993.

    Article  Google Scholar 

  5. T. Pun, “A new method for gray level thresholding using the entropy of the histogram”, Signal Processing, vol. 2, pp. 223–237, 1980.

    Article  Google Scholar 

  6. T. Pun, “Entropic thresholding, a new method for image segmentation”, Computer Graphics Image Processing, vol. 16, no. 3, pp. 210–239, 1981.

    Article  Google Scholar 

  7. J. N. Kapur, P. K. Sahoo and A. K. C. Wong, “A new method for gray-level picture thresholding using the entropy of the histogram”, Computer Graphics Vision Image Processing, vol. 29, no. 3, pp. 273–285, 1985.

    Article  Google Scholar 

  8. A. K. C. Wong and P. K. Sahoo, “A gray level threshold selection method based on maximum entropy principle”, IEEE Trans. System Man Cybernetics, vol. SMC-19, no. 4, pp. 866–871, 1989.

    Google Scholar 

  9. N. R. Pal and S. K. Pal, “Image model, poisson distribution and object extraction”, Int. J. Pattern Recognition and Artificial Intelligence, vol. 5, no. 3, pp. 459–483, 1991.

    Article  Google Scholar 

  10. N. R. Pal and D. Bhandari, “Image thresholding: some new techniques”, Signal Processing, vol. 33, no. 2, pp. 139–158, 1993.

    Article  MATH  Google Scholar 

  11. S. K. Pal and N. R. Pal, “Segmentation using contrast and homogeneity measures”, Pattern Recognition Letters, vol. 5, no. 4, pp. 293–304, 1987.

    Article  Google Scholar 

  12. N. R. Pal and S. K. Pal, “Object-background segmentation using new definitions of entropy”, LEE Proceedings-E, vol. 136, no. 4, pp. 284–295, 1989.

    Google Scholar 

  13. N. R. Pal and S. K. Pal, “Entropic thresholding”, Signal Processing, vol. 16, no. 2, pp. 97–108, 1989.

    Article  MathSciNet  Google Scholar 

  14. N. R. Pal and S. K. Pal, “Entropy: a new definition and its applications”, IEEE Trans. System Man Cybernetics, vol. SMC-21, no. 5, pp. 1260–1270, 1991.

    Google Scholar 

  15. A. S. Abutaleb, “ Automatic thresholding of gray level pictures using two-dimensional entropy”, Computer Graphics Vision Image Processing, vol. 47, no. 1, pp. 22–32, 1989.

    Article  Google Scholar 

  16. S. Ray, R. Shakya and B. Srinivasan, “New approaches to image segmentation based on probabilistic distance criteria”, in Proc. LASTED Int. Conf. Signal Image Processing, pp. 459–464, 1997.

    Google Scholar 

  17. N. Otsu, “A threshold selection method from gray level histogram”, IEEE Trans. System Man Cybernetics, vol. SMC-9, no. 1, pp. 62–66, 1979.

    Google Scholar 

  18. C. E. Shannon, “A mathematical theory of communication”, Bell System Technical Journal, vol. 27, pp. 379–423; 623–656, 1948.

    MathSciNet  Google Scholar 

  19. M. D. Levine and A. M. Nazif, “An experimental rule based system for testing low level segmentation strategies”, in Multicomputers and Image Processing: Algorithms and Programs (eds. K. Preston and L. Uhr), Academic Press, New York, pp. 617–625, 1982.

    Google Scholar 

  20. M. D. Levine and A. M. Nazif, “Dynamic measurement of computer generated image segmentation”, IEEE Trans. Pattern Analysis Machine Intelligence, vol. PAMI-7, no. 2, pp. 155–164, 1985.

    Google Scholar 

  21. J. C. Dainty, Image Science, Academic Press, New York, 1974.

    Google Scholar 

  22. C. H. Li and C. K. Lee, “Minimum cross entropy thresholding”, Pattern Recognition, vol. 26, no. 4, pp. 617–625, 1993.

    Article  Google Scholar 

  23. S. Kullback, Information Theory and Statistics, Wiley, New York, 1959.

    MATH  Google Scholar 

  24. N. R. Pal, “On minimum cross entropy thresholding”, Pattern, Recognition, vol. 29, no. 4, pp. 575–580, 1996.

    Article  Google Scholar 

  25. I. Vajda, “Note on discrimination information and variation”, IEEE Trans. Information Theory, vol. IT-16, pp. 771–772, 1970.

    Google Scholar 

  26. U. Kumar, V. Kumar and J. N. Kapur, “Normalized measures of entropy”, Int. J. General Systems, vol. 12, no. 1, pp. 55–69, 1986.

    Article  MathSciNet  Google Scholar 

  27. S. K. Pal and N. R. Pal, “Segmentation based on measures of contrast, homogeneity, and region size”, IEEE Trans. System Man Cybernetics, vol. SMC-17, no. 5, pp. 857–868, 1987.

    Google Scholar 

  28. A. Rényi, “On measures of entropy and information”, in Proc. 4th Berkeley Syrup. Math. Stat. and Prob., vol. 1, pp. 547–561, 1961.

    Google Scholar 

  29. J. H. Havrda and F. Charvat, “Quantification method of classificatory processes: concept of structural a-entropy”, Kybernetika, vol. 3, no. 1, pp. 30–35, 1967.

    MathSciNet  MATH  Google Scholar 

  30. S. Guiasu, Information Theory with Applications, McGraw-hill Int. Book Company, New York, 1977.

    Google Scholar 

  31. R. C. Gonzalez and P. Wintz, Digital Image Processing, Addison-Wesley, Reading, 1987.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Indian Statistical Institute, Calcutta, 700 035, India

    D. P. Mandal & N. R. Pal

Authors
  1. D. P. Mandal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. N. R. Pal
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer and Systems Sciences, Jawaharlal Nehru University, 110 067, New Delhi, India

    Karmeshu

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Mandal, D.P., Pal, N.R. (2003). On the Utility of Different Entropy Measures in Image Thresholding. In: Karmeshu (eds) Entropy Measures, Maximum Entropy Principle and Emerging Applications. Studies in Fuzziness and Soft Computing, vol 119. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-36212-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-36212-8_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-05531-7

  • Online ISBN: 978-3-540-36212-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation