A Generative Probabilistic Oriented Wavelet Model for Texture Segmentation

Abstract

This Letter addresses image segmentation via a generative model approach. A Bayesian network (BNT) in the space of dyadic wavelet transform coefficients is introduced to model texture images. The model is similar to a Hidden Markov model (HMM), but with non-stationary transitive conditional probability distributions. It is composed of discrete hidden variables and observable Gaussian outputs for wavelet coefficients. In particular, the Gabor wavelet transform is considered. The introduced model is compared with the simplest joint Gaussian probabilistic model for Gabor wavelet coefficients for several textures from the Brodatz album [1]. The comparison is based on cross-validation and includes probabilistic model ensembles instead of single models. In addition, the robustness of the models to cope with additive Gaussian noise is investigated. We further study the feasibility of the introduced generative model for image segmentation in the novelty detection framework [2]. Two examples are considered: (i) sea surface pollution detection from intensity images and (ii) image segmentation of the still images with varying illumination across the scene.

This is a preview of subscription content, log in to check access.

References

  1. 1.

    Brodatz, P.: A Photographic Album for Artists and Designers. Dover, New York, 1996.

    Google Scholar 

  2. 2.

    Bishop, C. M.: Novelty detection and neural network validation. IEE Proceedings: Vision, Image and Signal Processing 141(6) (1994), 217–222.

    Google Scholar 

  3. 3.

    Jain, A. K.: Fundamentals of Digital Image Processing. Prentice Hall, London, 1989.

    Google Scholar 

  4. 4.

    Gonzalez, R. C. and Wintz, P.: Digital Image Processing, Addison-Wesley Publishing Company, 1993.

  5. 5.

    Tuceryan, M. and Jain, A. K.: Texture analysis, In: C. H. Chen, L. F. Pau, and P. S. P. Wang, (eds.), The Handbook of Pattern Recognition and Computer Vision, World Scientific Publishing Co., 1988, pp. 207–248.

  6. 6.

    Duda, R. O. and Hart, P. E.: Pattern Classification and Scene Analysis, John Wiley, New York, 1973.

    Google Scholar 

  7. 7.

    Papoulis, A.: Probability, Random Variables, and Stochastic Processes, McGraw-Hill, New York-Toronto, 1991. Third edition.

    Google Scholar 

  8. 8.

    Geman, S. and German, D.: Stochastic relaxation, Gibbs distributions and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6(6) (1984), 721–741.

    Google Scholar 

  9. 9.

    Chellappa, R. and Jain, A.: Markov Random Fields: Theory and Applications, Academic Press, 1993.

  10. 10.

    Romberg, J. K., Choi, H. and Baraniuk, R. G.: Bayesian wavelet domain image modeling using Hidden Markov trees, In: International Conference on Image Processing-ICIP'99, Kobe, Japan, October 1999, pp. 1–5.

  11. 11.

    De Bonet, J. S. and Viola, P.: Texture recognition using a non-parametric multi-scale statistical model. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition, 1988.

  12. 12.

    Wainwright, M. J., Simonceli, E. P. and Willsky, A. S.: Random cascades on wavelet trees and their use on analyzing and modeling natural images. Applied and Computational Harmonic Analysis 11(1) (2001), 89–123.

    Google Scholar 

  13. 13.

    Mallat, S. G.: A Wavelet Tour of Signal Processing Academic Press, San Diego, 1998.

    Google Scholar 

  14. 14.

    Simoncelli, E. P.: Statistical models for images: Compression, restoration and synthesis. In 31st Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, November 1997, pp. 2–5.

  15. 15.

    Portilla, J. and Simoncelli, E. P.: A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision 40, 49–71, December 2000.

    Google Scholar 

  16. 16.

    Adelson, E. H., Simoncelli, E. P. and Hingorani, R.: Orthogonal pyramid transforms for image coding. In SPIE Visual Communications and Image Processing II, volume 845, October 1987, pp. 50–58.

    Google Scholar 

  17. 17.

    Daugman, J. G.: Complete discrete 2D Gabor transforms by neural networks for image analysis and compression. IEEE Transactions on ASSP 36(7) (1988), 1169–1179.

    Google Scholar 

  18. 18.

    Jain, A. K. and Farrokhnia, F.: Unsupervised texture segmentation using Gabor filters. Pattern Recognition 4(12) (1991), 1167–1186.

    Google Scholar 

  19. 19.

    Nestares, O., Navarro, R., Portilla, J. and Tabernero, A.: Efficient spatial-domain implementation of a multiscale image representation based on Gabor functions. Journal of Electronic Imaging, SPIE 07(01) (1998), 166–173.

    Google Scholar 

  20. 20.

    Marr, D.: Vision. Imprint FREEMAN, New York, 1982.

    Google Scholar 

  21. 21.

    Jensen. F. V.: An Introduction to Bayesian Networks. Springer Verlag, New York, 1996.

    Google Scholar 

  22. 22.

    Crouse, M. S., Nowak, R. D. and Baraniuk, R. G.: Wavelet-based signal processing using Hidden Markov Models. IEEE Transactions on Signal Processing, 46, 886–902, April 1998.

    Google Scholar 

  23. 23.

    Jordan, M.: Learning in Graphical Models. The MIT Press, Cambridge, Massachusetts, London, England, 1999.

    Google Scholar 

  24. 24.

    Rabiner, L. R. and Juang, B. H.: An Introduction to Hidden Markov Models. In IEEE ASSP Magazine, January 1986, pp. 4–16.

  25. 25.

    Dempster, A. P., Laird, N. M. and Rubin, D. B.: Maximum likelihood from incomplete data via the EM algorithm. Proceedings of the Royal Statistical Society B-39 (1977), 1–38.

    Google Scholar 

  26. 26.

    Frey, B. J.: Graphical Models for Machine Learning and Digotal Communiation. The MIT Press, Cambridge, Massachusetts London, England, 1998.

    Google Scholar 

  27. 27.

    Opper, M. and Saad, D.: Advanced Mean Field Methods. The MIT Press, Cambridge, 2001.

    Google Scholar 

  28. 28.

    Ronen, O., Rohlicek, J. R. and Ostendorf, M.: Parameter Estimation of Dependence Tree Models Using the EM Algorithm. IEEE Signal Processing Letters 2(8) (1995), 157–159.

    Google Scholar 

  29. 29.

    Kschischang, F. R., Frey, B. J. and Loeliger, H. A.: Factor graphs and the Sum-Product Algorithm. IEEE Transactions on Information Theory 47(2) (2001), 498–519.

    Google Scholar 

  30. 30.

    Efron B. and Tibshirani, R.: An Introduction to the Bootstrap. Chapman and Hall, New York, 1993.

    Google Scholar 

  31. 31.

    Bellman, R. E.: Adaptive Control Processes. Princeton University Press, Princeton, NJ, 1961.

    Google Scholar 

  32. 32.

    Geman, S., Bienenstock, E. and Doursat, R.: Neural networks and the bias-variance dilemma. Neural Computation 4 (1992), 1–58.

    Google Scholar 

  33. 33.

    Friedman, N. and Russel, S.: Image segmentation in video sequences: A probabilistic approach. In The Thirteenth Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann Publishers, 1997, pp. 175–181.

  34. 34.

    Stauffer, C. and Grimson, W. E. L.: Adaptive background mixture model for real-time tracking. In IEEE Computer Society Conference om Computer Vision and Pattern Recognition, Cat. No. PR00149, volume 2, June 23-25 1999, pp. 22–46.

    Google Scholar 

  35. 35.

    McLachlan, G. and Peel, D.: Finite Mixture Models. Wiley Series in Probability and Statistics, New York, 2000.

  36. 36.

    Bilmes, J A.: A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and Hidden Markov models. Technical report, tr-97-021, International Computer Science Institute and Computer Science Division U. C. Berkeley, 1998.

    Google Scholar 

  37. 37.

    Stainvas, I. and Lowe, D.: Towards sea surface pollution detection from visible band images. IEICE Transactions on Electronics a Special Issue on New Technologies in Signal Processing for Electromagnetic-wave Sensing and Imaging, E84C(12), 1848–1856, December 2001.

    Google Scholar 

  38. 38.

    Stainvas, I. and Lowe, D.: A generative model for separating illumination and reflectance from images. Technical report, Aston University, NCRG/2002/024, June 2002.

  39. 39.

    Heskes, T.: Selecting weighing factors in logarithmic opinion pools. Advances in Neural Information Processing Systems, 1998.

  40. 40.

    Hinton, G. E.: Products of experts. In Proceedings of the Ninth International Conference on Artificial Neural Networks (ICANN99), volume 1, Edinburgh, Scotland, 1999, pp. 1–6.

    Google Scholar 

  41. 41.

    Ghahramani, Z. and Jordan, M.: Factorial Hidden Markov models. Machine Learning, 29 (1997), 245–273.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Stainvas, I., Lowe, D. A Generative Probabilistic Oriented Wavelet Model for Texture Segmentation. Neural Processing Letters 17, 217–238 (2003). https://doi.org/10.1023/A:1026089427119

Download citation

  • Bayesian networks and ensembles
  • Dyadic wavelet transform
  • Gabor wavelet transform
  • generative probabilistic model
  • image texture segmentation
  • novelty detection