Template Learning using Wavelet Domain Statistical Models

Conference paper


Wavelets have been used with great success in applications such as signal denoising, compression, estimation and feature extraction. This is because of their ability to capture singularities in the signal with a few coefficients. Applications that consider the statistical dependencies of wavelet coefficients have been shown to perform better than those which assume the wavelet coefficients as independent. In this paper, a novel Gaussian mixture model, specifically suited for template learning is proposed for modeling the marginal statistics of the wavelet coefficients. A Bayesian approach for inferring a low dimensional statistical template with a set of training images, using the independent mixture and the hidden Markov tree models extended to the template learning case, is developed. Results obtained for template learning and pattern classification using the low dimensional templates are presented. For training with a large data set, statistical templates generated using the proposed Bayesian approach are more robust than those generated using an information-theoretic framework in the wavelet domain.


Bayesian Approach Gaussian Mixture Model Training Image Viterbi Algorithm Wavelet Domain 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Crouse, M., Nowak, R. and Baraniuk, R.: Wavelet-based statistical signal processing using hidden markov models. IEEE Transactions on Signal Processing. 46(4), 886–902 (1998).CrossRefMathSciNetGoogle Scholar
  2. 2.
    Scott, C.: A hierarchical wavelet-based framework for pattern analysis and synthesis. M.S. thesis, Rice University, Houston, TX, USA (2000).Google Scholar
  3. 3.
    Liu, J. and Moulin, P.: Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients. IEEE Transactions on Image Processing. 10(11), 1647–1658 (2001).zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Chipman, H., Kolaczyk, E. and McCulloch, R.: Adaptive bayesian wavelet shrinkage. Journal of The American Statistical Association. 92(440), 1413–1421 (1997).zbMATHCrossRefGoogle Scholar
  5. 5.
    Romberg, J.: A universal hidden markov tree image model. M.S. thesis, Rice University, Texas, USA (1999).Google Scholar
  6. 6.
    LeCun, Y., Bottou, L., Bengio, Y. and Haffner, P.: Gradient-based learning applied to document recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 86(11), 2278–2324 (1998).Google Scholar
  7. 7.
    Yale face database. Available online at
  8. 8.
    Matlab code for wavelet-based template learning and pattern classification using TEMPLAR. Available online at
  9. 9.
    Ramamurthy, K. N.: Template learning with wavelet domain statistical models for pattern synthesis and classification. M.S. thesis, Arizona State University, Tempe, AZ, USA (2008).Google Scholar
  10. 10.
    Ramamurthy, K. N., Thiagarajan, J. J. and Spanias, A.: Fast image registation with nonstationary Gauss-Markov random field templates. Accepted to the IEEE International Conference on Image Processing, Cairo, Egypt (2009).Google Scholar

Copyright information

© Springer-Verlag London 2010

Authors and Affiliations

  1. 1.School of Electrical, Computer and Energy Engineering, Arizona State UniversityArizonaUSA

Personalised recommendations