The Quest for a Dictionary
A fundamental ingredient in the definition of Sparse-Land’s signals and its deployment to applications is the dictionary A. How can we wisely choose A to perform well on the signals in question? This is the topic of this chapter, and our emphasis is put on learning methods for dictionaries, based on a group of examples.
KeywordsSparse Representation Wavelet Packet Image Patch Sparse Code Blind Source Separation
Unable to display preview. Download preview PDF.
- 1.M. Aharon, M. Elad, and A.M. Bruckstein, K-SVD and its non-negative variant for dictionary design, Proceedings of the SPIE conference wavelets, Vol. 5914, July 2005.Google Scholar
- 4.E.J. Candès and D.L. Donoho, Recovering edges in ill-posed inverse problems: optimality of curvelet frames, Annals of Statistics, 30(3):784–842, 2000.Google Scholar
- 6.A. Cichocki, R. Zdunek, A.H. Phan, and S.I. Amari, Nonnegative Matrix and Tensor Factorizations Applications to Exploratory Multi-way Data Analysis and Blind Source Separation, Wiley, Tokyo, Japan, 2009.Google Scholar
- 7.V. Chandrasekaran, M. Wakin, D. Baron, R. Baraniuk, Surflets: a sparse representation for multidimensional functions containing smooth discontinuities, IEEE Symposium on Information Theory, Chicago, IL, 2004.Google Scholar
- 13.D.L. Donoho and V. Stodden, When does non-negative matrix factorization give a correct decomposition into parts? Advances in Neural Information Processing 16 (Proc. NIPS 2003), MIT Press, 2004.Google Scholar
- 14.M. Elad and M. Aharon, Image denoising via learned dictionaries and sparse representation, International Conference on Computer Vision and pattern Recognition, New-York, June 17–22, 2006.Google Scholar
- 17.R. Eslami and H. Radha, The contourlet transform for image de-noising using cycle spinning, in Proceedings of Asilomar Conference on Signals, Systems, and Computers, pp. 1982–1986, November 2003.Google Scholar
- 20.G.H. Golub and C.F. Van Loan, Matrix Computations, Johns Hopkins Studies in Mathematical Sciences, Third edition, 1996.Google Scholar
- 21.P.O. Hoyer, Non-negative matrix factorization with sparseness constraints, Journal of Machine Learning Research, 1457–1469, 2004.Google Scholar
- 23.D. Lee and H. Seung, Learning the parts of objects by non-negative matrix factorization, Nature, 788–791, 1999.Google Scholar
- 24.S. Lesage, R. Gribonval, F. Bimbot, and L. Benaroya, Learning unions of orthonormal bases with thresholded singular value decomposition, ICASSP 2005 (IEEE Conf. on Acoustics, Speech and Signal Proc.).Google Scholar