Designing Structured Sparse Dictionaries for Sparse Representation Modeling
Linear approaches to the problem of unsupervised data dimensionality reduction consist in finding a suitable set of factors, which is usually called dictionary, on the basis of which data can be represented as a linear combination of the dictionary elements. In recent years there have been relevant efforts for searching data representation which are based on sparse dictionary elements or a sparse linear combination of the dictionary elements. Here we investigate the possibility to combine the advantages of both sparse dictionary elements and sparse linear combination. Notably, we also impose a structure on the dictionary elements. We compare our algorithm with two other different approaches presented in literature which impose either sparse structured dictionary elements or sparse linear combination. These (preliminary) results suggests that our approach presents some promising advantages, in particular a greater possibility of interpreting the data representation.
Unable to display preview. Download preview PDF.
- 2.Basso, C., Santoro, M., Verri, A., Villa, S.: Paddle: Proximal algorithm for dual dictionaries learning (2010), CoRR, abs/1011.3728Google Scholar
- 6.Engan, K., Aase, S.O., Hakon Husoy, J.: Method of optimal directions for frame design. In: Proc. of ICASSP 1999, vol. 5, pp. 2443–2446. IEEE Computer Society, Los Alamitos (1999)Google Scholar
- 7.Hastie, T., Tibshirani, R., Friedman, J.H.: The Elements of Statistical Learning: Data Mining, Inference and Prediction, corrected edition. Springer, Heidelberg (2003)Google Scholar
- 8.Jenatton, R., Audibert, J.Y., Bach, F.: Structured variable selection with sparsity-inducing norms. Technical report, arXiv:0904.3523 (2009)Google Scholar
- 9.Jenatton, R., Obozinski, G., Bach, F.: Structured sparse principal component analysis. In: International Conference on AISTATS (2010)Google Scholar
- 14.Zou, H., Hastie, T., Tibshirani, R.: Sparse Principal Component Analysis. Journal of Computational and Graphical Statistics 15 (2004)Google Scholar