Sparsity and persistence: mixed norms provide simple signal models with dependent coefficients
Sparse regression often uses ℓp norm priors (with p < 2). This paper demonstrates that the introduction of mixed-norms in such contexts allows one to go one step beyond in signal models, and promote some different, structured, forms of sparsity. It is shown that the particular case of the ℓ1,2 and ℓ2,1 norms leads to new group shrinkage operators. Mixed norm priors are shown to be particularly efficient in a generalized basis pursuit denoising approach, and are also used in a context of morphological component analysis. A suitable version of the Block Coordinate Relaxation algorithm is derived for the latter. The group-shrinkage operators are then modified to overcome some limitations of the mixed-norms. The proposed group shrinkage operators are tested on simulated signals in specific situations, to illustrate and compare their different behaviors. Results on real data are also used to illustrate the relevance of the approach.
KeywordsMixed-norms Time–frequency decompositions Sparse representations
Unable to display preview. Download preview PDF.
- 2.Berger J., Coifman R., Goldberg M.: Removing noise from music using local trigonometric bases and wavelet packets. J. Audio Eng. Soc. 42(10), 808–818 (1994)Google Scholar
- 3.Bobin, J., Moudden, Y., Fadili, J., Starck, J.L.: Morphological component analysis for sparse multichannel data: application to inpainting (2007, preprint)Google Scholar
- 4.Bruce, A.G., Sardy, S., Tseng, P.: Block coordinate relaxation methods for nonparametric signal denoising. In: Proceedings of the SPIE—The International Society for Optical Engineering, vol. 3391, pp. 75–86 (1998)Google Scholar
- 7.Daudet, L., Torrésani, B.: Hybrid representations for audiophonic signal encoding. Signal Process. 82(11), 1595–1617 (2002). Special issue on image and video coding beyond standardsGoogle Scholar
- 8.Daudet, L., Molla, S., Torrésani, B.: Towards a hybrid audio coder. In: Li, J.P. (ed.) International Conference Wavelet analysis and Applications, pp. 13–24. Chongqing, China (2004)Google Scholar
- 9.Donoho, D., Tsaig, Y., Drori, I., Starck, J.L.: Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit. Tech. rep., Statistics Department, Stanford University (2007, preprint)Google Scholar
- 13.Gribonval, R., Rauhut, H., Schnass, K., Vandergheynst, P.: Atoms of all channels, unite! average case analysis of multi-channel sparse recovery using greedy algorithms (2007) (INRIA technical report PI 1848)Google Scholar
- 14.Kowalski, M.: Sparse regression using mixed norms (2008). http://hal.archives-ouvertes.fr/hal-00202904/
- 17.Starck, J.L., Elad, M., Donoho, D.: Image decomposition via the combination of sparse representations and a variational approach. IEEE Trans. Image Process. 14(10), (2004)Google Scholar
- 20.Tropp, J., Gilbert, A., Strauss, M.: Algorithms for simultaneous sparse approximation. part I: greedy pursuit. Signal Process. 86, 572–588 (2006). Special issue “Sparse approximations in signal and image processing”Google Scholar
- 21.Tropp, J., Gilbert, A., Strauss, M.: Algorithms for simultaneous sparse approximation. part II: convex relaxation. Signal Process. 86, 589–602 (2006). Special issue “Sparse approximations in signal and image processing”Google Scholar