Model Selection in the Sparsity Context for Inverse Problems in Bayesian Framework
The Bayesian approach is considered for inverse problems with a typical forward model accounting for errors and a priori sparse solutions. Solutions with sparse structure are enforced using heavy-tailed prior distributions. The particular case of such prior expressed via normal variance mixtures with conjugate laws for the mixing distribution is the main interest of this paper. Such a prior is considered in this paper, namely, the Student-t distribution. Iterative algorithms are derived via posterior mean estimation. The mixing distribution parameters appear in updating equations and are also used for the initialization. For the choice of mixing distribution parameters, three model selection strategies are considered: (i) parameters approximating the mixing distribution with Jeffrey law, i.e., keeping the mixing distribution well defined but as close as possible to the Jeffreys priors, (ii) based on the prior distribution form, fixing the parameters corresponding to the form inducing the most sparse solution and (iii) based on the sparsity mechanism, fixing the hyperparameters using the statistical measures of the mixing and prior distribution. For each strategy of model selection, the theoretical advantages and drawbacks are discussed and the corresponding simulations are reported for a 1D direct sparsity application in a biomedical context. We show that the third strategy seems to provide the best parameter selection strategy for this context.
KeywordsInverse problems Gaussian scale mixtures Sparsity enforcing Parameter selection
- 1.Mohammad-Djafari, A.: EURASIP J. Adv. Signal Process. 52 (2012). https://doi.org/10.1186/1687-6180-2012-52
- 4.Smídl, V., Quinn, A.: The Variational Bayes Method in Signal Processing. Signals and communication technology, 1st edn. Springer, Heidelberg (2006). https://doi.org/10.1007/3-540-28820-1
- 5.Beal, M.J.: Variational Algorithms for Approximate Bayesian Inference. Ph.D. thesis, University College London (2003)Google Scholar
- 6.Dumitru, M.: A Bayesian Approach for Periodic Components Estimation for Chronobiological Signals. Ph.D. thesis, Université Paris-Saclay (2016)Google Scholar
- 9.Dumitru, M., Mohammad-Djafari, A., B.S, S.: EURASIP J. Bioinf. Syst. Biol. 3 (2016). https://doi.org/10.1186/s13637-015-0033-6