The Minimum Support Criterion for Blind Signal Extraction: A Limiting Case of the Strengthened Young’s Inequality

  • Sergio Cruces
  • Iván Durán
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3195)


In this paper, we address the problem of the blind extraction of a subset of “interesting” independent signals from a linear mixture. We present a novel criterion for the extraction of the sources whose density has the minimum support measure. By extending the definition of the Renyi’s entropies to include the zero-order case, this criterion can be regarded as part of a more general entropy minimization principle. It is known that Renyi’s entropies provide contrast functions for the blind extraction of independent and identically distributed sources under an ∞-norm constraint on the global transfer system. The proposed approach gives sharper lower-bounds for the zero-order Renyi’s entropy case and, contrary to the existing results, it allows the extraction even when the sources are non identically distributed. Another interesting feature is that it is robust to the presence of certain kinds of additive noise and outliers in the observations.


Convex Hull Minimum Support Minimum Entropy Blind Deconvolution Renyi Entropy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Godfrey, B.: An information theory approach to deconvolution,” Stanford exploration project, Report No. 15, pp. 157–182 (1978)Google Scholar
  2. 2.
    Donoho, D.: On Minimum Entropy Deconvolution. In: Findley, D.F. (ed.) Applied Time Series Analysis II, pp. 565–608. Academic Press, New York (1981)Google Scholar
  3. 3.
    Comon, P.: Independent component analysis, a new concept? Signal Processing 3(36), 287–314 (1994)CrossRefGoogle Scholar
  4. 4.
    Cruces, S., Cichocki, A., Amari, S.-i.: From blind signal extraction to blind instantaneous signal separation: criteria, algorithms and stability. IEEE Trans. On Neural Network (July 2004) (scheduled print)Google Scholar
  5. 5.
    Principe, J., Xu, D., Fisher, J.: Information Theoretic Learning. In: Haykin, S. (ed.) Unsupervised Adaptive Filtering, vol. I, pp. 265–319. Wiley, Chichester (2000)Google Scholar
  6. 6.
    Bercher, J.-F., Vignat, C.: A Renyi entropy convolution inequality with application. In: Proc. of EUSIPCO, Toulouse, France (2002)Google Scholar
  7. 7.
    Erdogmus, D., Principe, J.C., Vielva, L.: Blind deconvolution with minimum Renyi’s entropy. In: Proc. of EUSIPCO, Toulouse, France, vol. 2, pp. 71–74 (2002)Google Scholar
  8. 8.
    Cover, T.M., Thomas, J.A.: Elements of Information Theory. Wiley series in telecommunications. John Wiley, Chichester (1991)zbMATHCrossRefGoogle Scholar
  9. 9.
    Gardner, R.J.: The Brunn-Minkowski Inequality. Bulletin of the American Mathematical Society 39(3), 355–405 (2002)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Sergio Cruces
    • 1
  • Iván Durán
    • 1
  1. 1.Área de Teoría de la Señal y ComunicacionesSevilleSpain

Personalised recommendations