Skip to main content
SpringerLink
Log in

Cross-Entropy Optimal Dimensionality Reduction with a Condition on Information Capacity

  • MATHEMATICS
  • Published:
Doklady Mathematics Aims and scope Submit manuscript

Abstract

For matrices with nonnegative elements, an updated method of dimensionality reduction based on cross-entropy optimization of projection matrices under the condition of maintaining the information capacity is proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. E. Bingham and H. Manilla, “Random projection in dimensionality reduction: Application to image and next data,” in Proceedings of the 7th ACM SICKDD International Conference on Knowledge Discovery and Data Mining (ACM, New York, 2001), pp. 245–250.

  2. D. Achlioptas, “Database-friendly random projection,” in Proceeding of the 12th ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Data Base Systems (2001), pp. 274–281.

  3. Yu. S. Popkov, Yu. A. Dubnov, and A. Yu. Popkov, Autom. Remote Control 79 (11), 2038–2051 (2018).

    Article  MathSciNet  Google Scholar 

  4. M. G. Kendall and A. Stuart, The Advanced Theory of Statistics (Griffin, London, 1977).

    MATH  Google Scholar 

  5. I. T. Jollife, Principle Component Analysis (Springer-Verlag, New York, 2002).

    Google Scholar 

  6. S. A. Aivazyan et al., Applied Statistics: Classification and Dimensionality Reduction (Finansy i Statistika, Moscow, 1989) [in Russian].

    Google Scholar 

  7. R. A. Fisher, Ann. Eugen. 7, 179–188 (1936).

    Article  Google Scholar 

  8. P. Comon and C. Jutten, Handbook of Blind Source Separation, Independent Component Analysis, and Applications (Academic, Oxford, UK, 2010).

    Google Scholar 

  9. W. Michael et al., Comput. Stat. Data Anal. 52, 150–173 (2007).

    Google Scholar 

  10. B. T. Polyak and M. V. Khlebnikov, Autom. Remote Control 78 (3), 490–506 (2017).

    Article  MathSciNet  Google Scholar 

  11. Yu. S. Popkov, Tekh. Kibern., No. 2, 31–45 (1993).

  12. Yu. S. Popkov, Theory of Macrosystems: Model Equilibrium (URSS, Moscow, 1999) [in Russian].

    Google Scholar 

  13. S. Kullback and R. A. Leibler, Ann. Math. Stat. 22 (1), 79–86 (1951).

    Article  Google Scholar 

  14. J. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics (Wiley, New York, 1999).

    MATH  Google Scholar 

Download references

Funding

This work was supported by the Russian Foundation for Basic Research, project nos. 17-29-03119, 17-29-02115.

Author information

Authors and Affiliations

  1. Federal Research Center “Computer Science and Control”, Russian Academy of Sciences, 117312, Moscow, Russia

    Yu. S. Popkov & A. Yu. Popkov

  2. Department of Software Engineering, ORT Braude College, Karmiel, Israel

    Yu. S. Popkov

Authors
  1. Yu. S. Popkov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. Yu. Popkov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yu. S. Popkov.

Additional information

Translated by I. Ruzanova

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Popkov, Y.S., Popkov, A.Y. Cross-Entropy Optimal Dimensionality Reduction with a Condition on Information Capacity. Dokl. Math. 100, 420–422 (2019). https://doi.org/10.1134/S106456241905003X

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S106456241905003X

Search

Navigation