Abstract
For matrices with nonnegative elements, an updated method of dimensionality reduction based on cross-entropy optimization of projection matrices under the condition of maintaining the information capacity is proposed.
Similar content being viewed by others
REFERENCES
E. Bingham and H. Manilla, “Random projection in dimensionality reduction: Application to image and next data,” in Proceedings of the 7th ACM SICKDD International Conference on Knowledge Discovery and Data Mining (ACM, New York, 2001), pp. 245–250.
D. Achlioptas, “Database-friendly random projection,” in Proceeding of the 12th ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Data Base Systems (2001), pp. 274–281.
Yu. S. Popkov, Yu. A. Dubnov, and A. Yu. Popkov, Autom. Remote Control 79 (11), 2038–2051 (2018).
M. G. Kendall and A. Stuart, The Advanced Theory of Statistics (Griffin, London, 1977).
I. T. Jollife, Principle Component Analysis (Springer-Verlag, New York, 2002).
S. A. Aivazyan et al., Applied Statistics: Classification and Dimensionality Reduction (Finansy i Statistika, Moscow, 1989) [in Russian].
R. A. Fisher, Ann. Eugen. 7, 179–188 (1936).
P. Comon and C. Jutten, Handbook of Blind Source Separation, Independent Component Analysis, and Applications (Academic, Oxford, UK, 2010).
W. Michael et al., Comput. Stat. Data Anal. 52, 150–173 (2007).
B. T. Polyak and M. V. Khlebnikov, Autom. Remote Control 78 (3), 490–506 (2017).
Yu. S. Popkov, Tekh. Kibern., No. 2, 31–45 (1993).
Yu. S. Popkov, Theory of Macrosystems: Model Equilibrium (URSS, Moscow, 1999) [in Russian].
S. Kullback and R. A. Leibler, Ann. Math. Stat. 22 (1), 79–86 (1951).
J. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics (Wiley, New York, 1999).
Funding
This work was supported by the Russian Foundation for Basic Research, project nos. 17-29-03119, 17-29-02115.
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated by I. Ruzanova
Rights and permissions
About this article
Cite this article
Popkov, Y.S., Popkov, A.Y. Cross-Entropy Optimal Dimensionality Reduction with a Condition on Information Capacity. Dokl. Math. 100, 420–422 (2019). https://doi.org/10.1134/S106456241905003X
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S106456241905003X