Intrinsic Dimensionality

Chapter
First Online:
Part of the SpringerBriefs in Computer Science book series (BRIEFSCOMPUTER)

Abstract

In this chapter, various approaches are considered to estimate the intrinsic dimensionality of datasets. These approaches look at the spectrum of eigenvalues and also local and global aspects of the data. In addition, limitations of existing dimensionality reduction approaches are discussed, especially with respect to the range of possible embedding dimensions and reduced performance at higher embedding dimensionalities.

Keywords

Intrinsic dimensionality Fractal dimension Eigenspectrum 
This is a preview of subscription content, log in to check access.

References

  1. 1.
    Nene, S.A., Nayar, S.K., Murase, H.: Columbia Object Image Library (COIL-20). Tech. rep., Technical Report CUCS-005-96. (1996)Google Scholar
  2. 2.
    Strange, H., Zwiggelaar, R.: Classification performance related to intrinsic dimensionality in mammographic image analysis. In: Proceedings of the Thirteenth Annual Conference on Medical Image Understanding and Analysis, pp. 219–223 (2009)Google Scholar
  3. 3.
    Joliffe, I.T.: Principal Component Analysis. Springer-Verlag, New York (1986)Google Scholar
  4. 4.
    Xiao, L., Sun, J., Boyd, S.: A duality view of spectral methods for dimensionality reduction. In: Proceedings of the twenty-third International Conference on Machine Learning (ICML), pp. 1041–1048 (2006)Google Scholar
  5. 5.
    Perona, P., Polito, M.: Grouping and dimensionality reduction by locally linear embedding. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 1255–1262 (2002)Google Scholar
  6. 6.
    Saul, L.K., Roweis, S.: Think globally, fit locally: Unsupervised learning of low dimensional manifolds. Journal of Machine Learning Research 4, 119–155 (2003)Google Scholar
  7. 7.
    Eckmann, J.P., Ruelle, D.: Ergodic theory of chaos and strange attractors. Reviews of Modern Physics 57, 617–659 (1985)Google Scholar
  8. 8.
    Mo, D., Huang, S.H.: Fractal-Based intrinsic dimension estiation and its application in dimensionality reduction. IEEE Transactions on Knowledge and Data Engineering 24(1), 59–71 (2012)Google Scholar
  9. 9.
    Grassberger, P.: An optimized box-assisted algorithm for fractal dimension. Physics Letters A 148, 63–68 (1990)Google Scholar
  10. 10.
    Kégl, B.: Intrinsic dimension estimation using packing numbers. In: Advances in Neural Information Processing Systems 14: Proceedings of the 2002 Conference (NIPS), pp. 681–688 (2002)Google Scholar
  11. 11.
    Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Physica D 9(189), 189–208 (1983)Google Scholar
  12. 12.
    Camastra, F.: Data dimensionality estimation methods: A survey. Pattern Recognition 36, 2945–2954 (2003)Google Scholar
  13. 13.
    Eckmann, J.P., Ruelle, D.: Fundamental limitations for estimating dimensions and lyapounov exponents in dynamical systems. Physica D 56, 185–187 (1992)Google Scholar
  14. 14.
    Smith, L.A.: Intrinsic limits on dimension calculations. Physics Letters A 133, 283–288 (1988)Google Scholar
  15. 15.
    Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Chapman and Hall (1993)Google Scholar
  16. 16.
    Theiler, J., Eubank, S., Longtin, A., Galdrikian, B., Farmer, J.D.: Testing for nonlinearity in time series: the method for surrogate data. Physica D 58, 77–94 (1992)Google Scholar
  17. 17.
    Costa, J.A., Hero, A.O.: Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Transactions on Signal Processing 52(8), 2210–2221 (2004)Google Scholar
  18. 18.
    Fukunaga, K., Olsen, D.R.: An algorithm for finding the intrinsic dimensionality of data. IEEE Transactions on Computers C-20(2), 176–193 (1971)Google Scholar
  19. 19.
    Pettis, K.W., Bailey, T.A., Jain, A.K., Dubes, R.C.: An intrinsic dimensionality estimator from near-neighbor information. IEEE Transactions on Pattern Analysis and Machine Intelligence 1, 25–37 (1979)Google Scholar
  20. 20.
    Verveer, P.J., Duin, R.P.W.: An evaluation of intrinsic dimensionality estimators. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(1), 81–86 (1995)Google Scholar
  21. 21.
    Levina, E., Bickel, P.J.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems 16: Proceedings of the 2004 Conference (NIPS), pp. 777–784 (2004)Google Scholar
  22. 22.
    Fan, M., Qiao, H., Zhang, B.: Intrinsic dimension estimation of manifolds by incising balls. Pattern Recognition 42, 780–787 (2009)Google Scholar
  23. 23.
    Lee, J.A., Verleysen, M.: Nonlinear Dimensionality Reduction. Springer (2007)Google Scholar

Copyright information

© The Author(s) 2014

Authors and Affiliations

  1. 1.Department of Computer ScienceAberystwyth UniversityAberystwythUK

Personalised recommendations