Skip to main content

Assessing the Effectiveness of Intrinsic Dimension Estimators for Uncovering the Phase Space Dimensionality of Dynamical Systems from State Observations

A Comparative Analysis

  • 256 Accesses

Part of the Lecture Notes in Computer Science book series (LNCS,volume 14146)


Devising a model of a dynamical system from raw observations of its states and evolution requires characterising its phase space, which includes identifying its dimension and state variables. Recently, Boyuan Chen and his colleagues proposed a technique that uses intrinsic dimension estimators to discover the hidden variables in experimental data. The method uses estimators of the intrinsic dimension of the manifold of observations. We present the results of a comparative empirical performance evaluation of various candidate estimators. We expand the repertoire of estimators proposed by Chen et al. and find that several estimators not initially suggested by the authors outperforms the others.

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


  1. 1.

    The code to reproduce the results presented in this paper is available at:

  2. 2.

    The package is available at


  1. Amsaleg, L., et al.: Extreme-value-theoretic estimation of local intrinsic dimensionality. Data Min. Knowl. Disc. 32(6), 1768–1805 (2018)

    CrossRef  MathSciNet  MATH  Google Scholar 

  2. Bac, J., Mirkes, E.M., Gorban, A.N., Tyukin, I., Zinovyev, A.: Scikit-dimension: a python package for intrinsic dimension estimation. Entropy 23(10), 1368 (2021)

    CrossRef  MathSciNet  Google Scholar 

  3. Bellman, R.E.: Adaptive Control Processes. Princeton University Press, Princeton (1961)

    CrossRef  MATH  Google Scholar 

  4. Bennett, R.S.: Representation and analysis of signals part xxi. the intrinsic dimensionality of signal collections (1965)

    Google Scholar 

  5. Brito, M., Quiroz, A., Yukich, J.: Intrinsic dimension identification via graph-theoretic methods. J. Multivar. Anal. 116, 263–277 (2013)

    CrossRef  MathSciNet  MATH  Google Scholar 

  6. Campadelli, P., Casiraghi, E., Ceruti, C., Rozza, A.: Intrinsic dimension estimation: relevant techniques and a benchmark framework. Math. Probl. Eng. 2015, 1–21 (2015)

    CrossRef  MathSciNet  MATH  Google Scholar 

  7. Chen, B., Huang, K., Raghupathi, S., Chandratreya, I., Du, Q., Lipson, H.: Automated discovery of fundamental variables hidden in experimental data. Nat. Comput. Sci. 2, 433–442 (2022)

    CrossRef  Google Scholar 

  8. Costa, J., Girotra, A., Hero, A.: Estimating local intrinsic dimension with k-nearest neighbor graphs. In: IEEE/SP 13th Workshop on Statistical Signal Processing, 2005, pp. 417–422 (2005)

    Google Scholar 

  9. Costa, J., Hero, A.: Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Trans. Signal Process. 52(8), 2210–2221 (2004)

    CrossRef  MathSciNet  MATH  Google Scholar 

  10. Costa, J.A., Hero, A.O.: Determining Intrinsic Dimension and Entropy of High-Dimensional Shape Spaces, pp. 231–252. Birkhäuser Boston, Boston, MA (2006)

    Google Scholar 

  11. Facco, E., d’Errico, M., Rodriguez, A., Laio, A.: Estimating the intrinsic dimension of datasets by a minimal neighborhood information. Sci. Rep. 7(1), 12140 (2017)

    CrossRef  Google Scholar 

  12. Farahmand, A.M., Szepesvári, C., Audibert, J.Y.: Manifold-adaptive dimension estimation. In: Proceedings of the 24th International Conference on Machine Learning, pp. 265–272. ICML 2007, Association for Computing Machinery, New York, NY, USA (2007)

    Google Scholar 

  13. Grassberger, P., Procaccia, I.: Measuring the strangeness of strange attractors. Physica D 9(1), 189–208 (1983)

    CrossRef  MathSciNet  MATH  Google Scholar 

  14. Haro, G., Randall, G., Sapiro, G.: Translated poisson mixture model for stratification learning. Int. J. Comput. Vis. 80, 358–374 (2008)

    CrossRef  MATH  Google Scholar 

  15. Hein, M., Audibert, J.Y.: Intrinsic dimensionality estimation of submanifolds in \({R}^d\), pp. 289–296 (01 2005)

    Google Scholar 

  16. Jolliffe, I.T.: Principal component analysis and factor analysis. In: Principal Component Analysis. Springer Series in Statistics, pp. 115–128. Springer, New York (1986).

    CrossRef  Google Scholar 

  17. Kuwamura, M.: The hamiltonian formalism in reaction-diffusion systems. Asymptotic Anal. Singularities-Elliptic Parabolic PDEs Relat. Prob. 47, 635–646 (2007)

    MathSciNet  MATH  Google Scholar 

  18. Levina, E., Bickel, P.: Maximum likelihood estimation of intrinsic dimension. In: Advances in Neural Information Processing Systems, vol. 17 (2004)

    Google Scholar 

  19. Lombardi, G.: Intrinsic dimensionality estimation techniques (2023).

  20. Rozza, A., Lombardi, G., Ceruti, C., Casiraghi, E., Campadelli, P.: Novel high intrinsic dimensionality estimators. Mach. Learn. 89(1), 37–65 (2012)

    CrossRef  MathSciNet  MATH  Google Scholar 

  21. Stewart, D.E., Dewar, R.L.: Non-linear Dynamics, pp. 167–248. Cambridge University Press, Cambridge (2000)

    Google Scholar 

Download references


This research is supported by Singapore Ministry of Education, grant MOE-T2EP50120-0019, and by the National Research Foundation, Prime Minister’s Office, Singapore, under its Campus for Research Excellence and Technological Enterprise (CREATE) programme as part of the programme Descartes.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Félix Chavelli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chavelli, F., Zi-Yu, K., Low, J.S.C., Bressan, S. (2023). Assessing the Effectiveness of Intrinsic Dimension Estimators for Uncovering the Phase Space Dimensionality of Dynamical Systems from State Observations. In: Strauss, C., Amagasa, T., Kotsis, G., Tjoa, A.M., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2023. Lecture Notes in Computer Science, vol 14146. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-39846-9

  • Online ISBN: 978-3-031-39847-6

  • eBook Packages: Computer ScienceComputer Science (R0)