Encyclopedia of Biometrics

2015 Edition
| Editors: Stan Z. Li, Anil K. Jain

Manifold Learning

  • Philippos Mordohai
  • Gerard Medioni
Reference work entry
DOI: https://doi.org/10.1007/978-1-4899-7488-4_301

Definition

Manifold learning is the process of estimating the structure of a manifold from a set of samples, also referred to as observations or instances, taken from the manifold. It is a subfield of machine learning that operates in continuous domains and learns from observations that are represented as points in a Euclidean space, referred to as the ambient space. This type of learning, to Mitchell, is termed instance-based or memory-based learning [1]. The goal of such learning is to discover the underlying relationships between observations, on the assumption that they lie in a limited part of the space, typically a manifold, the intrinsic dimensionality of a manifold of which is an indication of the degrees of freedom of the underlying system.

Introduction

Manifold learning has attracted considerable attention of the machine learning community, due to a wide spectrum of applications in domains such as pattern recognition, data mining, biometrics, function approximation, and...

This is a preview of subscription content, log in to check access.

References

  1. 1.
    T. Mitchell, Machine Learning (McGraw-Hill, New York, 1997)zbMATHGoogle Scholar
  2. 2.
    I. Jolliffe, Principal Component Analysis (Springer, New York, 1986)Google Scholar
  3. 3.
    T. Cox, M. Cox, Multidimensional Scaling (Chapman & Hall, London, 1994)zbMATHGoogle Scholar
  4. 4.
    S. Roweis, L. Saul, Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)Google Scholar
  5. 5.
    J. Tenenbaum, V. de Silva, J. Langford, A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)Google Scholar
  6. 6.
    M. Brand, Charting a manifold, in Advances in Neural Information Processing Systems, vol. 15 (MIT, Cambridge, 2003), pp. 961–968Google Scholar
  7. 7.
    M. Belkin, P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput. 15(6), 1373–1396 (2003)zbMATHGoogle Scholar
  8. 8.
    P. Mordohai, G. Medioni, Tensor Voting: A Perceptual Organization Approach to Computer Vision and Machine Learning (Morgan & Claypool, San Rafael, 2006)Google Scholar
  9. 9.
    J. Bruske, G. Sommer, Intrinsic dimensionality estimation with optimally topology preserving maps. IEEE Trans. Pattern Anal. Mach. Intell. 20(5), 572–575 (1998)Google Scholar
  10. 10.
    B. Kégl, Intrinsic dimension estimation using packing numbers, in Advances in Neural Information Processing Systems, vol. 15 (MIT, Cambridge, 2003), pp. 681–688Google Scholar
  11. 11.
    M. Raginsky, S. Lazebnik, Estimation of intrinsic dimensionality using high-rate vector quantization, in Advances in Neural Information Processing Systems, vol. 18 (MIT, Cambridge, 2006), pp. 1105–1112Google Scholar
  12. 12.
    J. Costa, A. Hero, Geodesic entropic graphs for dimension and entropy estimation in manifold learning. IEEE Trans. Signal Process. 52(8), 2210–2221 (2004)MathSciNetGoogle Scholar
  13. 13.
    P. Mordohai, G. Medioni, Unsupervised dimensionality estimation and manifold learning in high-dimensional spaces by tensor voting, in International Joint Conference on Artificial Intelligence, Pittsburgh, 2005Google Scholar
  14. 14.
    B. Schölkopf, A. Smola, K.R. Müller, Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 10(5), 1299–1319 (1998)Google Scholar
  15. 15.
    D. Donoho, C. Grimes, Hessian eigenmaps: new tools for nonlinear dimensionality reduction, in Proceedings of National Academy of Science, 2003, pp. 5591–5596Google Scholar
  16. 16.
    K.Q. Weinberger, L.K. Saul, Unsupervised learning of image manifolds by semidefinite programming. Int. J. Comput. Vis. 70(1), 77–90 (2006)Google Scholar
  17. 17.
    S. Prince, J. Elder, Creating invariance to ‘nuisance parameters’ in face recognition, in International Conference on Computer Vision and Pattern Recognition, II, San Diego, 2005, pp. 446–453Google Scholar
  18. 18.
    W.K. Liao, G. Medioni, 3D face tracking and expression inference from a 2D sequence using manifold learning, in International Conference on Computer Vision and Pattern Recognition, Anchorage, 2008Google Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Philippos Mordohai
    • 1
  • Gerard Medioni
    • 2
  1. 1.Stevens Institute of TechnologyPAUSA
  2. 2.University of Southern CaliforniaLos AngelesUSA