Nonlinear Dimensionality Reduction Using Circuit Models
The problem addressed in nonlinear dimensionality reduction, is to find lower dimensional configurations of high dimensional data, thereby revealing underlying structure. One popular method in this regard is the Isomap algorithm, where local information is used to find approximate geodesic distances. From such distance estimations, lower dimensional representations, accurate on a global scale, are obtained by multidimensional scaling. The property of global approximation sets Isomap in contrast to many competing methods, which approximate only locally.
A serious drawback of Isomap is that it is topologically instable, i.e., that incorrectly chosen algorithm parameters or perturbations of data may abruptly alter the resulting configurations. To handle this problem, we propose new methods for more robust approximation of the geodesic distances. This is done using a viewpoint of electric circuits. The robustness is validated by experiments. By such an approach we achieve both the stability of local methods and the global approximation property of global methods.
KeywordsRoot Mean Square Error Root Mean Square Circuit Model Geodesic Distance Adjacency Graph
- 1.Andersson, F., Nilsson, J.: Circuit models for manifold learning. Tech. rep., Lund University (2005)Google Scholar
- 2.Balasubramanian, M., Schwartz, E.L., Tenenbaum, J.B., de Silva, V., Langford, J.C.: The Isomap algorithm and topological stability. Science 295 (2002)Google Scholar
- 4.Bernstein, M., de Silva, V., Langford, J.C., Tenenbaum, J.B.: Graph approximations to geodesics on embedded manifolds. Tech. rep., Stanford University (2000)Google Scholar
- 7.de Silva, V., Tenenbaum, J.: Global versus local methods in nonlinear dimensionality reduction. Neural Information Processing Systems 15, 705–712 (2003)Google Scholar
- 9.Ham, J., Lee, D.D., Mika, S., Schölkopf, B.: A kernel view of the dimensionality reduction of manifolds. In: ICML 2004: Twenty-first international conference on Machine learning. ACM Press, New York (2004)Google Scholar
- 11.Lafon, S.: Diffusion maps and geometric harmonics. Doctorate thesis, Yale University (2004)Google Scholar