Eigensolver Methods for Progressive Multidimensional Scaling of Large Data

  • Ulrik Brandes
  • Christian Pich
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4372)


We present a novel sampling-based approximation technique for classical multidimensional scaling that yields an extremely fast layout algorithm suitable even for very large graphs. It produces layouts that compare favorably with other methods for drawing large graphs, and it is among the fastest methods available. In addition, our approach allows for progressive computation, i.e. a rough approximation of the layout can be produced even faster, and then be refined until satisfaction.


  1. 1.
    Basalaj, W.: Incremental multidimensional scaling method for database visualization. In: Proc. VDA, pp. 149–158 (1999)Google Scholar
  2. 2.
    Bengio, Y., Paiement, J.-F., Vincent, P., Delalleau, O., Le Roux, N., Ouimet, M.: Out-of-sample extensions for LLE, Isomap, MDS, eigenmaps, and spectral clustering. In: NIPS, pp. 307–311 (2004)Google Scholar
  3. 3.
    Borg, I., Groenen, P.: Modern Multidimensional Scaling. Springer, Heidelberg (2005)MATHGoogle Scholar
  4. 4.
    Buja, A., Swayne, D.F.: Visualization methodology for multidimensional scaling. J. Classification 19, 7–43 (2002)MATHCrossRefMathSciNetGoogle Scholar
  5. 5.
    Burges, C.J.C.: Geometric methods for feature extraction and dimensional reduction. Technical report, Microsoft Research (2004)Google Scholar
  6. 6.
    Chalmers, M.: A linear iteration time layout algorithm for visualizing high-dimensional data. In: Proc. InfoVis, pp. 127–132. IEEE Computer Society Press, Los Alamitos (1996)Google Scholar
  7. 7.
    Civril, A., Magdon-Ismail, M., Bocek-Rivele, E.: SDE: Graph drawing using spectral distance embedding. In: Healy, P., Nikolov, N.S. (eds.) GD 2005. LNCS, vol. 3843, pp. 512–513. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Cohen, J.D.: Drawing graphs to convey proximity. ACM Transactions on Computer-Human Interaction 4(3), 197–229 (1997)CrossRefGoogle Scholar
  9. 9.
    Cox, T., Cox, M.: Multidimensional Scaling. Chapman and Hall, Boca Raton (2001)MATHGoogle Scholar
  10. 10.
    de Silva, V., Tenenbaum, J.: Global versus local methods in nonlinear dimensionality reduction. In: Proc. NIPS, pp. 721–728 (2003)Google Scholar
  11. 11.
    Faloutsos, C., Lin, K.: FastMap: A fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets. In: Proc. ACM SIGMOD, pp. 163–174. ACM Press, New York (1995)CrossRefGoogle Scholar
  12. 12.
    Gansner, E.R., Koren, Y., North, S.: Graph drawing by stress majorization. In: Pach, J. (ed.) GD 2004. LNCS, vol. 3383, pp. 239–250. Springer, Heidelberg (2005)Google Scholar
  13. 13.
    Golub, G.H., Loan, C.F.v.: Matrix computations. Johns Hopkins University Press, Baltimore (1996)MATHGoogle Scholar
  14. 14.
    Hachul, S., Jünger, M.: An experimental comparison of fast algorithms for drawing general large graphs. In: Healy, P., Nikolov, N.S. (eds.) GD 2005. LNCS, vol. 3843, pp. 235–250. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  15. 15.
    Harel, D., Koren, Y.: Graph drawing by high-dimensional embedding. In: Goodrich, M.T., Kobourov, S.G. (eds.) GD 2002. LNCS, vol. 2528, pp. 388–393. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  16. 16.
    Jourdan, F., Melançon, G.: Multiscale hybrid MDS. In: Proc. IV, pp. 388–393. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  17. 17.
    Kadushin, C.: Personal communicationGoogle Scholar
  18. 18.
    Kamada, T., Kawai, S.: An algorithm for drawing general undirected graphs. Information Processing Letters 31, 7–15 (1989)MATHCrossRefMathSciNetGoogle Scholar
  19. 19.
    Koren, Y.: Graph drawing by subspace optimization. In: Proc. VisSym, pp. 65–74 (2004)Google Scholar
  20. 20.
    Koren, Y., Carmel, L., Harel, D.: ACE: A fast multiscale eigenvectors computation for drawing huge graphs. In: Proc. InfoVis, pp. 137–144. IEEE Computer Society Press, Los Alamitos (2002)Google Scholar
  21. 21.
    Koren, Y., Harel, D.: One-dimensional layout optimization, with applications to graph drawing by axis separation. Computational Geometry: Theory and Applications 32, 115–138 (2005)MATHMathSciNetGoogle Scholar
  22. 22.
    Kruskal, J.B.: Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29(1), 1–27 (1964)MATHCrossRefMathSciNetGoogle Scholar
  23. 23.
    Kruskal, J.B., Hart, R.E.: A geometric interpretation of diagnostic data from a digital machine: Based on a study of the Morris, Illinois, Electronic Central Office. Bell Sys. Tech. J. 45(8), 1299–1338 (1966)Google Scholar
  24. 24.
    Kruskal, J.B., Seery, D.: Designing network diagrams. In: Proc. First General Conference on Social Graphics, pp. 22–50 (1980)Google Scholar
  25. 25.
    Morrison, A., Chalmers, M.: Improving hybrid MDS with pivot-based searching. In: Proc. InfoVis, pp. 85–90. IEEE Computer Society Press, Los Alamitos (2003)Google Scholar
  26. 26.
    Morrison, A., Ross, G., Chalmers, M.: A hybrid layout algorithm for sub-quadratic multidimensional scaling. In: Proc. InfoVis, pp. 152–158. IEEE Computer Society Press, Los Alamitos (2002)Google Scholar
  27. 27.
    Platt, J.C.: FastMap, MetricMap, and Landmark MDS are all Nyström Algorithms. Technical report, Microsoft Research (2004)Google Scholar
  28. 28.
    Saul, L.K., Weinberger, K.Q., Ham, J.H., Sha, F., Lee, D.D.: Spectral methods for dimensionality reduction. In: Schölkopf, B., Chapelle, O., Zien, A. (eds.) Semi-Supervised Learning, MIT Press, Cambridge (To appear, 2006)Google Scholar
  29. 29.
    Silva, J.G., Marques, J.S., Lemos, J.M.: Selecting landmark points for sparse manifold learning. In: Proc. NIPS (2005)Google Scholar
  30. 30.
    Torgerson, W.S.: Multidimensional scaling: I. Theory and Method. Psychometrika 17, 401–419 (1952)MATHCrossRefMathSciNetGoogle Scholar
  31. 31.
    Wang, J.T.-L., Wang, X., Lin, K., Shasha, D., Shapiro, B.A., Zhang, K.: Evaluating a class of distance-mapping algorithms for data mining and clustering. In: Proc. KDD, pp. 307–311 (1999)Google Scholar
  32. 32.
    Williams, M., Munzner, T.: Steerable, progressive multidimensional scaling. In: Proc. InfoVis, pp. 57–64. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar

Copyright information

© Springer Berlin Heidelberg 2007

Authors and Affiliations

  • Ulrik Brandes
    • 1
  • Christian Pich
    • 1
  1. 1.Department of Computer & Information Science, University of KonstanzGermany

Personalised recommendations