Quick Shift and Kernel Methods for Mode Seeking

  • Andrea Vedaldi
  • Stefano Soatto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5305)


We show that the complexity of the recently introduced medoid-shift algorithm in clustering N points is O(N2), with a small constant, if the underlying distance is Euclidean. This makes medoid shift considerably faster than mean shift, contrarily to what previously believed. We then exploit kernel methods to extend both mean shift and the improved medoid shift to a large family of distances, with complexity bounded by the effective rank of the resulting kernel matrix, and with explicit regularization constraints. Finally, we show that, under certain conditions, medoid shift fails to cluster data points belonging to the same mode, resulting in over-fragmentation. We propose remedies for this problem, by introducing a novel, simple and extremely efficient clustering algorithm, called quick shift, that explicitly trades off under- and over-fragmentation. Like medoid shift, quick shift operates in non-Euclidean spaces in a straightforward manner. We also show that the accelerated medoid shift can be used to initialize mean shift for increased efficiency. We illustrate our algorithms to clustering data on manifolds, image segmentation, and the automatic discovery of visual categories.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bach, F.R., Jordan, M.I.: Kernel independent componet analysis. Journal of Machine Learninig Research 3(1) (2002)Google Scholar
  2. 2.
    Carreira-Perpiñán, M.: Fast nonparametric clustering with gaussian blurring mean-shift. In: Proc. ICML (2006)Google Scholar
  3. 3.
    Cheng, Y.: Mean shift, mode seeking, and clustering. PAMI 17(8) (1995)Google Scholar
  4. 4.
    Choi, H., Choi, S.: Robust kernel isomap. Pattern Recognition (2006)Google Scholar
  5. 5.
    Comaniciu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. PAMI 24(5) (2002)Google Scholar
  6. 6.
    Comaniciu, D., Ramesh, V., Meer, P.: The variable bandwidth mean shift and data-driven scale selection. In: Proc. ICCV (2001)Google Scholar
  7. 7.
    Csurka, G., Dance, C.R., Dan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Proc. ECCV (2004)Google Scholar
  8. 8.
    Fine, S., Scheinberg, K.: Efficient SVM training using low-rank kernel representations. Journal of Machine Learninig Research (2001)Google Scholar
  9. 9.
    Fukunaga, K., Hostler, L.D.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. 21(1) (1975)Google Scholar
  10. 10.
    Grauman, K., Darrell, T.: Unsupervised learning of categories from sets of partially matching image features. In: Proc. CVPR (2006)Google Scholar
  11. 11.
    Hein, M., Bousquet, O.: Hilbertian metrics and positive definite kernels on probability measures. In: Proc. AISTAT (2005)Google Scholar
  12. 12.
    Knuth, D.: The Art of Computer Programming: Seminumerical Algorithms, 3rd edn., vol. 2 (1998)Google Scholar
  13. 13.
    Koontz, W.L.G., Narendra, P., Fukunaga, K.: A graph-theoretic approach to nonparametric cluster analyisis. IEEE Trans. on Computers c-25(9) (1976)Google Scholar
  14. 14.
    Lowe, D.: Implementation of the scale invariant feature transform (2007), http://www.cs.ubc.ca/~lowe/keypoints/
  15. 15.
    Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.-R.: Fisher discriminant analysis with kernels. In: Proc. IEEE Neural Networks for Signal Processing Workshop (1999)Google Scholar
  16. 16.
    Paris, S., Durand, F.: A topological approach to hierarchical segmentation using mean shift. In: Proc. CVPR (2007)Google Scholar
  17. 17.
    Sain, S.R.: Multivariate locally adaptive density estimation. Comp. Stat. and Data Analysis, 39 (2002)Google Scholar
  18. 18.
    Schölkopf, B.: The kernel trick for distances. In: Proc. NIPS (2001)Google Scholar
  19. 19.
    Schölkopf, B., Smola, A.J.: Learning with Kernels. MIT Press, Cambridge (2002)Google Scholar
  20. 20.
    Sheikh, Y.A., Khan, E.A., Kanade, T.: Mode-seeking by medoidshifts. In: Proc. CVPR (2007)Google Scholar
  21. 21.
    Subbarao, R., Meer, P.: Nonlinear mean shift for clustering over analytic manifolds. In: Proc. CVPR (2006)Google Scholar
  22. 22.
    Sundaramoorthy, G., Yezzi, A., Mennucci, A.: Sobolev active contours. Int. J. Comput. Vision 73(3) (2007)Google Scholar
  23. 23.
    Yang, C., Duraiswami, R., Gumerov, N.A., Davis, L.: Improved fast Gauss transform and efficient kernel density estimation. In: Proc. ICCV (2003)Google Scholar
  24. 24.
    Yuan, X., Li, S.Z.: Half quadric analysis for mean shift: with extension to a sequential data mode-seeking method. In: Proc. CVPR (2007)Google Scholar
  25. 25.
    Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: A comprehensive study IJCV (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Andrea Vedaldi
    • 1
  • Stefano Soatto
    • 1
  1. 1.Computer Science DepartmentUniversity of CaliforniaLos Angeles 

Personalised recommendations