Abstract
The mean-shift algorithm is a popular algorithm in computer vision and image processing. It can also be cast as a minimum gamma-divergence estimation. In this paper we focus on the “blurring” mean-shift algorithm, which is one version of the mean-shift process that successively blurs the dataset. The analysis of the blurring mean-shift is relatively more complicated compared to the nonblurring version, yet the algorithm convergence and the estimation consistency have not been well studied in the literature. In this paper we prove both the convergence and the consistency of the blurring mean-shift. We also perform simulation studies to compare the efficiency of the blurring and the nonblurring versions of the mean-shift algorithms. Our results show that the blurring mean-shift has more efficiency.
Similar content being viewed by others
References
Carreira-Perpinan, M.A. (2006). Fast nonparametric clustering with gaussian blurring mean-shift. In: Proceedings of the 23rd international conference machine learning (ICML 2006) (pp. 153–160).
Carreira-Perpinan, M.A. (2007). Gaussian mean-shift is an em algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5), 767–776.
Chang-Chien, S.J., Hung, W.L., Yang, M.S. (2012). On mean shift-based clustering for circular data. Soft Computing, 16(6), 1043–1060.
Chen, T.L., Shiu, S.Y. (2007). A clustering algorithm by self-updating process. In: JSM proceedings, statistical computing section, Salt Lake City, Utah (pp. 2034–2038).
Chen, T.L., Hsieh, D.N., Hung, H., Tu, I.P., Wu, P.S., Wu, Y.M., Chang, W.H., Huang, S.Y. (2013). \(\gamma \)-SUP: a clustering algorithm for cryo-electron microscopy images of asymmetric particles. Annals of Applied Statistcs (to appear).
Cheng, Y.Z. (1995). Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(8), 790–799.
Comaniciu, D., Comaniciu, P. (2001). The variable bandwidth mean shift and data-driven scale selection. In: Proceedings of the IEEE international conference on computer vision (ICCV) (pp. 438–446).
Comaniciu, D., Meer, P. (2000). Real-time tracking of non-rigid objects using mean shift. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) (pp. 142–149).
Comaniciu, D., Meer, P. (2002). Mean shift: a robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), 603–619.
Fashing, M., Tomasi, C. (2005). Mean shift is a bound optimization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3), 471–474.
Friedman, L., Netanyahu, N. S., Shoshany, M. (2013). Mean shift-based clustering of remotely sensed data with agricultural and land-cover applications. International Journal of Remote Sensing, 34(17), 6037–6053.
Fujisawa, H., Eguchi, S. (2008). Robust parameter estimation with a small bias against heavy contamination. Journal of Multivariate Analysis, 99(9), 2053–2081.
Fukunaga, K., Hostetler, L.D. (1975). The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Transactions on Information Theory, 21(1), 32–40.
Leichter, I. (2012). Mean shift trackers with cross-bin metrics. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(4), 695–706.
Li, X., Hu, Z., Wu, F. (2007). A note on the convergence of the mean shift. Pattern Recognition, 40(6), 1756–1762.
Liu, Y., Li, S.Z., Wu, W., Huang, R. (2013). Dynamics of a mean-shift-like algorithm and its applications on clustering. Information Processing Letters, 113(1–2), 8–16.
Windham, M.P. (1995). Robustifying model fitting. Journal of the Royal Statistical Society Series B Methodological, 57(3), 599–609.
Wu, K., Yang, M. (2007). Mean shift-based clustering. Pattern Recognition, 40(11), 3035–3052.
Zhang, X., Cui, Y., Li, D., Liu, X., Zhang, F. (2012). An adaptive mean shift clustering algorithm based on locality-sensitive hashing. Optik International Journal for Light and Electron Optics, 123(20), 1891–1894.
Acknowledgments
The author would like to thank Pei Lun Tseng for suggesting a shorter proof on Lemma 2, and Professor Chii-Ruey Hwang and Professor Su-Yun Huang for inputs and discussions.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work is supported by the National Science Council, Taiwan, Grant Nos. NSC 96-2118-M-001-007-.
About this article
Cite this article
Chen, TL. On the convergence and consistency of the blurring mean-shift process. Ann Inst Stat Math 67, 157–176 (2015). https://doi.org/10.1007/s10463-013-0443-8
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10463-013-0443-8