Hashing-Based Approximate DBSCAN
- 675 Downloads
Analyzing massive amounts of data and extracting value from it has become key across different disciplines. As the amounts of data grow rapidly, however, current approaches for data analysis struggle. This is particularly true for clustering algorithms where distance calculations between pairs of points dominate overall time.
Crucial to the data analysis and clustering process, however, is that it is rarely straightforward. Instead, parameters need to be determined through several iterations. Entirely accurate results are thus rarely needed and instead we can sacrifice precision of the final result to accelerate the computation. In this paper we develop ADvaNCE, a new approach to approximating DBSCAN. ADvaNCE uses two measures to reduce distance calculation overhead: (1) locality sensitive hashing to approximate and speed up distance calculations and (2) representative point selection to reduce the number of distance calculations. Our experiments show that our approach is in general one order of magnitude faster (at most 30x in our experiments) than the state of the art.
KeywordsExecution Time Distance Calculation Range Query Query Point Cell Width
- 3.Ankerst, M., Breunig, M.M., Kriegel, H.-P., Sander, J.: OPTICS: ordering points to identify the clustering structure. In: SIGMOD 1999 (1999)Google Scholar
- 4.Bache, K., Lichman, M.: UCI Machine Learning Repository (2013)Google Scholar
- 6.Borah, B., Bhattacharyya, D.: An improved sampling-based DBSCAN for large spatial databases. In: Conference on Intelligent Sensing and Information Processing (2004)Google Scholar
- 9.Datar, M., Immorlica, N., Indyk, P., Mirrokni, V.S.: Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of the Twentieth Annual Symposium on Computational Geometry, SCG 2004 (2004)Google Scholar
- 10.Ester, M., Kriegel, H.-P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the 2nd International Conference on Knowledge Discovery and and Data Mining (1996)Google Scholar
- 11.Gan, J., Tao, Y.: DBSCAN revisited: mis-claim, un-fixability, and approximation. In: SIGMOD 2015 (2015)Google Scholar
- 12.Gunawan, A.: A faster algorithm for DBSCAN. Master’s thesis, Technical University of Eindhoven, March 2013Google Scholar
- 13.Patwary, M., Ali, M., Satish, N., Sundaram, N., Manne, F., Habib, S., Dubey, P.: Pardicle: parallel approximate density-based clustering. In: Supercomputing 2014 (2014)Google Scholar
- 14.Viswanath, P., Pinkesh, R.: l-DBSCAN: a fast hybrid density based clustering method. In: Proceedings of the Conference on Pattern Recognition (2006)Google Scholar
- 15.Yeganeh, S., Habibi, J., Abolhassani, H., Tehrani, M., Esmaelnezhad, J.: An approximation algorithm for finding skeletal points for density based clustering approaches. In: Symposium on Computational Intelligence and Data Mining (2009)Google Scholar