Abstract
With the rapid development of the Internet and multimedia technology, the amount of multimedia data on the Internet is escalating exponentially, which has attracted much research attention in the field of Near-Duplicate Video Detection (NDVD). Motivated by the excellent performance of Convolutional Neural Networks (CNNs) in image classification, we bring the powerful discrimination ability of the CNN model to the NDVD system and propose a hierarchical detection method based on the derived deep semantic features from the CNN models. The original CNN features are firstly extracted from the video frames, and then a semantic descriptor and a labels descriptor are obtained respectively based on the basic content unit. Finally, a hierarchical matching scheme is proposed to promote fast near-duplicate video detection. The proposed approach has been tested on the widely used CC_WEB_VIDEO dataset, and has achieved state-of-the-art results with the mean Average Precision (mAP) of 0.977.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wu, X., Hauptmann, A.G., Ngo, C.W.: Practical elimination of near-duplicates from web video search. In: Proceedings of the 15th International Conference on Multimedia, pp. 218–227 (2007)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Szegedy, C., et al.: Going deeper with convolutions. In: Proceedings of the 28th IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–9 (2015)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the 31st IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)
Cai, Y., et al.: Million-scale near-duplicate video retrieval system. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 837–838 (2011)
Paisitkriangkrai, S., Mei, T., Zhang, J., Hua, X.S.: Clip-based hierarchical representation of near-duplicate video detection. Int. J. Comput. Math. 88(18), 3817–3833 (2011)
Douze, M., Jegou, H., Schmid, C.: An image-based approach to video copy detection with spatio-temporal post-filtering. IEEE Trans. Multimed. 12(4), 257–266 (2010)
Law-To, J., Buisson, O., Gouet-Brunet, V., Boujemaa, N.: Robust voting algorithm based on labels of behavior for video copy detection. In: Proceedings of the 14th ACM International Conference on Multimedia, pp. 835–844 (2006)
Harris, C., Stevens, M.: A combined corner and edge detector. In: 4th Alvey Vision Conference, pp. 153–158 (1988)
Ke, Y., Sukthankar, R., Huston, L.: An efficient parts-based near-duplicate and sub-image retrieval system. In: Proceedings of the 12th ACM International Conference on Multimedia, pp. 869–876 (2004)
Song, J., Yang, Y., Huang, Z., Shen, H.T., Hong, R.: Multiple feature hashing for real-time large scale near-duplicate video retrieval. In: Proceedings of the 19th International Conference on Multimedea, pp. 423–432 (2011)
Bohm, C., Pryakhin, A., Schubert, M., Gruber, M., Kunath, P.: ProVeR: probabilistic video retrieval using the Gauss-Tree. In: Proceedings of the 23rd IEEE International Conference on Data Engineering, pp. 1521–1522 (2007)
Weber, R., Sehek, H.J., Blott, S.: A quantitative analysis and performance study for similarity-search methods in high-dimensional spaces. In: Proceedings of the 24th International Conference on Very Large Data Bases, pp. 194–205 (1998)
Weber, R., Böhm, K.: Trading quality for time with nearest-neighbor search. In: Zaniolo, C., Lockemann, Peter C., Scholl, Marc H., Grust, T. (eds.) EDBT 2000. LNCS, vol. 1777, pp. 21–35. Springer, Heidelberg (2000). https://doi.org/10.1007/3-540-46439-5_2
Datar, M., Immorlica, N., lndyk, P., Mirrokni, V.S.: Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of the 20th Annual Symposium on Computational Geometry, pp. 253–262 (2004)
Jiang, Y.G., Wang, J.: Partial copy detection in videos: a benchmark and an evaluation of popular methods. IEEE Trans. Big Data 2, 32–42 (2016)
Wang, L., Bao, Yu., Li, H., Fan, X., Luo, Z.: Compact CNN based video representation for efficient video copy detection. In: Amsaleg, L., Guðmundsson, G.Þ., Gurrin, C., Jónsson, B.Þ., Satoh, S. (eds.) MMM 2017. LNCS, vol. 10132, pp. 576–587. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-51811-4_47
Jiang, Y.G., Ngo, C.W.: Visual word proximity and linguistics for semantic video indexing and near-duplicate retrieval. Comput. Vis. Image Underst. 3(3), 405–414 (2009)
Huang, Z., Shen, H.T., Shao, J., Cui, B., Zhou, X.: Practical online near-duplicate subsequence detection for continuous video streams. IEEE Trans. Multimed. 12(5), 386–398 (2010)
Chou, C.L., Chen, H.T., Lee, S.Y.: Pattern-based near-duplicate video retrieval and localization on web-scale videos. IEEE Trans. Multimed. 17(3), 382–395 (2015)
Kordopatis-Zilos, G., Papadopoulos, S., Patras, I., Kompatsiaris, Y.: Near-Duplicate video retrieval by aggregating intermediate CNN layers. In: Amsaleg, L., Guðmundsson, G.Þ., Gurrin, C., Jónsson, B.Þ., Satoh, S. (eds.) MMM 2017. LNCS, vol. 10132, pp. 251–263. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-51811-4_21
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Liang, S., Wang, P. (2020). An Efficient Hierarchical Near-Duplicate Video Detection Algorithm Based on Deep Semantic Features. In: Ro, Y., et al. MultiMedia Modeling. MMM 2020. Lecture Notes in Computer Science(), vol 11961. Springer, Cham. https://doi.org/10.1007/978-3-030-37731-1_61
Download citation
DOI: https://doi.org/10.1007/978-3-030-37731-1_61
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37730-4
Online ISBN: 978-3-030-37731-1
eBook Packages: Computer ScienceComputer Science (R0)