Video Clip Retrieval by Graph Matching
This paper presents a new approach to video clip retrieval using the Earth Mover’s Distance (EMD). The approach builds on the many-to-many match methodology between two graph-based representations. The problem of measuring similarity between two clips is formulated as a graph matching task in two stages. First, a bipartite graph with spatio-temporal neighbourhood is constructed to explore the relation between data points and estimate the relevance between a pair of video clips. Secondly, using the EMD, the problem of matching a clip pair is converted to computing the minimum cost of transportation within the spatio-temporal graph. Experimental results on the UCF YouTube Action dataset show that the presented work attained a significant improvement in retrieval capability over conventional techniques.
Keywordsgraph matching Earth Mover’s Distance video retrieval
Unable to display preview. Download preview PDF.
- 1.Chen, L., Chua, T.S.: A match and tiling approach to content-based video retrieval. In: Proceedings of IEEE International Conference on Multimedia and Expo. (2001)Google Scholar
- 3.Zhou, F., de la Torre, F.: Factorized graph matching. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2012)Google Scholar
- 4.Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. International Journal of Computer Vision (2000)Google Scholar
- 5.van der Maaten, L.J.P., Postma, E.O., van den Herik, H.J.: Dimensionality reduction: A Comparative Review (2008)Google Scholar
- 6.Liu, J., Luo, J., Shah, M.: Recognizing realistic actions from videos in the wild. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2009)Google Scholar
- 8.Scovanner, P., Ali, S., Shah, M.: A 3-dimensional SIFT descriptor and its application to action recognition. In: Proceedings of ACM Multimedia (2007)Google Scholar
- 9.Plummer, D., Lovász, L.: Matching theory. Elsevier Science (1986)Google Scholar