Graph-Based Browsing for Large Video Collections
We present a graph-based browsing system for visually searching video clips in large collections. It is an extension of a previously proposed system ImageMap which allows visual browsing in millions of images using a hierarchical pyramid structure of images sorted by their similarities. Image subsets can be explored through a viewport at different pyramid levels, however, due to the underlying 2D-organization the high dimensional relationships between all images could not be represented. In order to preserve the complex inter-image relationships we propose to use a hierarchical graph where edges connect related images. By traversing this graph the users may navigate to other similar images. Different visualization and navigation modes are available. Various filters and search tools such as search by example, color, or sketch may be applied. These tools help to narrow down the amount of video frames to be inspected or to direct the view to regions of the graph where matching frames are located.
KeywordsContent-based Video Retrieval Exploration Image Browsing Visualization Navigation
Unable to display preview. Download preview PDF.
- 1.Schoeffmann, K., et al.: The Video Browser Showdown: A Live Evaluation of Interactive Video Search Tools. International Journal of Multimedia Information Retrieval (MMIR) 3(2), 113–127 (2014)Google Scholar
- 2.Barthel, K.U.: Automatic Image Sorting using MPEG-7 Descriptors. In: ICOB 2005, Workshop on Immersive Communication and Broadcast Systems (2005)Google Scholar
- 3.Barthel, K.U., Hezel, N., Mackowiak, R.: ImageMap - Visually Browsing Millions of Images. Submitted to 21st International Conference on Multimedia Modelling (2015)Google Scholar
- 4.Haubold, A.: Indexing and browsing unstructured videos using visual, audio, textual, and facial cues. Doctoral Dissertation, Columbia University New York, NY (2008)Google Scholar