Using Self-Organizing Maps to Support Video Navigation
Content-based video navigation is an efficient method for browsing video information. A common approach is to cluster shots into groups and visualize them afterwards. In this paper, we present a prototype that follows in general this approach. Unlike existing systems, the clustering is based on a growing self-organizing map algorithm. We focus on studying the applicability of SOMs for video navigation support. We ignore the temporal aspect completely during the clustering, but we project the grouped data on an original time bar control afterwards. This complements our interface by providing – at the same time – an integrated view of time and content based information. The aim is to supply the user with as much information as possible on one single screen, without overwhelming him. Special attention is also given to the interaction possibilities which are hierarchically organized.
KeywordsVideo Content Colour Histogram Shot Boundary Winner Neuron Shot Boundary Detection
Unable to display preview. Download preview PDF.
- 6.Nürnberger, A., Detyniecki, M.: Visualizing changes in data collections using growing self-organizing maps. In: Proc. of Int. Joint Conference on Neural Networks (IJCANN 2002), pp. 1912–1917. IEEE, Los Alamitos (2002)Google Scholar
- 7.Laaksonen, J., Koskela, M., Oja, E.: Picsom: Self-organizing maps for content-based image retrieval. In: Proc. of IEEE Int. Joint Conference on Neural Networks (IJCNN 1999), Washington, DC, July 1999. IEEE, Los Alamitos (1999)Google Scholar
- 8.Nürnberger, A., Klose, A.: Improving clustering and visualization of multimedia data using interactive user feedback. In: Proc. of the 9th Int. Conf. on Inform. Proc. and Management of Uncertainty in Knowledge-Based Systems, pp. 993–999 (2002)Google Scholar
- 9.Bimbo, A.D.: Visual Information Retrieval. Morgan Kaufmann, San Francisco (1999)Google Scholar
- 10.Miene, A., Hermes, T., Ioannidis, G.: Automatic video indexing with the advisor system. In: Proc. Int. Works. on Content-Based Multimedia Indexing, Brescia, Italy (2001)Google Scholar
- 11.Nürnberger, A., Detyniecki, M.: Adaptive multimedia retrieval: From data to user interaction. In: Strackeljan, J., Leiviskä, K., Gabrys, B. (eds.) Do smart adaptive systems exist - Best practice for selection and combination of intelligent methods, Springer, Berlin (2005)Google Scholar
- 12.Browne, P., Smeaton, A.F., Murphy, N., O’Connor, N., Marlow, S., Berrut, C.: Evaluating and combining digital video shot boundary detection algorithms. In: Proc. Irish Machine Vision and Image Processing Conf., Dublin, Ireland (2000)Google Scholar
- 13.Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (1995)Google Scholar