Abstract
Professional video searchers typically have to search for particular video fragments in a vast video archive that contains many hours of video data. Without having the right video archive exploration tools, this is a difficult and time consuming task that induces hours of video skimming. We propose the video archive explorer, a video exploration tool that provides visual representations of automatically detected concepts to facilitate individual and collaborative video search tasks. This video archive explorer is developed by employing a user-centred methodology, which ensures that the tool is more likely to fit to the end user needs. A qualitative evaluation with professional video searchers shows that the combination of automatic video indexing, interactive visualisations and user-centred design can result in an increased usability, user satisfaction and productivity.
Similar content being viewed by others
References
Adcock J, Cooper M, Pickens J (2008) Experiments in interactive video search by addition and subtraction. In: Proceedings of the 2008 international conference on content-based image and video retrieval, CIVR ’08, pp 465–474. ACM, New York, NY, USA
Arnowitz J, Arent M, Berger N (2006) Effective prototyping for software makers (the Morgan Kaufmann series in interactive technologies). Morgan Kaufmann, San Francisco, CA, USA
Beyer H, Holtzblatt K (1998) Contextual design: defining customer-centered systems. Morgan Kaufmann. ISBN: 1-55680-411-1
Boreczky J, Girgensohn A (2000) Gene Golovchinsky, and Shingo Uchihashi. An interactive comic book presentation for exploring video. In: CHI ’00: proceedings of the SIGCHI conference on human factors in computing systems, pp 185–192. ACM, New York, NY, USA
Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan Kaufmann
Cheng K-Y, Luo S-J, Chen B-Y, Chu H-H (2009) Smartplayer: user-centric video fast-forwarding. In: CHI ’09: proceedings of the 27th international conference on human factors in computing systems, pp 789–798. ACM, New York, NY, USA
Christel MG (2008) Supporting video library exploratory search: when storyboards are not enough. In: CIVR ’08: proceedings of the 2008 international conference on content-based image and video retrieval, pp 447–456. ACM, New York, NY, USA
Christel MG, Smith MA, Taylor CR, Winkler DB (1998) Evolving video skims into useful multimedia abstractions. In: CHI ’98: proceedings of the SIGCHI conference on human factors in computing systems, pp 171–178. ACM Press/Addison-Wesley, New York, NY, USA
Cilella S (2011) Did you ever know that you’re my hero?: the power of storytelling. Interactions 18:62–66
Dragicevic P, Ramos G, Bibliowitcz J, Nowrouzezahrai D, Balakrishnan R, Singh K (2008) Video browsing by direct manipulation. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, CHI ’08, pp 237–246. ACM, USA, New York, NY
Grün C, Gerken J, Jetter H-C, König WA, Reiterer H (2005) Mediovis—a user-centred library metadata browser. In: ECDL 2005: proceedings of the 9th European conference on research and advanced technology for digital libraries 2005, pp 174–185. Springer
Haesen M, Coninx K, Van den Bergh J, Luyten K (2008) Muicser: a process framework for multi-disciplinary user-centred software engineering processes. In: HCSE ’08: second conference on human-centered software engineering, pp 150–165
Haesen M, Meskens J, Luyten K, Coninx K (2010) Draw me a storyboard: incorporating principles and techniques of comics to ease communication and artefact creation in user-centred design. In: In Proc. of BCS conference on human computer interaction
Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST ’05: proceedings of the 18th annual ACM symposium on user interface software and technology, pp 115–118. ACM, New York, NY, USA
Haubold A, Kender JR (2007) Vast mm: multimedia browser for presentation video. In: CIVR ’07: proceedings of the 6th ACM international conference on image and video retrieval, pp 41–48. ACM, New York, NY, USA
Hauptmann AG, Christel MG, Yan R (2008) Video retrieval based on semantic concepts. Proc IEEE 96(4):602–622
Hauptmann E, Baron RV, Chen MY, Christel M, Mummert L, Schlosser S, Sun X, Valdes V, Yang J (2008) Informedia trecvid2008: exploring new frontiers. In: Trecvid 2008
Heilig M, Demarmels M, König WA, Gerken J, Rexhausen S, Jetter H-C, Reiterer H (2008) Mediovis: visual information seeking in digital libraries. In: Proceedings of the working conference on advanced visual interfaces, AVI ’08, pp 490–491. ACM, New York, NY, USA
Hürst W, Götz G, Jarvers P (2004) Advanced user interfaces for dynamic video browsing. In: Proceedings of the 12th annual ACM international conference on multimedia, MULTIMEDIA ’04, pp 742–743. ACM, New York, NY, USA
International Standards Organization (1999) ISO 13407. Human centred design process for interactive systems. Geneva, Swiss
Kankanhalli MS, Rui Y (2008) Application potential of multimedia information retrieval. Proc IEEE 96(4):712–720
Karrer T, Weiss M, Lee E, Borchers J (2008) Dragon: a direct manipulation interface for frame-accurate in-scene video navigation. In: CHI ’08: proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, pp 247–250. ACM, New York, NY, USA
Masui T, Kashiwagi K, Borden IV GR (1995) Elastic graphical interfaces to precise data manipulation. In: Conference companion on human factors in computing systems, CHI ’95, pp 143–144. ACM, New York, NY, USA
Meskens J, Luyten K, Coninx K (2010) D-macs: building multi-device user interfaces by demonstrating, sharing and replaying design actions. In: Proceedings of the 23nd annual ACM symposium on user interface software and technology, UIST ’10, pp 129–138. ACM, New York, NY, USA
Morris MR (2007) Interfaces for collaborative exploratory web search: motivations and directions for multi-user design. In: ACM SIGCHI 2007 workshop on exploratory search and HCI: designing and evaluating interfaces to support exploratory search interaction, pp 9–12
Patton J (2008) Consider multiple solutions. IEEE Softw 25:72–73
Pham PT, Moens M-F, Tuytelaars T (2010) Cross-media alignment of names and faces. IEEE Trans Multimedia 12(1):13–27
Pham PT, Moens M-F, Tuytelaars T (2010) Naming persons in news video with label propagation. In: International workshop on visual content identification and search (VCIDS), pp 1528–1533
Plaisant C, Milash B, Rose A, Widoff S, Shneiderman B (1996) Lifelines: visualizing personal histories. In: CHI ’96: proceedings of the SIGCHI conference on human factors in computing systems, pp 221–ff. ACM, New York, NY, USA
Poulisse G-J, Moens M-F, Dekens T, Deschacht K (2010) News story segmentation in multiple modalities. Multimed Tools Appl 48:3–22
Redmond-Pyle D, Moore A (1995) Graphical user interface design and evaluation. Prentice Hall, London
Smeaton A, Lee H, Foley C, McGivney S (2007) Collaborative video searching on a tabletop. Multimed Syst 12:375–391. doi:10.1007/s00530-006-0064-7
Smeaton AF, Over P, Kraaij W (2006) Evaluation campaigns and trecvid. In: Proceedings of the 8th ACM international workshop on multimedia information retrieval, MIR ’06, pp 321–330. ACM, New York, NY, USA
Snoek CGM, Worring M, de Rooij O, van de Sande KEA, Yan R, Hauptmann AG (2008) VideOlympics: real-time evaluation of multimedia retrieval systems. IEEE Multimed 15(1):86–91
Tang A, Greenberg S, Fels S (2008) Exploring video streams using slit-tear visualizations. In: AVI ’08: proceedings of the working conference on advanced visual interfaces, pp 191–198. ACM, New York, NY, USA
Twidale MB, Nichols DM, Paice CD (1997) Browsing is a collaborative process. Inf Process Manag 33:761–783
Uchihashi S, Foote J, Girgensohn A, Boreczky J (1999) Video manga: generating semantically meaningful video summaries. In: MULTIMEDIA ’99: proceedings of the seventh ACM international conference on multimedia (part 1), pp 383–392. ACM, New York, NY, USA
University of Konstanz HCI Group, Mediovis—project description. http://hci.uni-konstanz.de/index.php?a=research&b=projects&c=16314278&lang=en#description
Wang S, Jing F, He J, Du Q, Zhang L (2007) Igroup: presenting web image search results in semantic clusters. In: Proceedings of the SIGCHI conference on human factors in computing systems, CHI ’07, pp 587–596. ACM, New York, NY, USA
Wassink I, Kulyk O, van Dijk EMAG, van der Veer GC, van der Vet PE (2008) Applying a user-centred approach to interactive visualization design. In: Trends in interactive visualization. Springer, London. ISBN: 978-1-84800-268-5
Worring M, Snoek CGM, de Rooij O, Nguyen GP, Smeulders AWM (2007) The MediaMill semantic video search engine. In: Proceedings of the IEEE international conference on acoustics, speech, and signal processing. Invited paper, pages –. Honolulu, Hawaii, USA
Zhang HJ, Tan SY, Smoliar SW, Yihong G (1995) Automatic parsing and indexing of news video. Multimed Syst 2:256–266. doi:10.1007/BF01225243
Acknowledgements
This research was supported by the IWT Project AMASS+ + (SBO-060051). We would like to thank all members of the AMASS+ + user committee for their feedback about the results discussed during the half-yearly user committee meetings. Special thanks to the Flemish broadcasting company VRT to contribute to the user studies. Grateful acknowledgement is given to Koen Deschacht, Wim De Smet, Scott Martens, Ineke Schuurman, Vincent Vandeghinste, Frank Van Eynde and Luc Van Gool. Furthermore, we would like to thank Jimmy Cleuren for his contribution to the high-fidelity prototypes and Karel Robert for the graphic design of the user interface.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Haesen, M., Meskens, J., Luyten, K. et al. Finding a needle in a haystack: an interactive video archive explorer for professional video searchers. Multimed Tools Appl 63, 331–356 (2013). https://doi.org/10.1007/s11042-011-0809-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-011-0809-y