Abstract
Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bernhaupt, R., Obrist, M., Tscheligi, M.: Usability and usage of iTV services: lessons learned in an Austrian field trial. ACM Computers in Entertainment 5(2) (2007)
Browne, P., Czirjek, C., Gaughan, G., Gurrin, C., Jones, G., Lee, H., Marlow, S., Mc-Donald, K., Murphy, N., O’Connor, N.E., O’Hare, N., Smeaton, A.F., Ye, J.: Dublin City University Video Track Experiments for TREC 2003. In: Proceedings of the TRECVid Workshop, Gaithersburg (2003)
Gurrin, C., MacNeela, P., Smeaton, A.F., Lee, H., Browne, P., McDonald, K.: Fıschlar-Nursing, Using Digital Video Libraries to Teach Nursing Students. In: WBE 2004 - IASTED International Conference on Web-Based Education, pp. 111–116 (2004)
Lanagan, J., Smeaton, A.F.: SportsAnno: What Do You Think? In: Proc. of Large-Scale Semantic Access to Content (Text, Image, Video and Sound) RIAO (2007)
Lee, H., Smeaton, A.F., O’Connor, N., Smyth, B.: User Evaluation of Físchlár-News: An Automatic Broadcast News Delivery System. TOIS - ACM Transactions on Information Systems 24(2), 145–189 (2006)
Lee, H., Smeaton, A.F., O’Connor, N., Jones, G., Blighe, M., Byrne, D., Doherty, A., Gurrin, C.: Constructing a SenseCam Visual Diary as a Media Process. Multimedia Systems Journal, Special Issue on Canonical Processes of Media Production 14(6), 341–349 (2008)
Lee, H., Smeaton, A.F.: Designing the User Interface for the Fıschlar Digital Video Library. Journal of Digital Information 2(4) (2002)
Lehane, B., O’Connor, N.E., Lee, H., Smeaton, A.F.: Indexing of Fictional Video Content for Event Detection and Summarisation. EURASIP Journal on Image and Video Processing, 1–15 (2007)
Lehane, B., O’Connor, N.E., Smeaton, A., Lee, H.: A System for Event-Based Film Browsing. In: Göbel, S., Malkewitz, R., Iurgel, I. (eds.) TIDSE 2006. LNCS, vol. 4326, pp. 334–345. Springer, Heidelberg (2006)
McKeown, K., Barzilay, R., Evans, D., Hatzivassiloglou, V., Klavans, J., Nenkovo, A., Sable, C., Schiffman, B., Sigelman, S.: Tracking and summarazing news on a daily basis with Columbia’s Newsblaster. In: Proc. of the Human Language Technology Conference (2002)
Mohamad Ali, N., Smeaton, A.F.: Are Visual Informatics Actually Useful in Practice: A Study in a Film Studies Context. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 811–821. Springer, Heidelberg (2009)
Mohamad Ali, N., Smeaton, A.F., Lee, H., Brereton, P.: Developing, Deploying and Assessing the Usage of a Movie Archive System. In: HCI 2009. LNCS, vol. 5613, pp. 567–576. Springer, Heidelberg (2009)
Nielsen, J.: Usability Engineering. Academic Press, Inc. (1993)
O’Hare, N., Smeaton, A.F.: Context-Aware Person Identification in Personal Photo Collections. IEEE Transactions on Multimedia, Special Issue on Integration of Context and Content for Multimedia Management 11(2), 220–228 (2009)
O’Hare, N., Lee, H., Cooray, S., Gurrin, C., Jones, G., Malobabic, J., O’Connor, N., Smeaton, A.F., Uscilowski, B.: MediAssist: Using Content-Based Analysis and Context to Manage Personal Photo Collections. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds.) CIVR 2006. LNCS, vol. 4071, pp. 529–532. Springer, Heidelberg (2006)
Pielot, M., Boll, S.: Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems. In: Floréen, P., Krüger, A., Spasojevic, M. (eds.) Pervasive Computing. LNCS, vol. 6030, pp. 76–93. Springer, Heidelberg (2010)
Smeaton, A.F., Gurrin, C., Lee, H., McDonald, K., Murphy, N., O’Connor, N.E., O’Sullivan, D., Smyth, B., Wilson, D.: The Fıschlar-News-Stories System: Personalised Access to an Archive of TV News. In: RIAO 2004 - Coupling Approaches, Coupling Media and Coupling Languages for Information Retrieval, pp. 3–17 (2004)
Smeaton, A.F., Lee, H., McDonald, K.: Experiences of Creating Four Video Library Collections with the Fıschlar System. International Journal on Digital Libraries 4(1), 42–44 (2004)
Smeaton, A.F., Over, P., Doherty, A.: Video Shot Boundary Detection: Seven Years of TRECVid Activity. Computer Vision and Image Understanding 114(4), 411–418 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mohamad Ali, N., Lee, H., Smeaton, A.F. (2011). Use of Content Analysis Tools for Visual Interaction Design. In: Zaman, H.B., et al. Visual Informatics: Sustaining Research and Innovations. IVIC 2011. Lecture Notes in Computer Science, vol 7067. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25200-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-25200-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25199-3
Online ISBN: 978-3-642-25200-6
eBook Packages: Computer ScienceComputer Science (R0)