Use of Content Analysis Tools for Visual Interaction Design

  • Nazlena Mohamad Ali
  • Hyowon Lee
  • Alan F. Smeaton
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7067)


Automatic media content analysis in multimedia is a very promising field of research bringing in various possibilities for enhancing visual informatics. By computationally analysing the quantitative data contained in text, audio, image and video media, more semantically meaningful and useful information on the media contents can be derived, extracted and visualised, informing human users those facts and patterns initially hidden in the bit streams of data. Insights into how to transform the emerging technological possibilities from these media analysis tools into usable visual interfaces to help people see visual information in novel ways will be an important contribution to visual informatics. In this paper, we outline some of the more promising content analysis techniques currently being researched in multimedia and computer vision and discuss how these could be used to develop visually-oriented end-user interfaces that support searching, browsing and summarization of the media contents in various usage contexts. We illustrate this with a few example applications that we have developed over the years, all of which designed in such a way as to take advantage of the automatic content analysis and to discover and create novel usage scenarios of consuming visually-oriented media contents.


content analysis visual interaction design visualization video browsing Visual Informatics 


  1. 1.
    Bernhaupt, R., Obrist, M., Tscheligi, M.: Usability and usage of iTV services: lessons learned in an Austrian field trial. ACM Computers in Entertainment 5(2) (2007)Google Scholar
  2. 2.
    Browne, P., Czirjek, C., Gaughan, G., Gurrin, C., Jones, G., Lee, H., Marlow, S., Mc-Donald, K., Murphy, N., O’Connor, N.E., O’Hare, N., Smeaton, A.F., Ye, J.: Dublin City University Video Track Experiments for TREC 2003. In: Proceedings of the TRECVid Workshop, Gaithersburg (2003)Google Scholar
  3. 3.
    Gurrin, C., MacNeela, P., Smeaton, A.F., Lee, H., Browne, P., McDonald, K.: Fıschlar-Nursing, Using Digital Video Libraries to Teach Nursing Students. In: WBE 2004 - IASTED International Conference on Web-Based Education, pp. 111–116 (2004)Google Scholar
  4. 4.
    Lanagan, J., Smeaton, A.F.: SportsAnno: What Do You Think? In: Proc. of Large-Scale Semantic Access to Content (Text, Image, Video and Sound) RIAO (2007)Google Scholar
  5. 5.
    Lee, H., Smeaton, A.F., O’Connor, N., Smyth, B.: User Evaluation of Físchlár-News: An Automatic Broadcast News Delivery System. TOIS - ACM Transactions on Information Systems 24(2), 145–189 (2006)CrossRefGoogle Scholar
  6. 6.
    Lee, H., Smeaton, A.F., O’Connor, N., Jones, G., Blighe, M., Byrne, D., Doherty, A., Gurrin, C.: Constructing a SenseCam Visual Diary as a Media Process. Multimedia Systems Journal, Special Issue on Canonical Processes of Media Production 14(6), 341–349 (2008)Google Scholar
  7. 7.
    Lee, H., Smeaton, A.F.: Designing the User Interface for the Fıschlar Digital Video Library. Journal of Digital Information 2(4) (2002)Google Scholar
  8. 8.
    Lehane, B., O’Connor, N.E., Lee, H., Smeaton, A.F.: Indexing of Fictional Video Content for Event Detection and Summarisation. EURASIP Journal on Image and Video Processing, 1–15 (2007)Google Scholar
  9. 9.
    Lehane, B., O’Connor, N.E., Smeaton, A., Lee, H.: A System for Event-Based Film Browsing. In: Göbel, S., Malkewitz, R., Iurgel, I. (eds.) TIDSE 2006. LNCS, vol. 4326, pp. 334–345. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  10. 10.
    McKeown, K., Barzilay, R., Evans, D., Hatzivassiloglou, V., Klavans, J., Nenkovo, A., Sable, C., Schiffman, B., Sigelman, S.: Tracking and summarazing news on a daily basis with Columbia’s Newsblaster. In: Proc. of the Human Language Technology Conference (2002)Google Scholar
  11. 11.
    Mohamad Ali, N., Smeaton, A.F.: Are Visual Informatics Actually Useful in Practice: A Study in a Film Studies Context. In: Badioze Zaman, H., Robinson, P., Petrou, M., Olivier, P., Schröder, H., Shih, T.K. (eds.) IVIC 2009. LNCS, vol. 5857, pp. 811–821. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  12. 12.
    Mohamad Ali, N., Smeaton, A.F., Lee, H., Brereton, P.: Developing, Deploying and Assessing the Usage of a Movie Archive System. In: HCI 2009. LNCS, vol. 5613, pp. 567–576. Springer, Heidelberg (2009)Google Scholar
  13. 13.
    Nielsen, J.: Usability Engineering. Academic Press, Inc. (1993)Google Scholar
  14. 14.
    O’Hare, N., Smeaton, A.F.: Context-Aware Person Identification in Personal Photo Collections. IEEE Transactions on Multimedia, Special Issue on Integration of Context and Content for Multimedia Management 11(2), 220–228 (2009)Google Scholar
  15. 15.
    O’Hare, N., Lee, H., Cooray, S., Gurrin, C., Jones, G., Malobabic, J., O’Connor, N., Smeaton, A.F., Uscilowski, B.: MediAssist: Using Content-Based Analysis and Context to Manage Personal Photo Collections. In: Sundaram, H., Naphade, M., Smith, J.R., Rui, Y. (eds.) CIVR 2006. LNCS, vol. 4071, pp. 529–532. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  16. 16.
    Pielot, M., Boll, S.: Tactile Wayfinder: Comparison of Tactile Waypoint Navigation with Commercial Pedestrian Navigation Systems. In: Floréen, P., Krüger, A., Spasojevic, M. (eds.) Pervasive Computing. LNCS, vol. 6030, pp. 76–93. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  17. 17.
    Smeaton, A.F., Gurrin, C., Lee, H., McDonald, K., Murphy, N., O’Connor, N.E., O’Sullivan, D., Smyth, B., Wilson, D.: The Fıschlar-News-Stories System: Personalised Access to an Archive of TV News. In: RIAO 2004 - Coupling Approaches, Coupling Media and Coupling Languages for Information Retrieval, pp. 3–17 (2004)Google Scholar
  18. 18.
    Smeaton, A.F., Lee, H., McDonald, K.: Experiences of Creating Four Video Library Collections with the Fıschlar System. International Journal on Digital Libraries 4(1), 42–44 (2004)CrossRefGoogle Scholar
  19. 19.
    Smeaton, A.F., Over, P., Doherty, A.: Video Shot Boundary Detection: Seven Years of TRECVid Activity. Computer Vision and Image Understanding 114(4), 411–418 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Nazlena Mohamad Ali
    • 1
  • Hyowon Lee
    • 2
  • Alan F. Smeaton
    • 2
  1. 1.Institute of Visual InformaticsUniversity Kebangsaan MalaysiaMalaysia
  2. 2.CLARITY: Centre for Sensor Web TechnologiesDublin City UniversityIreland

Personalised recommendations