Skip to main content

Ten Research Questions for Scalable Multimedia Analytics

Part of the Lecture Notes in Computer Science book series (LNISA,volume 9517)


The scale and complexity of multimedia collections is ever increasing, as is the desire to harvest useful insight from the collections. To optimally support the complex quest for insight, multimedia analytics has emerged as a new research area that combines concepts and techniques from multimedia analysis and visual analytics into a single framework. State of the art multimedia analytics solutions are highly interactive and give users freedom in how they perform their analytics task, but they do not scale well. State of the art scalable database management solutions, on the other hand, are not yet designed for multimedia analytics workloads. In this position paper we therefore argue the need for research on scalable multimedia analytics, a new research area built on the three pillars of visual analytics, multimedia analysis and database management. We propose a specific goal for scalable multimedia analytics and present several important research questions that we believe must be addressed in order to achieve that goal.


  • Query Processing
  • Database Management
  • Analytic Task
  • Multimedia Data
  • Business Analytic

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-27674-8_26
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   64.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-27674-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   84.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.


  1. 1.

    The requirements are sometimes given as four, six or even seven Vs. The additional Vs—veracity, validity, viability and value—are not important for this discussion.


  1. Burtner, R., Bohn, S., Payne, D.: Interactive visual comparison of multimedia data through type-specific views. In: Wong, P.C., Kao, D.L., Hao, M.C., Chen, C., Healey, C.G. (eds.) SPIE Conference on Visualization and Data Analysis (VDA), Burlingame, CA, USA, pp. 86540M–86540M-15 (2013)

    Google Scholar 

  2. Chinchor, N.A., Thomas, J.J., Wong, P.C., Christel, M.G., Ribarsky, W.: Multimedia analysis + visual analytics = multimedia analytics. IEEE Comput. Graph. Appl. Mag. 30(5), 52–60 (2010)

    CrossRef  Google Scholar 

  3. Jégou, H., Douze, M., Schmid, C.: Product quantization for nearest neighbor search. IEEE Trans. Pattern Anal. Mach. Intell. 33(1), 117–128 (2011)

    CrossRef  Google Scholar 

  4. Jónsson, B.Þ., Tómasson, G., Sigurþórsson, H., Eiríksdóttir, Á., Amsaleg, L., Lárusdóttir, M.K.: A multi-dimensional data model for personal photo browsing. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 345–356. Springer, Heidelberg (2015)

    Google Scholar 

  5. Keim, D.A., Kohlhammer, J., Ellis, G., Mansmann, F. (eds.): Mastering The Information Age-Solving Problems with Visual Analytics. Eurographics (2010)

    Google Scholar 

  6. Lejsek, H., Jónsson, B.Þ., Amsaleg, L.: NV-Tree: nearest neighbours at the billion scale. In: De Natale, F.G.B., Del Bimbo, A., Hanjalic, A., Manjunath, B.S., Satoh, S. (eds.) ACM International Conference on Multimedia Retrieval (ICMR), Trento, Italy, pp. 54:1–54:8 (2011)

    Google Scholar 

  7. Moise, D., Shestakov, D., , G.Þ., Amsaleg, L.: Indexing and searching 100M images with Map-Reduce. In: Jain, R., Prabhakaran, B., Worring, M., Smith, J.R., Chua, T.S. (eds.) ACM International Conference on Multimedia Retrieval (ICMR), Dallas, TX, USA, pp. 17–24 (2013)

    Google Scholar 

  8. North, C.: Towards measuring visualization insight. IEEE Comput. Graph. Appl. Mag. 26(3), 6–9 (2006)

    CrossRef  Google Scholar 

  9. Rudinac, S., Larson, M., Hanjalic, A.: Learning crowdsourced user preferences for visual summarization of image collections. IEEE Trans. Multimedia 15(6), 1231–1243 (2013)

    CrossRef  Google Scholar 

  10. Snoek, C.G.M., van de Sande, K.E.A., de Rooij, O., Huurnink, B., van Gemert, J.C., Uijlings, J.R.R., He, J., Li, X., Everts, I., Nedovic, V., van Liempt, M., van Balen, R., Yan, F., Tahir, M.A., Mikolajczyk, K., Kittler, J., de Rijke, M., Geusebroek, J.M., Gevers, T., Worring, M., Smeulders, A.W.M., Koelma, D.C.: The MediaMill TRECVID 2008 semantic video search engine. In: Over, P., Awad, G., Rose, R.T., Fiscus, J.G., Kraaij, W., Smeaton, A.F. (eds.) TRECVID Workshop, Gaithersburg, MD, USA (2008)

    Google Scholar 

  11. Viaud, M.L., Thièvre, J., Goëau, H., Saulnier, A., Buisson, O.: Interactive components for visual exploration of multimedia archives. In: Luo, J., Guan, L., Hanjalic, A., Kankanhalli, M.S., Lee, I. (eds.) ACM International Conference on Image and Video Retrieval (CIVR), Niagara Falls, Canada, pp. 609–616 (2008)

    Google Scholar 

  12. Worring, M., Koelma, D.C.: Insight in image collections by multimedia pivot tables. In: Hauptmann, A.G., Ngo, C.W., Xue, X., Jiang, Y.G., Snoek, C., Vasconcelos, N. (eds.) ACM International Conference on Multimedia Retrieval (ICMR), Shanghai, China, pp. 291–298 (2015)

    Google Scholar 

  13. Zahálka, J., Worring, M.: Towards interactive, intelligent, and integrated multimedia analytics. In: Chen, M., Ebert, D.S., North, C. (eds.) IEEE Conference on Visual Analytics Science and Technology (VAST), France, Paris, pp. 3–12 (2014)

    Google Scholar 

Download references


This work was in part supported by the CNRS PICS grant “MMAnalytics” and by sabbatical support from Reykjavik University. Thanks go to the anonymous reviewers, for comments that helped improve the paper.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Björn Þór Jónsson .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Jónsson, B.Þ., Worring, M., Zahálka, J., Rudinac, S., Amsaleg, L. (2016). Ten Research Questions for Scalable Multimedia Analytics. In: Tian, Q., Sebe, N., Qi, GJ., Huet, B., Hong, R., Liu, X. (eds) MultiMedia Modeling. MMM 2016. Lecture Notes in Computer Science(), vol 9517. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27673-1

  • Online ISBN: 978-3-319-27674-8

  • eBook Packages: Computer ScienceComputer Science (R0)