Media REVEALr: A Social Multimedia Monitoring and Intelligence System for Web Multimedia Verification

  • Katerina Andreadou
  • Symeon Papadopoulos
  • Lazaros Apostolidis
  • Anastasia Krithara
  • Yiannis Kompatsiaris
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9074)

Abstract

Modern online social networks, such as Twitter and Instagram, are nowadays important sources for publishing information and content around breaking news stories and incidents related to public safety, ranging from natural disasters and aeroplane accidents to terrorist attacks and industrial accidents. A crucial issue regarding such information and content is the extent that they can be relied upon and used for improving the situational awareness and operational capabilities of decision makers. Given the proliferation of noisy, irrelevant and fake content posted to such platforms, two important requirements for systems supporting the information access needs in incidents, such as the ones described above, include the support for understanding the “big picture” around the incident and the verification of particular pieces of posted content. To this end, we propose Media REVEALr, a scalable and efficient content-based media crawling and indexing framework featuring a novel and resilient near-duplicate detection approach and intelligent content- and context-based aggregation capabilities (e.g. clustering, named entity extraction). We evaluate the system using both reference benchmark datasets as well as datasets collected around real-world incidents, and we describe the ways it contributes to the improvement of the situational awareness and journalistic verification in breaking news situations, like natural disasters.

Keywords

Social media monitoring Event mining Situational awareness Multimedia verification Breaking news reporting 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRefGoogle Scholar
  2. 2.
    Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD 1996), Portland, Oregon, USA, pp. 226–231 (1996)Google Scholar
  3. 3.
    Gattani, A., Lamba, D.S., Garera, N., Tiwari, M., Chai, X., Das, S., Subramaniam, S., Rajaraman, A., Harinarayan, V., Doan, A.: Entity extraction, linking, classification, and tagging for social media: A wikipedia-based approach. Proc. VLDB Endow. 6(11), 1126–1137 (2013)CrossRefGoogle Scholar
  4. 4.
    Hobbs, J.R.: Fastus: A system for extracting information from natural-language text. Technical Report 519, AI Center, SRI International, 333 Ravenswood Ave., Menlo Park, CA 94025 (November 1992)Google Scholar
  5. 5.
    Jegou, H., Douze, M., Schmid, C.: Hamming embedding and weak geometric consistency for large scale image search. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 304–317. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Jégou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., Schmid, C.: Aggregating local image descriptors into compact codes. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(9), 1704–1716 (2012)CrossRefGoogle Scholar
  7. 7.
    Kennedy, L., Chang, S.-F.: Internet image archaeology: Automatically tracing the manipulation history of photographs on the web. In: Proceedings of the 16th ACM International Conference on Multimedia, MM 2008, pp. 349–358. ACM, New York (2008)Google Scholar
  8. 8.
    Marcus, A., Bernstein, M.S., Badar, O., Karger, D.R., Madden, S., Miller, R.C.: Twitinfo: Aggregating and visualizing microblogs for event exploration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 227–236. ACM, New York (2011)CrossRefGoogle Scholar
  9. 9.
    Mathioudakis, M., Koudas, N.: Twittermonitor: Trend detection over the twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 1155–1158. ACM, New York (2010)Google Scholar
  10. 10.
    Papadopoulos, S., Corney, D., Aiello, L.M.: SNOW 2014 Data Challenge: Assessing the performance of news topic detection methods in social media. In: Proceedings of the SNOW 2014 Data Challenge Workshop co-located with 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 8, pp. 1–8 (2014)Google Scholar
  11. 11.
    Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8. ACM, New York (2012)Google Scholar
  12. 12.
    Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Lost in quantization: Improving particular object retrieval in large scale image databases. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), pp. 1–8 (June 2008)Google Scholar
  13. 13.
    Spyromitros-Xioufis, E., Papadopoulos, S., Kompatsiaris, Y., Tsoumakas, G., Vlahavas, I.: A comprehensive study over VLAD and Product Quantization in large-scale image retrieval. IEEE Transactions on Multimedia 16(6), 1713–1728 (2014)CrossRefGoogle Scholar
  14. 14.
    Weng, L., Menczer, F., Ahn, Y.: Predicting successful memes using network and community structure. CoRR, abs/1403.6199 (2014)Google Scholar
  15. 15.
    Xie, L., Natsev, A., Kender, J.R., Hill, M., Smith, J.R.: Visual memes in social media: Tracking real-world news in youtube videos. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 53–62. ACM, New York (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Katerina Andreadou
    • 1
  • Symeon Papadopoulos
    • 1
  • Lazaros Apostolidis
    • 1
  • Anastasia Krithara
    • 2
  • Yiannis Kompatsiaris
    • 1
  1. 1.Information Technologies InstituteCERTHThessalonikiGreece
  2. 2.NCSR DemokritosAghiaGreece

Personalised recommendations