Media REVEALr: A Social Multimedia Monitoring and Intelligence System for Web Multimedia Verification
Modern online social networks, such as Twitter and Instagram, are nowadays important sources for publishing information and content around breaking news stories and incidents related to public safety, ranging from natural disasters and aeroplane accidents to terrorist attacks and industrial accidents. A crucial issue regarding such information and content is the extent that they can be relied upon and used for improving the situational awareness and operational capabilities of decision makers. Given the proliferation of noisy, irrelevant and fake content posted to such platforms, two important requirements for systems supporting the information access needs in incidents, such as the ones described above, include the support for understanding the “big picture” around the incident and the verification of particular pieces of posted content. To this end, we propose Media REVEALr, a scalable and efficient content-based media crawling and indexing framework featuring a novel and resilient near-duplicate detection approach and intelligent content- and context-based aggregation capabilities (e.g. clustering, named entity extraction). We evaluate the system using both reference benchmark datasets as well as datasets collected around real-world incidents, and we describe the ways it contributes to the improvement of the situational awareness and journalistic verification in breaking news situations, like natural disasters.
KeywordsSocial media monitoring Event mining Situational awareness Multimedia verification Breaking news reporting
Unable to display preview. Download preview PDF.
- 2.Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD 1996), Portland, Oregon, USA, pp. 226–231 (1996)Google Scholar
- 4.Hobbs, J.R.: Fastus: A system for extracting information from natural-language text. Technical Report 519, AI Center, SRI International, 333 Ravenswood Ave., Menlo Park, CA 94025 (November 1992)Google Scholar
- 7.Kennedy, L., Chang, S.-F.: Internet image archaeology: Automatically tracing the manipulation history of photographs on the web. In: Proceedings of the 16th ACM International Conference on Multimedia, MM 2008, pp. 349–358. ACM, New York (2008)Google Scholar
- 9.Mathioudakis, M., Koudas, N.: Twittermonitor: Trend detection over the twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 1155–1158. ACM, New York (2010)Google Scholar
- 10.Papadopoulos, S., Corney, D., Aiello, L.M.: SNOW 2014 Data Challenge: Assessing the performance of news topic detection methods in social media. In: Proceedings of the SNOW 2014 Data Challenge Workshop co-located with 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 8, pp. 1–8 (2014)Google Scholar
- 11.Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8. ACM, New York (2012)Google Scholar
- 12.Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Lost in quantization: Improving particular object retrieval in large scale image databases. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), pp. 1–8 (June 2008)Google Scholar
- 14.Weng, L., Menczer, F., Ahn, Y.: Predicting successful memes using network and community structure. CoRR, abs/1403.6199 (2014)Google Scholar
- 15.Xie, L., Natsev, A., Kender, J.R., Hill, M., Smith, J.R.: Visual memes in social media: Tracking real-world news in youtube videos. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 53–62. ACM, New York (2011)Google Scholar