Abstract
Modern online social networks, such as Twitter and Instagram, are nowadays important sources for publishing information and content around breaking news stories and incidents related to public safety, ranging from natural disasters and aeroplane accidents to terrorist attacks and industrial accidents. A crucial issue regarding such information and content is the extent that they can be relied upon and used for improving the situational awareness and operational capabilities of decision makers. Given the proliferation of noisy, irrelevant and fake content posted to such platforms, two important requirements for systems supporting the information access needs in incidents, such as the ones described above, include the support for understanding the “big picture” around the incident and the verification of particular pieces of posted content. To this end, we propose Media REVEALr, a scalable and efficient content-based media crawling and indexing framework featuring a novel and resilient near-duplicate detection approach and intelligent content- and context-based aggregation capabilities (e.g. clustering, named entity extraction). We evaluate the system using both reference benchmark datasets as well as datasets collected around real-world incidents, and we describe the ways it contributes to the improvement of the situational awareness and journalistic verification in breaking news situations, like natural disasters.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Ester, M., Kriegel, H., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD 1996), Portland, Oregon, USA, pp. 226–231 (1996)
Gattani, A., Lamba, D.S., Garera, N., Tiwari, M., Chai, X., Das, S., Subramaniam, S., Rajaraman, A., Harinarayan, V., Doan, A.: Entity extraction, linking, classification, and tagging for social media: A wikipedia-based approach. Proc. VLDB Endow. 6(11), 1126–1137 (2013)
Hobbs, J.R.: Fastus: A system for extracting information from natural-language text. Technical Report 519, AI Center, SRI International, 333 Ravenswood Ave., Menlo Park, CA 94025 (November 1992)
Jegou, H., Douze, M., Schmid, C.: Hamming embedding and weak geometric consistency for large scale image search. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part I. LNCS, vol. 5302, pp. 304–317. Springer, Heidelberg (2008)
Jégou, H., Perronnin, F., Douze, M., Sanchez, J., Perez, P., Schmid, C.: Aggregating local image descriptors into compact codes. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(9), 1704–1716 (2012)
Kennedy, L., Chang, S.-F.: Internet image archaeology: Automatically tracing the manipulation history of photographs on the web. In: Proceedings of the 16th ACM International Conference on Multimedia, MM 2008, pp. 349–358. ACM, New York (2008)
Marcus, A., Bernstein, M.S., Badar, O., Karger, D.R., Madden, S., Miller, R.C.: Twitinfo: Aggregating and visualizing microblogs for event exploration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 227–236. ACM, New York (2011)
Mathioudakis, M., Koudas, N.: Twittermonitor: Trend detection over the twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, SIGMOD 2010, pp. 1155–1158. ACM, New York (2010)
Papadopoulos, S., Corney, D., Aiello, L.M.: SNOW 2014 Data Challenge: Assessing the performance of news topic detection methods in social media. In: Proceedings of the SNOW 2014 Data Challenge Workshop co-located with 23rd International World Wide Web Conference (WWW 2014), Seoul, Korea, April 8, pp. 1–8 (2014)
Petkos, G., Papadopoulos, S., Kompatsiaris, Y.: Social event detection using multimodal clustering and integrating supervisory signals. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval, ICMR 2012, pp. 23:1–23:8. ACM, New York (2012)
Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Lost in quantization: Improving particular object retrieval in large scale image databases. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2008), pp. 1–8 (June 2008)
Spyromitros-Xioufis, E., Papadopoulos, S., Kompatsiaris, Y., Tsoumakas, G., Vlahavas, I.: A comprehensive study over VLAD and Product Quantization in large-scale image retrieval. IEEE Transactions on Multimedia 16(6), 1713–1728 (2014)
Weng, L., Menczer, F., Ahn, Y.: Predicting successful memes using network and community structure. CoRR, abs/1403.6199 (2014)
Xie, L., Natsev, A., Kender, J.R., Hill, M., Smith, J.R.: Visual memes in social media: Tracking real-world news in youtube videos. In: Proceedings of the 19th ACM International Conference on Multimedia, MM 2011, pp. 53–62. ACM, New York (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Andreadou, K., Papadopoulos, S., Apostolidis, L., Krithara, A., Kompatsiaris, Y. (2015). Media REVEALr: A Social Multimedia Monitoring and Intelligence System for Web Multimedia Verification. In: Chau, M., Wang, G., Chen, H. (eds) Intelligence and Security Informatics. PAISI 2015. Lecture Notes in Computer Science(), vol 9074. Springer, Cham. https://doi.org/10.1007/978-3-319-18455-5_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-18455-5_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18454-8
Online ISBN: 978-3-319-18455-5
eBook Packages: Computer ScienceComputer Science (R0)