Multilingual Real-time Event Extraction for Border Security Intelligence Gathering

  • Martin Atkinson
  • Jakub PiskorskiEmail author
  • Erik Van der Goot
  • Roman Yangarber
Part of the Lecture Notes in Social Networks book series (LNSN)


This chapter gives an overview of tools developed for Frontex, the European Agency for the Management of Operational Cooperation at the External Borders of the Member States of the European Union, to facilitate the process of extracting structured information on events related to border security from on-line news articles, with a particular focus on incidents and developments in the context of illegal migration, cross-border crime, and related crisis situations at the EU external borders and in third countries. A hybrid event extraction system has been constructed, which consists of two core event extraction engines, namely, NEXUS, developed at the Joint Research Centre (JRC) of the European Commission and PULS, developed at the University of Helsinki. These systems are applied to the stream of news articles continuously gathered and pre-processed by the Europe Media Monitor (EMM) – a large-scale multilingual news aggregation engine, developed at the JRC. In order to bridge the automated analysis phase with in-depth human analysis phase an event moderation tool has been developed, which allows the user to access the database of automatically extracted event descriptions and to clean, validate, group, enhance, and export them into other knowledge repositories.


Event Type News Article Human Trafficking Event Extraction Prepositional Phrase 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



The major part of the work presented in this chapter was supported by the EMM Project carried out by the Open Source Text Information Mining and Analysis Action in the JRC of the EC. We are indebted to all our EMM colleagues without whom the presented work could not have been be possible.

The custmomisation of the PULSevent extraction system to the extraction of illegal migration incidents and related cross-border crimes was supported by Frontex.


  1. 1.
    Tanev, H., Piskorski, J., Atkinson, M.: Real-Time News Event Extraction for Global Crisis Monitoring. In: Proceedings of the 13thInternational Conference on Applications of Natural Language to Information Systems (NLDB 2008). Lecture Notes in Computer Science, vol. 5039, pp. 207–218. Springer, Berlin (2008)Google Scholar
  2. 2.
    Piskorski, J., Tanev, H., Atkinson, M., Goot, E.V.D.: Cluster-centric approach to news event extraction. In: Proceedings of the International Conference on Multimedia & Network Information Systems, Wroclaw, Poland, IOS Press (2009)Google Scholar
  3. 3.
    Grishman, R., Huttunen, S., Yangarber, R.: Information extraction for enhanced access to disease outbreak reports. J. Biomed. Inform. 35(4) (2003)Google Scholar
  4. 4.
    Yangarber, R., Jokipii, L., Rauramo, A., Huttunen, S.: Extracting information about outbreaks of infectious epidemics. In: Proceedings of the HLT-EMNLP 2005, Vancouver, Canada (2005)Google Scholar
  5. 5.
    Appelt, D.: Introduction to Information Extraction Technology, Tutorial held at IJCAI-99, Stockholm, Sweden (1999)Google Scholar
  6. 6.
    Llytinen, S., Gershman., A.: ATRANS: Automatic processing of money transfer messages. In: Proceedings of the 5th National Conference of the American Association for Artificial Intelligence, IEEE Computer Society Press (1986)Google Scholar
  7. 7.
    Kehler, A.: Learning embedded discourse mechanisms for information extraction. In: Proceedings of AAAI Spring Symposium on Applying Machine Learning to Discourse Processing (1998)Google Scholar
  8. 8.
    Yangarber, R., Grishman, R., Tapanainen, P., Huttunen, S.: Unsupervised discovery of scenario-level patterns for information extraction. In: Proceedings of ANLP-NAACL 2000, Seattle, USA, (2000)Google Scholar
  9. 9.
    Grishman, R., Huttunen, S., Yangarber, R.: Real-time event extraction for infectious disease outbreaks. In: Proceedings of Human Language Technology Conference 2002, San Diego, USA (2002)Google Scholar
  10. 10.
    Yangarber, R., Etter, P.V., Steinberger, R.: Content collection and analysis in the domain of epidemiology. In: Proceedings of DrMED 2008: International Workshop on Describing Medical Web Resources at MIE 2008: the 21stInternational Congress of the European Federation for Medical Informatics 2008, Goeteborg, Sweden (2008)Google Scholar
  11. 11.
    King, G., Lowe, W.: An automated information extraction tool for international conflict data with performance as good as human coders: A rare events evaluation design. Int. Organ. 57, 617–642 (2003)Google Scholar
  12. 12.
    Ashish, N., Appelt, D., Freitag, D., Zelenko, D.: In: Proceedings of the Workshop on Event Extraction and Synthesis, Held in conjunction with the AAAI 2006 conference, Menlo Park, California, USA (2006)Google Scholar
  13. 13.
    Proceedings of the Third Message Understanding Conference (MUC-3), Morgan Kaufmann (1991)Google Scholar
  14. 14.
    Proceedings of the Fourth Message Understanding Conference (MUC-4), Morgan Kaufmann (1992)Google Scholar
  15. 15.
    Steinberger, R., Fuart, F., van der Goot, E., Best, C., Etter, P.V., Yangarber, R.: Text Mining from the Web for Medical Intelligence. In: Fogelman-Soulie, F., Perrotta, D., Piskorski, J., Steinberger, R., (eds.) Mining Massive Data Sets for Security. IOS Press, Amsterdam, the Netherlands (2008)Google Scholar
  16. 16.
    Freifeld, C., Mandl, K., Reis, B., Brownstein, J.: HealthMap: Global infectious disease monitoring through automated classification and visualization of internet media reports. J. Am. Med. Inform. Assoc. 15(1) (2008)Google Scholar
  17. 17.
    Doan, S., Hung-Ngo, Q., Kawazoe, A., Collier, N.: Global health monitor–a web-based system for detecting and mapping infectious diseases. In: Proceedings of the International Joint Conference on NLP (IJCNLP). (2008)Google Scholar
  18. 18.
    Naughton, M., Kushmerick, N., Carthy, J.: Event extraction from heterogeneous news sources. In: Proceedings of the AAAI 2006 workshop on Event Extraction and Synthesis, Menlo Park, California, USA (2006)Google Scholar
  19. 19.
    Wagner, E., Liu, J., Birnbaum, L., Forbus, K., Baker, J.: Using explicit semantic models to track situations across news articles. In: Proceedings of the AAAI 2006 workshop on Event Extraction and Synthesis, Menlo Park, California, USA (2006)Google Scholar
  20. 20.
    Atkinson, M., van der Goot, E.: Near real time information mining in multilingual news. In: Proceedings of the 18thWorld Wide Web Conference. (2009)Google Scholar
  21. 21.
    Pouliquen, B., Tanev, H., Atkinson, M.: Extracting and learning social networks out of multilingual news. In: Learning Social Networks out of Multilingual News. Proceedings of the social networks and application tools workshop (SocNet-08), Skalica, Slovakia, 19–21 Sept 2008Google Scholar
  22. 22.
    Kabadjov, M., Atkinson, M., Steinberger, J., Steinberger, R., Van der Goot, E.: NewsGist: A Multilingual Statistical News Summarizer. In: Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD’2010). (2010)Google Scholar
  23. 23.
    Balahur, A., Steinberger, R., Van der Goot, E., Pouliquen, B., Kabadjov, M.: Opinion Mining on Newspaper Quotations. In: Proceedings of the workshop ’Intelligent Analysis and Processing of Web News Content’ (IAPWNC), held at the 2009 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, Milano, Italy. (2009)Google Scholar
  24. 24.
    Lyons, R.: Understanding Digital Signal Processing, Second Edition. ISBN-13: 978-0-13-108989-1, Prentice Hall (2004)Google Scholar
  25. 25.
    Piskorski, J.: ExPRESS – Extraction pattern recognition engine and specification suite. In: Proceedings of the 6thInternational Workshop Finite-State Methods and Natural language Processing 2007 (FSMNLP 2007), Potsdam, Germany (2007)Google Scholar
  26. 26.
    Piskorski, J., Tanev, H., Atkinson, M., van der Goot, E.: Online News Event Extraction for Global Crisis Surveillance. Transactions on Computational Collective Intelligence, Springer Lecture Notes in Computer Science (2011)Google Scholar
  27. 27.
    Zavarella, V., Tanev, H., Piskorski, J.: Event extraction for Italian using a cascade of finite-state grammars. In: Proceedings of the 7thInternational Workshop on Finite-State Machines and Natural Language Processing. (2008)Google Scholar
  28. 28.
    Tanev, H., Zavarella, V., Linge, J., Kabadjov, M., Piskorski, J., Atkinson, M., Steinberger, R.: Exploiting Machine Learning Techniques to Build an Event Extraction System for Portuguese and Spanish. Linguamática: Revista para o Processamento Automático das Línguas Ibéricas 2, 550–566 (2009)Google Scholar
  29. 29.
    Tanev, H., Oezden, P.: Learning to populate an ontology of violent events. In: Fogelman-Soulie, F., Perrotta, D., Piskorski, J., Steinberger, R., (eds.) Mining Massive Data Sets for Security. IOS Press, Amsterdam, the Netherlands (2008)Google Scholar
  30. 30.
    Pinheiro, V., Furtado, V., Pequeno, T., Nogueira, D.: Natrual language processing based on semantic inferentialism for extracting crime information from text. In: Proceedings of 2010 IEEE Conference on Intelligence and Security Informatics, Vancouver, Canada (2010)Google Scholar
  31. 31.
    Yangarber, R.: Counter-training in discovery of semantic patterns. In: Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan, July 2003Google Scholar
  32. 32.
    Lin, W., Yangarber, R., Grishman, R.: Bootstrapped learning of semantic classes from positive and negative examples. In: Proceedings of the ICML Workshop on The Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining, Washington, DC, Aug 2003Google Scholar
  33. 33.
    Turchi, M., Flaounas, I., Ali, O., De Bie, T., Snowsill, T., Cristianini, N.: Found in translation. In: Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, Springer (ECML/PKDD 2009) (2000)Google Scholar
  34. 34.
    Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Zens, R., Constantin, A., Federico, M., Bertoldi, N., Dyer, C., Cowan, B., Shen, W., Moran, C., Bojar, O., Herbst, E.: Moses: open source toolkit for statistical machine translation. In: Proceedings of ACL 2007, Demonstration Session, pp. 177–180. (2007)Google Scholar
  35. 35.
    Zhang, Y., Zeng, S., Huang, C.N., Fan, L., Yu, X., Dang, Y., Larson, C., Denning, D., Roberts, N., Chen, H.: Developing a dark web collection and infrastructure for computational and social sciences. In: Proceedings of ISI 2010, Vancouver, Canada (2010)Google Scholar

Copyright information

© Springer-Verlag/Wien 2011

Authors and Affiliations

  • Martin Atkinson
    • 1
  • Jakub Piskorski
    • 2
    Email author
  • Erik Van der Goot
    • 1
  • Roman Yangarber
    • 3
  1. 1.Joint Research Centre of the European CommissionIspraItaly
  2. 2.Research and Development UnitWarsawPoland
  3. 3.Department of Computer ScienceUniversity of HelsinkiHelsinkiFinland

Personalised recommendations