Skip to main content

Tweet2Story: Extracting Narratives from Twitter

  • Conference paper
  • First Online:
Progress in Artificial Intelligence (EPIA 2023)

Abstract

Topics discussed on social media platforms contain a disparate amount of information written in colloquial language, making it difficult to understand the narrative of the topic. In this paper, we take a step forward, towards the resolution of this problem by proposing a framework that performs the automatic extraction of narratives from a document, such as tweet posts. To this regard, we propose a methodology that extracts information from the texts through a pipeline of tasks, such as co-reference resolution and the extraction of entity relations. The result of this process is embedded into an annotation file to be used by subsequent operations, such as visualization schemas. We named this framework Tweet2Story and measured its effectiveness under an evaluation schema that involved three different aspects: (i) as an Open Information extraction (OpenIE) task, (ii) by comparing the narratives of manually annotated news articles linked to tweets about the same topic and (iii) by comparing their knowledge graphs, produced by the narratives, in a qualitative way. The results obtained show a high precision and a moderate recall, on par with other OpenIE state-of-the-art frameworks and confirm that the narratives can be extracted from small texts. Furthermore, we show that the narrative can be visualized in an easily understandable way.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://brat.nlplab.org/standoff.html.

  2. 2.

    https://github.com/LIAAD/Tweet2Story.

  3. 3.

    https://github.com/explosion/spacy-models/releases/tag/en_core_web_md-3.1.0.

  4. 4.

    https://allennlp.org/.

References

  1. Angeli, G., Johnson Premkumar, M.J., Manning, C.D.: Leveraging linguistic structure for open domain information extraction. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 344–354. Association for Computational Linguistics, Beijing, China (Jul 2015). https://doi.org/10.3115/v1/P15-1034, https://aclanthology.org/P15-1034

  2. Bhardwaj, S., Aggarwal, S., Mausam, M.: CaRB: A crowdsourced benchmark for open IE. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 6263–6268. Association for Computational Linguistics, Hong Kong, China (Nov 2019). 10.18653/v1/D19-1651, https://www.aclweb.org/anthology/D19-1651

  3. Campos, R., Jorge, A., Jatowt, A., Bhatia, S., Litvak, M.: The 6th international workshop on narrative extraction from texts: Text2story 2023. In: Kamps, J., Goeuriot, L., Crestani, F., Maistro, M., Joho, H., Davis, B., Gurrin, C., Kruschwitz, U., Caputo, A. (eds.) Advances in Information Retrieval, pp. 377–383. Springer Nature Switzerland, Cham (2023)

    Chapter  Google Scholar 

  4. Del Corro, L., Gemulla, R.: Clausie: Clause-based open information extraction. In: Proceedings of the 22nd International Conference on World Wide Web, p. 355–366. WWW’13, Association for Computing Machinery, New York, NY, USA (2013). 10.1145/2488388.2488420, https://doi.org/10.1145/2488388.2488420

  5. Dutkiewicz, J., Nowak, M., Jedrzejek, C.: R2e: Rule-based event extractor. In: Proceedings of the RuleML 2014 Challenge and the RuleML 2014 Doctoral Consortium hosted by the 8th International Web Rule Symposium (RuleML 2014), pp. 1–13. Poznań University of Technology, Prague, Czech Republic (2014)

    Google Scholar 

  6. Eisenberg, J.D.: Automatic Extraction of Narrative Structure from Long Form Text. Ph.D. thesis, Florida International University (2018)

    Google Scholar 

  7. Fader, A., Soderland, S., Etzioni, O.: Identifying relations for open information extraction. In: Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, pp. 1535–1545. Association for Computational Linguistics, Edinburgh, Scotland, UK. (Jul 2011). https://aclanthology.org/D11-1142

  8. Lee, K., He, L., Zettlemoyer, L.: Higher-order coreference resolution with coarse-to-fine inference. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pp. 687–692. Association for Computational Linguistics, New Orleans, Louisiana (Jun 2018). https://doi.org/10.18653/v1/N18-2108, https://aclanthology.org/N18-2108

  9. Lin, C.Y.: ROUGE: A package for automatic evaluation of summaries. In: Text Summarization Branches Out, pp. 74–81. Association for Computational Linguistics, Barcelona, Spain (Jul 2004). https://aclanthology.org/W04-1013

    Google Scholar 

  10. Metilli, D., Bartalesi V., Meghini C.: Steps towards a system to extract formal narratives from text. In: Text2Story 2019-Second Workshop on Narrative Extraction From Texts, pp. 53–61. CEUR-WS.org, Aachen, DEU, Cologne, Germany (April 2019)

    Google Scholar 

  11. MuckRack: The state of journalism 2021. MUCK RACK Blog (Mar 15 2021). https://muckrack.com/blog/2021/03/15/state-of-journalism-2021

  12. Shi, P., Lin, J.: Simple Bert models for relation extraction and semantic role labeling (2019). arXiv:abs/1904.05255

  13. Strötgen, J., Gertz, M.: Heideltime: High quality rule-based extraction and normalization of temporal expressions. In: Proceedings of the 5th International Workshop on Semantic Evaluation, p. 321–324. SemEval’10, Association for Computational Linguistics, USA (2010)

    Google Scholar 

  14. Suarez, A., Albakour, D., Corney, D., Martinez, M., Esquivel, J.: A data collection for evaluating the retrieval of related tweets to news articles. In: 40th European Conference on Information Retrieval Research (ECIR 2018), pp. 780–786. Springer, Cham, Grenoble, France (March 2018). https://link.springer.com/chapter/10.1007/978-3-319-76941-7_76

  15. Vargas, J.V.: Narrative Information Extraction with Non-Linear Natural Language Processing Pipelines. Ph.D. thesis, Drexel University (2017)

    Google Scholar 

Download references

Acknowledgment

This work is financed by National Funds through the Portuguese funding agency, FCT–Fundação para a Ciência e a Tecnologia, within project UIDB/50014/2020 and LA/P/0063/2020. The authors of this paper were financed by National Funds through the FCT–Fundação para a Ciência e a Tecnologia, I.P. (Portuguese Foundation for Science and Technology) within the project StorySense, with reference 2022.09312.PTDC).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vasco Campos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Campos, V., Campos, R., Jorge, A. (2023). Tweet2Story: Extracting Narratives from Twitter. In: Moniz, N., Vale, Z., Cascalho, J., Silva, C., Sebastião, R. (eds) Progress in Artificial Intelligence. EPIA 2023. Lecture Notes in Computer Science(), vol 14115. Springer, Cham. https://doi.org/10.1007/978-3-031-49008-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-49008-8_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-49007-1

  • Online ISBN: 978-3-031-49008-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics