Skip to main content

Overview of PAN 2023: Authorship Verification, Multi-Author Writing Style Analysis, Profiling Cryptocurrency Influencers, and Trigger Detection

Condensed Lab Overview

  • Conference paper
  • First Online:
Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2023)

Abstract

The paper gives a brief overview of three shared tasks which have been organized at the PAN 2023 lab on digital text forensics and stylometry hosted at the CLEF 2023 conference. The tasks include authorship verification across discourse types, multi-author writing style analysis, profiling cryptocurrency influencers with few-shot learning, and trigger detection. Authorship verification and multi-author analysis continue and advance from past editions of PAN and influencer profiling and trigger detection are new tasks with novel research questions and evaluation resources. All four tasks alilgn with the goals of all shared tasks at PAN: to advance the state of the art in text forensics and stylometry while ensuring objective evaluation on newly developed benchmark datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://pan.webis.de/data.html.

  2. 2.

    https://fold.aston.ac.uk/handle/123456789/17.

  3. 3.

    https://www.reddit.com/.

  4. 4.

    To generate the datasets, we have followed a methodology that complies with the EU General Data Protection Regulation [45].

  5. 5.

    https://zerogravitymarketing.com/the-different-tiers-of-influencers-and-when-to-use-each/.

    https://twitter.com/latermedia/status/1385337617340829701.

    https://izea.com/resources/influencer-tiers/.

References

  1. Bevendorff, J., et al.: Overview of PAN 2021: authorship verification, profiling hate speech spreaders on twitter, and style change detection. In: Candan, K.S., et al. (eds.) CLEF 2021. LNCS, vol. 12880, pp. 419–431. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-85251-1_26

    Chapter  Google Scholar 

  2. Bevendorff, J., et al.: Overview of PAN 2020: authorship verification, celebrity profiling, profiling fake news spreaders on Twitter, and style change detection. In: Arampatzis, A., et al. (eds.) CLEF 2020. LNCS, vol. 12260, pp. 372–383. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58219-7_25

    Chapter  Google Scholar 

  3. Bobicev, V., Sokolova, M.: Inter-annotator agreement in sentiment analysis: machine learning perspective. In: Proceedings of the International Conference Recent Advances in Natural Language Processing (2017)

    Google Scholar 

  4. Cao, G., et al.: A dual-model classification method based on RoBERTa for trigger detection. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  5. Cao, H., et al.: Trigger warning labeling with RoBERTa and resampling for distressing content detection. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  6. Chen, H., Han, Z., Li, Z., Han, Y.: A writing style embedding based on contrastive learning for multi-author writing style analysis. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  7. Chinea-Rios, M., Borrego-Obrador, I., Franco-Salvador, M., Rangel, F., Rosso, P.: Profiling cryptocurrency influencers with few-shot learning at PAN 2023. In: CLEF 2022 Labs and Workshops, Notebook Papers, CEUR-WS.org (2023)

    Google Scholar 

  8. Chinea-Rios, M., Müller, T., Sarracén, G.L.D.l.P., Rangel, F., Franco-Salvador, M.: Zero and few-shot learning for author profiling. arXiv preprint arXiv:2204.10543 (2022)

  9. Espinosa, D., Sidorov, G.: Using BERT to profiling cryptocurrency influencers. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  10. Felser, J., Demus, C., Labudde, D., Spranger, M.: FoSIL at PAN?23: trigger detection with a two stage topic classifier. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  11. Fröbe, M., et al.: Continuous integration for reproducible shared tasks with TIRA.io. In: Kamps, J., et al. (eds.) ECIR 2023. Lecture Notes in Computer Science, vol. 13982, pp. 236–241. Springer, Berlin (2023). https://doi.org/10.1007/978-3-031-28241-6_20

    Chapter  Google Scholar 

  12. Giglou, H.B., Rahgouy, M., Oskuee, J.D.M.M., Tekanlou, H.B.A., Seals, C.D.: Leveraging large language models with multiple loss learners for few-shot author profiling. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  13. Girish, K., Hegdev, A., Balouchzahi, F., Lakshmaiah, S.H.: Profiling cryptocurrency influencers with sentence transformers. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  14. Guo, M., Han, Z., Chen, H., Qi, H.: A contrastive learning of sample pairs for authorship verification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  15. Hashemi, A., Shi, W.: Enhancing writing style change detection using transformer-based models and data augmentation. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  16. He, P., Liu, X., Gao, J., Chen, W.: Deberta: Decoding-enhanced BERT with disentangled attention. In: International Conference on Learning Representations (2021). https://openreview.net/forum?id=XPZIaotutsD

  17. Huang, M., Huang, Z., Kong, L.: Encoded classifier using knowledge distillation for multi-author writing style analysis. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  18. Huang, Z., Kong, L., Huang, M.: Authorship verification based on CoSENT. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  19. Ibrahim, M., et al.: Enhancing authorship verification using sentence-transformers. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  20. Jacobo, G., Dehesa, V., Rojas, D., Gómez-Adorno, H.: Authorship verification machine learning methods for style change detection in texts. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  21. Kestemont, M., Stover, J., Koppel, M., Karsdorp, F., Daelemans, W.: Authenticating the writings of Julius Caesar. Expert Syst. Appl. 63, 86–96 (2016)

    Article  Google Scholar 

  22. Kestemont, M., et al.: Overview of the author identification task at PAN 2018: cross-domain authorship attribution and style change detection. In: CLEF 2018 Labs and Workshops, Notebook Papers (2018)

    Google Scholar 

  23. Koppel, M., Winter, Y.: Determining if two documents are written by the same author. J. Assoc. Inf. Sci. Technol. 65(1), 178–187 (2014)

    Article  Google Scholar 

  24. Kucukkaya, I.E., Sahin, U., Toraman, C.: ARC-NLP at PAN 23: transition-focused natural language inference for writing style detection. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  25. Kumar, A., Saeed, A.A., Trinh, L.H.M.: Profiling cryptocurrency influencers with few shot learning. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  26. Labadie, R., Sarvazyan, A.M.: Reshape or update? metric learning and fine-tuning for low-resource influencer profiling. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  27. Lakshmaiah, S.H., Hegde, A., Balouchzahi, F.: Trigger detection in social media text. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  28. Li, J., Zhang, Q., Huang, M.: Author verification of text fragments based on the Bert model. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  29. Li, Z., Han, Z., Cai, J., Huang, Z., Huang, S., Kong, L.: CLEM4PCI: profiling cryptocurrency influencers with few-shot learning via contrastive learning and ensemble model. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  30. Liu, X., Kong, L., Huang, M.: Text-segment interaction for authorship verification using BERT-based classification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  31. Lomonaco, F., Siino, M., Tesconi, M.: Text enrichment with Japanese language to profile cryptocurrency influencers. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  32. LSA, U.: An Introduction to Content Warnings and Trigger Warnings (2023). https://sites.lsa.umich.edu/inclusive-teaching-sandbox/wp-content/uploads/sites/853/2021/02/An-Introduction-to-Content-Warnings-and-Trigger-Warnings-Draft.pdf. Accessed 10 May 2023

  33. Lv, J., Han, Y., Dong, Q.: Application of R-drop in author authorship verification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  34. Martinez-Galicia, J.A., Embarcadero-Ruiz, D., Rios-Orduna, A., Gómez-Adorno, H.: Graph-based siamese network for authorship verification. In: CLEF 2022 Labs and Workshops, Notebook Papers, CEUR-WS.org (2022)

    Google Scholar 

  35. Mollá, I.F., Jordà, J.S.: Profiling cryptocurrency influencers with few-shot learning. Overview for PAN at CLEF 2023. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  36. Mueller, T., Pérez-Torró, G., Franco-Salvador, M.: Few-shot learning with Siamese networks and label tuning. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 8532–8545 (2022)

    Google Scholar 

  37. Müller, T., Pérez-Torró, G., Basile, A., Franco-Salvador, M.: Active few-shot learning with fasl. arXiv preprint arXiv:2204.09347 (2022)

  38. Muslihuddeen, H., Sathvika, P., Sankar, S., Ostwal, S., Kumar, D.A.: Profiling cryptocurrency influencers using few-shot learning. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  39. Najafi, M., Tavan, E.: Text-to-text transformer in authorship verification via stylistic and semantical analysis. In: CLEF 2022 Labs and Workshops, Notebook Papers, CEUR-WS.org (2022)

    Google Scholar 

  40. Petropoulos, P.: Contrastive learning for authorship verification using BERT and bi-LSTM in a Siamese architecture. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  41. Potthast, M., Gollub, T., Rangel, F., Rosso, P., Stamatatos, E., Stein, B.: Improving the Reproducibility of PAN’s shared tasks: In: Kanoulas, E., et al. (eds.) CLEF 2014. LNCS, vol. 8685, pp. 268–299. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11382-1_22

    Chapter  Google Scholar 

  42. Qiu, Y., Qi, H., Han, Y., Huang, K.: Authorship verification based on SimCSE. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  43. Rangel, F., De-La-Peña-Sarracén, G.L., Chulvi, B., Fersini, E., Rosso, P.: Profiling hate speech spreaders on Twitter task at PAN 2021. In: Faggioli, G., Ferro, N., Joly, A., Maistro, M., Piroi, F. (eds.) CLEF 2021 Labs and Workshops, Notebook Papers, CEUR-WS.org (2021)

    Google Scholar 

  44. Rangel, F., Giachanou, A., Ghanem, B., Rosso, P.: Overview of the 8th author profiling task at PAN 2019: profiling fake news spreaders on Twitter. In: CLEF 2020 Labs and Workshops, Notebook Papers. CEUR Workshop Proceedings (2020)

    Google Scholar 

  45. Rangel, F., Rosso, P.: On the implications of the general data protection regulation on the organisation of evaluation tasks. Lang. Law/Linguagem Direito 5(2), 95–117 (2019)

    Google Scholar 

  46. Rangel, F., Rosso, P.: Overview of the 7th author profiling task at pan 2019: bots and gender profiling. In: CLEF 2019 Labs and Workshops, Notebook Papers (2019)

    Google Scholar 

  47. Rangel, F., et al.: Overview of the 2nd author profiling task at PAN 2014. In: CLEF 2014 Labs and Workshops, Notebook Papers (2014)

    Google Scholar 

  48. Rangel, F., Rosso, P., Franco-Salvador, M.: A low dimensionality representation for language variety identification. In: Proceedings of the CICLING, pp. 156–169 (2016)

    Google Scholar 

  49. Rangel, F., Rosso, P., Montes-y-Gómez, M., Potthast, M., Stein, B.: Overview of the 6th author profiling task at PAN 2018: multimodal gender identification in Twitter. In: CLEF 2019 Labs and Workshops, Notebook Papers (2018)

    Google Scholar 

  50. Rangel, F., Rosso, P., Moshe Koppel, M., Stamatatos, E., Inches, G.: Overview of the author profiling task at PAN 2013. In: CLEF 2013 Labs and Workshops, Notebook Papers (2013)

    Google Scholar 

  51. Rangel, F., Rosso, P., Potthast, M., Stein, B.: Overview of the 5th author profiling task at PAN 2017: gender and language variety identification in Twitter. Working Notes Papers of the CLEF (2017)

    Google Scholar 

  52. Rangel, F., Rosso, P., Potthast, M., Stein, B., Daelemans, W.: Overview of the 3rd author profiling task at PAN 2015. In: CLEF 2015 Labs and Workshops, Notebook Papers (2015)

    Google Scholar 

  53. Rangel, F., Rosso, P., Verhoeven, B., Daelemans, W., Potthast, M., Stein, B.: Overview of the 4th author profiling task at PAN 2016: cross-genre evaluations. In: CLEF 2016 Labs and Workshops, Notebook Papers (2016). ISSN 1613–0073

    Google Scholar 

  54. Read., U.: Guide to policy and procedures for teaching and learning; Guidance on content warnings on course content (‘trigger’ warnings) (2023). https://www.reading.ac.uk/cqsd/-/media/project/functions/cqsd/documents/qap/trigger-warnings.pdf. Accessed 10 May 2023

  55. Reynier, O.B., Berta, C., Francisco, R., Paolo, R., Elisabetta, F.: Profiling irony and stereotype spreaders on Twitter (irostereo) at PAN 2022. In: CLEF 2021 Labs and Workshops, Notebook Papers (2022)

    Google Scholar 

  56. Rosso, P., Rangel, F., Potthast, M., Stamatatos, E., Tschuggnall, M., Stein, B.: Overview of PAN’16–new challenges for authorship analysis: cross-genre profiling, clustering, diarization, and obfuscation. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction. 7th International Conference of the CLEF Initiative (CLEF 16) (2016)

    Google Scholar 

  57. Sahin, U., Kucukkaya, I.E., Toraman, C.: ARC-NLP at PAN 2023: hierarchical long text classification for trigger detection. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  58. Sanjesh, R., Mangai, A.: A Multi-feature custom classification approach to authorship verification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  59. Sawhney, R., Agarwal, S., Mittal, V., Rosso, P., Nanda, V., Chava, S.: Cryptocurrency bubble detection: a new stock market dataset, financial task & hyperbolic models. In: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 5531–5545 (2022)

    Google Scholar 

  60. Siino, M., Tesconi, M., Tinnirello, I.: Profiling cryptocurrency influencers with few-shot learning using data augmentation and ELECTRA. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  61. Siino, M., Tinnirello, I.: XLNet with data augmentation to profile cryptocurrency influencers. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  62. Stamatatos, E., et al.: Overview of the authorship verification task at PAN 2022. In: CLEF 2022 Labs and Workshops, Notebook Papers, CEUR-WS.org (2022)

    Google Scholar 

  63. Stamatatos, E., et al.: Overview of the authorship verification task at PAN 2023. In: CLEF 2023 Labs and Workshops, Notebook Papers, CEUR-WS.org (2023)

    Google Scholar 

  64. Stamatatos, E., Potthast, M., Rangel, F., Rosso, P., Stein, B.: Overview of the PAN/CLEF 2015 evaluation lab. In: Mothe, J., et al. (eds.) CLEF 2015. LNCS, vol. 9283, pp. 518–538. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24027-5_49

    Chapter  Google Scholar 

  65. Su, Y., Han, Y., Qi, H.: Siamese networks in trigger detection task. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  66. Sun, Y., Afanaseva, S., Patil, K.: Stylometric and neural features combined deep Bayesian classifier for authorship verification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  67. Teahan, W.J., Harper, D.J.: Using compression-based language models for text categorization. In: Croft, W.B., Lafferty, J. (eds.) Language Modeling for Information Retrieval. The Springer International Series on Information Retrieval, vol. 13, pp. 141–165. Springer, Netherlands (2003). https://doi.org/10.1007/978-94-017-0171-6_7

    Chapter  MATH  Google Scholar 

  68. Troiano, E., Padó, S., Klinger, R.: Emotion ratings: How intensity, annotation confidence and agreements are entangled. arXiv preprint arXiv:2103.01667 (2021)

  69. Tschuggnall, M., et al.: Overview of the author identification task at PAN 2017: style breach detection and author clustering. In: CLEF 2017 Labs and Workshops, Notebook Papers (2017)

    Google Scholar 

  70. Valenzuela, A.V., Adorno, H.G., Galicia, J.A.M.: Heterogeneous-graph convolutional network for authorship verification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  71. Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  72. Villa-Cueva, E., Valles-Silva, J.M., Lopez-Monroy, A.P., Sanchez-Vega, F., Lopez-Santillan, J.R.: Integrating fine-tuned language models and entailment-based approaches for low-resource tweet classification. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  73. Weiss, K., Khoshgoftaar, T.M., Wang, D.D.: A survey of transfer learning. J. Big Data 3(1), 1–40 (2016). https://doi.org/10.1186/s40537-016-0043-6

    Article  Google Scholar 

  74. Wiegmann, M., Wolska, M., Potthast, M., Stein, B.: Overview of the trigger detection task at PAN 2023. In: CLEF 2023 Labs and Workshops, Notebook Papers, CEUR-WS.org (2023)

    Google Scholar 

  75. Wiegmann, M., Wolska, M., Schröder, C., Borchardt, O., Stein, B., Potthast, M.: Trigger warning assignment as a multi-label document classification problem. In: Proceedings of the 61th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Toronto, Canada (2023)

    Google Scholar 

  76. Ye, Z., Zhong, C., Qi, H., Han, Y.: Supervised contrastive learning for multi-author writing style analysis. In: Aliannejadi, M., Faggioli, G., Ferro, N., Vlachos, M. (eds.) Working Notes of CLEF 2023 - Conference and Labs of the Evaluation Forum, CEUR-WS.org (2023)

    Google Scholar 

  77. Zangerle, E., Mayerl, M., Potthast, M., Stein, B.: Overview of the style change detection task at PAN 2021. In: Faggioli, G., Ferro, N., Joly, A., Maistro, M., Piroi, F. (eds.) CLEF 2021 Labs and Workshops, Notebook Papers, CEUR-WS.org (2021)

    Google Scholar 

  78. Zangerle, E., Mayerl, M., Potthast, M., Stein, B.: Overview of the style change detection task at PAN 2022. In: CLEF 2022 Labs and Workshops, Notebook Papers, CEUR-WS.org (2022)

    Google Scholar 

  79. Zangerle, E., Mayerl, M., Potthast, M., Stein, B.: Overview of the style change detection task at PAN 2023. In: CLEF 2023 Labs and Workshops, Notebook Papers, CEUR-WS.org (2023)

    Google Scholar 

  80. Zangerle, E., Mayerl, M., Specht, G., Potthast, M., Stein, B.: Overview of the style change detection task at PAN 2020. In: CLEF 2020 Labs and Workshops, Notebook Papers (2020)

    Google Scholar 

  81. Zangerle, E., Tschuggnall, M., Specht, G., Stein, B., Potthast, M.: Overview of the style change detection task at PAN 2019. In: CLEF 2019 Labs and Workshops, Notebook Papers (2019)

    Google Scholar 

Download references

Acknowledgments

The work from Symanto has been partially funded by the Pro\(^2\)Haters - Proactive Profiling of Hate Speech Spreaders (CDTi IDI-20210776), the XAI-DisInfodemics: eXplainable AI for disinformation and conspiracy detection during infodemics (MICIN PLEC2021-007681), the OBULEX - OBservatorio del Uso de Lenguage sEXista en la red (IVACE IMINOD/2022/106), and the ANDHI - ANomalous Diffusion of Harmful Information (CPP2021-008994) R &D grants.

The work of Paolo Rosso was in the framework of the FairTransNLP research project (PID2021-124361OB-C31), funded by MCIN/AEI/10.13039/501100011033 and by ERDF, EU A way of making Europe.

This work has been partially supported by the OpenWebSearch.eu project (funded by the EU; GA 101070014).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matti Wiegmann .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bevendorff, J. et al. (2023). Overview of PAN 2023: Authorship Verification, Multi-Author Writing Style Analysis, Profiling Cryptocurrency Influencers, and Trigger Detection. In: Arampatzis, A., et al. Experimental IR Meets Multilinguality, Multimodality, and Interaction. CLEF 2023. Lecture Notes in Computer Science, vol 14163. Springer, Cham. https://doi.org/10.1007/978-3-031-42448-9_29

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42448-9_29

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42447-2

  • Online ISBN: 978-3-031-42448-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics