Skip to main content

Automatic Recognition of Gender and Genre in a Corpus of Microtexts

  • Conference paper
  • First Online:
  • 618 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1173))

Abstract

In this paper, we focus on author’s gender and writing genre recognition solely on books titles. We analyse data extracted from the bibliography resources of the National Library of Poland. Within a paper, we compare different methods of text (title) representation and classification. It includes word embedding models such as word2vec, ELMo and classification algorithms such as linear models, multilayer perceptron and bidirectional LSTM. It is shown, that the writing genre (for defined 28 classes) could be automatically recognized based only on the book title with accuracy equal to 0.74. The best results were achieved by fastText methods with word n-grams.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://www.bn.org.pl/en/catalogues-and-bibliographies.

  2. 2.

    http://data.bn.org.pl/db/bibs-ksiazka.marc.

  3. 3.

    http://hdl.handle.net/11321/606.

References

  1. Baj, M., Walkowiak, T.: Computer based stylometric analysis of texts in polish language. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) Artificial Intelligence and Soft Computing, pp. 3–12. Springer, Cham (2017)

    Chapter  Google Scholar 

  2. Eder, M., Piasecki, M., Walkowiak, T.: An open stylometric system based on multilevel text analysis. Cogn. Stud. \(|\) Etudes cognitives 17, 267–287 (2017)

    Google Scholar 

  3. Harris, Z.S.: Distributional structure. Word 10(2–3), 146–162 (1954)

    Article  Google Scholar 

  4. Hastie, T.J., Tibshirani, R.J., Friedman, J.H.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer Series in Statistics. Springer, New York (2009). autres impressions: 2011 (corr.), 2013 (7e corr.)

    Book  Google Scholar 

  5. Joulin, A., Grave, E., Bojanowski, P., Mikolov, T.: Bag of tricks for efficient text classification. In: Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, pp. 427–431. Association for Computational Linguistics (2017). http://aclweb.org/anthology/E17-2068

  6. Kocon, J., Gawor, M.: Evaluating KGR10 polish word embeddings in the recognition of temporal expressions using BiLSTM-CRF. CoRR abs/1904.04055 (2019). http://arxiv.org/abs/1904.04055

  7. Le, Q., Mikolov, T.: Distributed representations of sentences and documents. In: International Conference on Machine Learning, pp. 1188–1196 (2014)

    Google Scholar 

  8. Mikros, G., Perifanos, K.: Authorship Attribution in Greek Tweets Using Author’s Multilevel N-gram Profiles, pp. 17–23. AAAI Press, Palo Alto (2013)

    Google Scholar 

  9. Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., Zettlemoyer, L.: Deep contextualized word representations. In: Proceedings of NAACL (2018)

    Google Scholar 

  10. Schuster, M., Paliwal, K.K.: Bidirectional recurrent neural networks. IEEE Trans. Signal Process. 45(11), 2673–2681 (1997)

    Article  Google Scholar 

  11. Schwartz, R., Tsur, O., Rappoport, A., Koppel, M.: Authorship attribution of micro-messages. In: Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, Washington, USA, pp. 1880–1891. Association for Computational Linguistics, October 2013. https://www.aclweb.org/anthology/D13-1193

  12. Silessi, S., Varol, C., Karabatak, M.: Identifying gender from SMS text messages. In: 15th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 488–491 (12 2016)

    Google Scholar 

  13. Thomale, J.: Interpreting MARC: where’s the bibliographic data? Code4Lib J. (11) (2010). https://journal.code4lib.org/articles/3832

  14. Torkkola, K.: Discriminative features for textdocument classification. Formal Pattern Anal. Appl. 6(4), 301–308 (2004). https://doi.org/10.1007/s10044-003-0196-8

    Article  MathSciNet  Google Scholar 

  15. Walkowiak, T., Datko, S., Maciejewski, H.: Bag-of-words, bag-of-topics and word-to-vec based subject classification of text documents in polish - a comparative study. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds.) Contemporary Complex Systems and Their Dependability, pp. 526–535. Springer, Cham (2019)

    Chapter  Google Scholar 

  16. Walkowiak, T., Datko, S., Maciejewski, H.: Low-dimensional classification of text documents. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds.) Engineering in Dependability of Computer Systems and Networks, pp. 534–543. Springer, Cham (2020)

    Chapter  Google Scholar 

  17. Walkowiak, T., Piasecki, M.: Stylometry analysis of literary texts in polish. In: Rutkowski, L., Scherer, R., Korytkowski, M., Pedrycz, W., Tadeusiewicz, R., Zurada, J.M. (eds.) Artificial Intelligence and Soft Computing, pp. 777–787. Springer, Cham (2018)

    Chapter  Google Scholar 

  18. Yeo, I.K., Johnson, R.A.: A new family of power transformations to improve normality or symmetry. Biometrika 87(4), 954–959 (2000)

    Article  MathSciNet  Google Scholar 

  19. Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. J. Roy. Stat. Soc. B 67, 301–320 (2005)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tomasz Walkowiak .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pawłowski, A., Walkowiak, T. (2020). Automatic Recognition of Gender and Genre in a Corpus of Microtexts. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Theory and Applications of Dependable Computer Systems. DepCoS-RELCOMEX 2020. Advances in Intelligent Systems and Computing, vol 1173. Springer, Cham. https://doi.org/10.1007/978-3-030-48256-5_46

Download citation

Publish with us

Policies and ethics