Skip to main content

POMET: a corpus for poetic meter classification

Abstract

The availability of appropriate research corpora is a fundamental concern in music information retrieval research. This paper addresses the design, development, and evaluation of a poetic corpus, POMET, for the meter estimation task. Poems, which communicate through rhythm and apparent meaning, have a vital role in many literary traditions. Metrical rhythm generally involves periodic arrangements of sequences of stressed and unstressed syllables in each line of poems. It has already been proved that poetry’s aesthetic and emotional perception can be studied well using poetic meter analysis. A corpus with eight meters is designed and recorded in a studio environment for Malayalam, one of the prominent languages in South India. Using deep neural network architectures, a pilot evaluation is performed with musical texture features and spectrograms. We hope that the corpus can be used as a benchmark dataset for poetic meter estimation, rhythmic analysis, and corpus-based prosody analysis.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Data Availability

The datasets analyzed in this manuscript are made publicly available in the URL given in the paper. Requests to the datasets can also be sent to rajeev@cet.ac.in.

Notes

  1. https://en.wikipedia.org/wiki/Malayalam.

  2. A language stream obtained by combining the native tongue and Sanskrit pleasingly.

  3. https://staff.aist.go.jp/m.goto/RWC-MDB/.

  4. https://zenodo.org/.

  5. Tanpura is a string instrument that supports and sustains the melody of the singer by providing a continuous harmonic bourdon or drone.

  6. Vamp plug-in. MELODIA- melody extraction vamp plug-in: https://www.upf.edu/web/mtg.

  7. https://en.unesco.org/silkroad/silk-road-themes/intangible-cultural-heritage/al-taghrooda-traditional-bedouin-chanted-poetry.

  8. http://aflang.humanities.ucla.edu/language-materials/chadic-languages/hausa/hausa-poetry-song/.

References

  • Agirrezabal, M., Alegria, I., & Hulden, M. (2016). Machine learning for metrical analysis of englishpoetry. In Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers (pp. 772–781).

  • Cakr, E., Parascandolo, G., Heittola, T., Huttunen, H., & Virtanen, T. (2017). Convolutional recurrent neural networks for polyphonic sound event detection. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 25(6), 1291–1303.

    Article  Google Scholar 

  • Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., & Bougares, F. (2014). Schwenk,H.: Learning phrase representation using RNN encoder-decoder for machine translation,computation and language. Retrieved from arXiv:1406.1078

  • Christian, O., Winfried, M., Martin, K., Tim, R., Maren, S., Sascha, O., & Sonja, A. K. (2013). Aesthetic and emotional effects of meter and rhyme in poetry. Frontiers in Psychology, 4, 1–10.

    Article  Google Scholar 

  • Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neuronal networks on sequence modeling, neuronal and evolutionary computing. Retrieved from arXiv:1412.3555

  • Cieri, C., Maxwell, M., Strassel, S., & Tracey, J. (2016). Selection criteria for low resource language programs. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16) (pp. 4543–4549).

  • Cui, Z., Ke, R., Pu, Z., & Wang, Y. (2018). Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. Retrieved from arXiv:1801.02143

  • Dehak, N., Kenny, P., Dehak, R., Dumouchel, P., & Ouellet, P. (2011). Front-end factor analysis for speaker verification. IEEE Transactions on Audio, Speech, and Language Processing, 19, 788–798.

    Article  Google Scholar 

  • Deo, A. S. (2007). The metrical organization of classical Sanskrit verse. Journal of Linguistics, 43(1), 63–114.

    Article  Google Scholar 

  • Dixon, S. (2006). Onset detection revisited. In Proceedings of the International Conference on Digital Audio Effects (DAFx06) (pp. 1–6).

  • Elizalde, B., Lei, H., & Friedland., G.: An i-vector representation of acoustic environments for audio-based video event detection on user generated content. In Proceedings of IEEE International Symposium on Multimedia (pp. 114–117).

  • Francesc, A., Joan, C. S., & Xavier, S. (2016). A review of physical and perceptual feature extraction techniques for speech, music and environmental sounds. Applied Science, 6(5), 1–44.

    Google Scholar 

  • Geetanjali, R., Ghosh, A., Bhattacharyya, P., & Haffari, G. (2015). Automated analysis of Bangla poetry for classification and poet identification. In Proceedings of the 12th International Conference on Natural Language Processing (pp. 247–253).

  • Genzel, D., Uszkoreit, J., & Och, F. (2010). Poetic statistical machine translation: Rhyme and meter. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (pp. 158–166).

  • Geron, A. (2018). Hands on machine learning with scikit-learn and tensorflow. OReilly.

    Google Scholar 

  • Gimeno, P., Vinals, I., Ortega, A., Miguel, A., & Lleida, E. (2020). Multiclass audio segmentation based on recurrent neural networks for broadcast domain data. EURASIP Journal on Audio, Speech, and Music Processing, 2020, 1–19.

    Article  Google Scholar 

  • Greene, E., Bodrumlu, T., & Knight, K. (2010). Automatic analysis of rhythmic poetry with applications to generation and translation. Proceedings of the Conference on Empirical Methods in Natural Language Processing, 4(10), 524–533.

    Google Scholar 

  • Gruber, N., & Jockisch, A. (2020). Are GRU cells more specific and LSTM cells more sensitive in motive classification of text? Frontiers in Artificial Intelligence,. 3, 40.

    Article  Google Scholar 

  • Gulati, S., Rao, V., & Rao, P. (2012). Meter detection from audio for Indian music (pp. 34–43). Speech, Sound and Music Processing: Embracing Research in India.

    Google Scholar 

  • Hamidi, S., Razzazi, F., & Ghaemmaghami, M. P. (2009). Automatic meter classification in Persian poetries using support vector machines. In Proceedings of IEEE International Conference on Signal Processing and Information Technology (pp. 563–567).

  • Jamal, N., Mohd, M., & Noah, S. A. (2012). Poetry classification using support vector machines. Journal of Computer Science, 8(9), 1441–1446.

    Article  Google Scholar 

  • Kenny, P., Boulianne, G., & Dumouchel, P. (2005). Eigenvoice modeling with sparse training data. IEEE Transactions on Speech and Audio Processing, 13, 345–354.

    Article  Google Scholar 

  • Klapuri, A., et al. (2003). Musical meter estimation and music transcription (pp. 40–45). Cambridge Music Processing Colloquium.

    Google Scholar 

  • Li, T., Ogihara, M., & Li, Q. (2003). A comparative study on content-based music genre classification. In Proceedings of the 26th Annual International ACM Conference on Research and development in information retrieval (pp. 282–289).

  • Liu, C., Feng, L., Liu, G., Wang, H., & Liu, S. (2019). Bottom-up broadcast neural network for music genre classification. Pattern Recognition Letters, 80, 1–7.

    Google Scholar 

  • Magueresse, A., Carles, V., & Heetderks, E. (2020). Low-resource languages: A review of past work and future challenges.

  • Mamede, N., Trancoso, I., Araujo, P., & Viana, C. (2004). An electronic assistant for poetry writing. In Proceedings of Ibero-American Conference on Artificial Intelligence, pp. 286–294.

  • McKinney, M.F., & Moelants., D. (2006). Audio beat tracking from mirex 2006.Web resource. Retrieved from http://www.music-ir.org/mirex2006/index.php/AudioBeatTracking

  • Menninghaus, W., Wagner, V., Knoop, C., & Scharinger, M. (2018). Poetic speech melody: A crucial link between music and language. PLoS ONE, 13(11), 1–5.

    Article  Google Scholar 

  • Mikel, G. (2009) . Automatic musical meter detection. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 329–332). IEEE.

  • Miron., M. (2011). Automatic detection of Hindustani Talas. Master Thesis, Music Technology Group, Universitat Pompeu Fabra, Spain.

  • Namboodiri, A., Narayanan, P., & Jawahar, C. (2007). On using classical poetry structure for Indian language post-processing. In Proceedings of International Conference on Document Analysis and Recognition (pp. 1238–1242).

  • Olivier, L., Toiviainen, P., & Eerola, T. (2008). A Matlab toolbox for music information retrieval. In C. Preisach, H. Burkhardt, L. Schmidt-Thieme, & R. Decker (Eds.), Data analysis, machine learning and applications. Studies in classification, data analysis, and knowledge organization (pp. 261–268). Springer.

    Google Scholar 

  • Pons, J., Lidy, T., & Serra, X. (2016). Experimenting with musically motivated convolutionalneural networks. In Proceedings of 14th International Workshop on Content-Based Multimedia Indexing (pp. 1–6).

  • Radford, A. , Metz, L. (2016) Soumith Chintala: Unsupervised representation learning with deep convolutional generative adversarial networks. In Proceedings of ICLR.

  • Rajan, R., Kumar, A. V., & Babu, B. P. (2020). Poetic meter classification using i-vector-MTF fusion. In Proceedings of INTERSPEECH.

  • Rajan, R., & Raju, A. A. (2018). Poetic meter classification using acoustic cues. In Proceedings of International Conference on Signal Processing and Communications (SPCOM) (pp. 31–35).

  • Rajan, R., & Raju, A. A. (2019). Deep neural network based poetic meter classification using musical texture feature fusion. In Proceedings of 27th European Signal Processing Conference (EUSIPCO) (pp. 1–5).

  • Rajesh, S., & Nalini, N. (2020). Musical instrument emotion recognition using deep recurrent neural network. Procedia Computer Science, 167, 16–25.

    Article  Google Scholar 

  • Richard, G., Sundaram, S., & Narayanan, S. (2013). An overview on perceptually motivated audio indexing and classification. Proceedings of the IEEE, 101(9), 1939–1954.

    Article  Google Scholar 

  • Salamon, J., & Bello, J. P. (2016). Deep convolutional neural networks and data augmentation for environmental sound classification. IEEE Signal Processing Letters, 52(1), 1–5.

    Google Scholar 

  • Sbait, D. (1993). Debate in the improvised-sung poetry of the Palestinians. Asian Folklore Studies, 52(1), 93–117.

    Article  Google Scholar 

  • Seppanan, J. (2015). Computational models for musical meter recognition. Masters thesis, Tampere University of Technology, Department of Information Technology.

  • Singh, A. K. (2008). Natural language processing for less privileged languages: Where do we come from? Where are we going? In Proceedings of the IJCNLP-08 Workshop on NLP for Less Privileged Languages.

  • Sreedharan, G. (1975). Malayalam poetry-a kaleidoscopic view. Indian Literature, 18(4), 12–26.

    Google Scholar 

  • Tanasescu, C., Paget, B., & Inkpen, D. (2016). Automatic classification of poetry by meter and rhyme. In Proceedings of the Twenty-Ninth International Flairs Conference.

  • Tang, C. P., Chui, K., Yu, Y., Zeng, Z., & Wong, K. (2018). Music genre classification using a hierarchical long short term memory (LSTM) model. In Proceedings of International Conference on Information Retrieval,Yokohama,Japan (pp. 521–526).

  • Tizhoosh, H. R., Sahba, F., & Dara, R. (2008). Poetic features for poem recognition: A comparative study. Journal of Pattern Recognition Research, 3(1), 24–39.

    Article  Google Scholar 

  • Tsvetkov., Y. (2017). Opportunities and challenges in working with low-resource languages. Carnegie Mellon University.

  • Yi, Y., He, Z., Li, L., Yu, T., & Yi, E. (2005). Advanced studies on traditional Chinese poetry style identification. Proceedings of International Conference on Machine Learning and Cybernetics, 6, 3830–3833.

    Google Scholar 

  • Zhong, J., Hu, W., Soong, F., & Meng, H. (2017). DNN i-vector speaker verification with short,text-constrained test utterances. In Proceedings of the Annual Conference of the International Speech Communication Association (pp. 1507–1511), Interspeech. https://doi.org/10.21437/Interspeech.2017-1036

Download references

Acknowledgements

The authors express sincere gratitude to the singers and technicians who helped us to record this database.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rajeev Rajan.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Rajan, R., Chandrika Reghunath, L. & Varghese, L.T. POMET: a corpus for poetic meter classification. Lang Resources & Evaluation (2022). https://doi.org/10.1007/s10579-022-09604-5

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10579-022-09604-5

Keywords

  • Poetic meter
  • Convolutional neural network
  • I-vector
  • Feature fusion
  • Recurrent neural network