Domain Adaptation for Dependency Parsing at Evalita 2011

  • Felice Dell’Orletta
  • Simone Marchi
  • Simonetta Montemagni
  • Giulia Venturi
  • Tommaso Agnoloni
  • Enrico Francesconi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7689)


The domain adaptation task was aimed at investigating techniques for adapting state–of–the–art dependency parsing systems to new domains. Both the language dealt with, i.e. Italian, and the target domain, namely the legal domain, represent two main novelties of the task organised at Evalita 2011 with respect to previous domain adaptation initiatives. In this paper, we define the task and describe how the datasets were created from different resources. In addition, we characterize the different approaches of the participating systems, report the test results, and provide a first analysis of these results.


Dependency Parsing Domain Adaptation Self-training Active Learning Legal-NLP 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Attardi, G.: Experiments with a multilanguage non-projective dependency parser. In: Proceedings of the Shared task CoNLL-X, New York City, pp. 166–170 (2006)Google Scholar
  2. 2.
    Attardi, G., Dell’Orletta, F.: Reverse revision and linear tree combination for dependency parsing. In: Proceedings of NAACL-HLT (2009)Google Scholar
  3. 3.
    Attardi, G., Dell’Orletta, F., Simi, M., Turian, J.: Accurate Dependency Parsing with a Stacked Multilayer Perceptron. In: Proceedings of Evalita 2009 (2009)Google Scholar
  4. 4.
    Attardi, G., Simi, M., Zanelli, A.: Domain Adaptation by Active Learning. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds.) EVALITA 2012. LNCS(LNAI), vol. 7689, pp. 77–85. Springer, Heidelberg (2012)Google Scholar
  5. 5.
    Biber, D., Conrad, S., Reppen, R.: Corpus linguistics. Investigating Language Structure and Use. Cambridge University Press (1998)Google Scholar
  6. 6.
    Bonin, F., Dell’Orletta, F., Venturi, G., Montemagni, S.: Singling out Legal Knowledge from World Knowledge. In: Proceedings of the IV Workshop on Legal Ontologies and Artificial Intelligence Techniques (LOAIT 2010), Fiesole, 7 luglio (2010)Google Scholar
  7. 7.
    Bosco, C., Montemagni, S., Mazzei, A., Lombardo, V., Dell’Orletta, F., Lenci, A.: Evalita 2009 Parsing Task: comparing dependency parsers and treebanks. In: Proceedings of Evalita 2009, Reggio Emilia (2009)Google Scholar
  8. 8.
    Bosco, C., Mazzei, A.: The EVALITA Dependency Parsing Task: From 2007 to 2011. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds.) EVALITA 2012. LNCS(LNAI), vol. 7689, pp. 1–12. Springer, Heidelberg (2012)Google Scholar
  9. 9.
    Proceedings of the Workshop on Domain Adaptation for Natural Language Processing (2010),
  10. 10.
    Dell’Orletta, F., Montemagni, S., Venturi, G.: READ–IT: Assessing Readability of Italian Texts with a View to Text Simplification. In: Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies, Edinburgh, Scotland, UK, pp. 73–83 (2011)Google Scholar
  11. 11.
    Frazier, L.: Syntactic complexity. In: Dowty, D.R., Karttunen, L., Zwicky, A.M. (eds.) Natural Language Parsing. Cambridge University Press (1985)Google Scholar
  12. 12.
    Gibson, E.: Linguistic complexity: Locality of syntactic dependencies. Cognition 68(1), 1–76 (1998)CrossRefGoogle Scholar
  13. 13.
    Lease, M., Charniak, E.: Parsing biomedical literature. In: Proceedings of the Second International Joint Conference on Natural Language Processing (IJCNLP 2005), pp. 58–69 (2005)Google Scholar
  14. 14.
    Lin, D.: On the structural complexity of natural language sentences. In: Proceedings of COLING 1996, pp. 729–733 (1996)Google Scholar
  15. 15.
    McClosky, D.: Any Domain Parsing: Automatic Domain Adaptation for Natural Language Parsing. Ph.D. thesis, Brown University (2010)Google Scholar
  16. 16.
    McDonald, R., Crammer, K., Pereira, F.: Online large-margin training of dependency parsers. In: Proceedings of ACL (2005)Google Scholar
  17. 17.
    McDonald, R., Lerman, K., Pereira, F.: Multilingual Dependency Analysis with a Two-Stage Discriminative Parser. In: Proceedings of CoNLL, New York City (2006)Google Scholar
  18. 18.
    McDonald, R., Nivre, J.: Characterizing the Errors of Data-Driven Dependency Parsing Models. In: Proceedings of EMNLP–CoNLL, pp. 122-131 (2007)Google Scholar
  19. 19.
    Nivre, J., Hall, J., Kübler, S., McDonald, R., Nilsson, J., Riedel, S., Yuret, D.: The CoNLL 2007 Shared Task on Dependency Parsing. In: Proceedings of the EMNLP-CoNLL, pp. 915–932 (2007)Google Scholar
  20. 20.
    Plank, B., van Noord, G.: Effective Measures of Domain Similarity for Parsing. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, Portland, Oregon, June 19-24, pp. 1566–1576 (2011)Google Scholar
  21. 21.
    Plank, B., Søgaard, A.: Experiments in Newswire-to-Law Adaptation of Graph-Based Dependency Parsers. In: Magnini, B., Cutugno, F., Falcone, M., Pianta, E. (eds.) EVALITA 2012. LNCS(LNAI), vol. 7689, pp. 70–76. Springer, Heidelberg (2012)Google Scholar
  22. 22.
    Sagae, K., Tsujii, J.: Dependency Parsing and Domain Adaptation with LR Models and Parser Ensembles. In: Proceedings of the CoNLL Shared Task Session of EMNLP-CoNLL, Prague, pp. 1044–1050 (2007)Google Scholar
  23. 23.
    Venturi, G.: Lingua e diritto: una prospettiva linguistico–computazionale. Ph.D. Thesis, Università di Torino (2011)Google Scholar
  24. 24.
    Yngve, V. H.A.: A model and an hypothesis for language structure. In: Proceedings of the American Philosophical Society, pp. 444–466 (1960)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Felice Dell’Orletta
    • 1
  • Simone Marchi
    • 1
  • Simonetta Montemagni
    • 1
  • Giulia Venturi
    • 2
  • Tommaso Agnoloni
    • 3
  • Enrico Francesconi
    • 3
  1. 1.Istituto di Linguistica Computazionale ”Antonio Zampolli”CNRPisaItaly
  2. 2.Scuola Superiore Sant’Anna di Studi Universitari e di PerfezionamentoPisaItaly
  3. 3.Istituto di Teoria e Tecniche dell’Informazione GiuridicaCNRFirenzeItaly

Personalised recommendations