Language Resources and Evaluation

, Volume 43, Issue 2, pp 105–121

Classification of semantic relations between nominals

  • Roxana Girju
  • Preslav Nakov
  • Vivi Nastase
  • Stan Szpakowicz
  • Peter Turney
  • Deniz Yuret

DOI: 10.1007/s10579-009-9083-2

Cite this article as:
Girju, R., Nakov, P., Nastase, V. et al. Lang Resources & Evaluation (2009) 43: 105. doi:10.1007/s10579-009-9083-2


The NLP community has shown a renewed interest in deeper semantic analyses, among them automatic recognition of semantic relations in text. We present the development and evaluation of a semantic analysis task: automatic recognition of relations between pairs of nominals in a sentence. The task was part of SemEval-2007, the fourth edition of the semantic evaluation event previously known as SensEval. Apart from the observations we have made, the long-lasting effect of this task may be a framework for comparing approaches to the task. We introduce the problem of recognizing relations between nominals, and in particular the process of drafting and refining the definitions of the semantic relations. We show how we created the training and test data, list and briefly describe the 15 participating systems, discuss the results, and conclude with the lessons learned in the course of this exercise.


Semantic relations Nominals Classification SemEval 

Copyright information

© Her Majesty the Queen in right of Canada 2009

Authors and Affiliations

  • Roxana Girju
    • 1
  • Preslav Nakov
    • 2
    • 3
  • Vivi Nastase
    • 4
  • Stan Szpakowicz
    • 5
    • 6
  • Peter Turney
    • 7
  • Deniz Yuret
    • 8
  1. 1.University of Illinois at Urbana-ChampaignUrbanaUSA
  2. 2.University of California at BerkeleyBerkeleyUSA
  3. 3.Bulgarian Academy of SciencesSofiaBulgaria
  4. 4.EML Research gGmbHHeidelbergGermany
  5. 5.University of OttawaOttawaCanada
  6. 6.Polish Academy of SciencesWarszawaPoland
  7. 7.National Research Council of CanadaOttawaCanada
  8. 8.Koç UniversitySarıyer, IstanbulTurkey

Personalised recommendations