On the Quality of Annotations with Controlled Vocabularies

Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10078)

Abstract

Corpus analysis and controlled vocabularies can benefit from each other in different ways. Usually, a controlled vocabulary is assumed to be in place and is used for improving the processing of a corpus. However, in practice the controlled vocabularies may be not available or domain experts may be not satisfied with their quality. In this work we investigate how one could measure how well a controlled vocabulary fits a corpus. For this purpose we find all the occurrences of the concepts from a controlled vocabulary (in form of a thesaurus) in each document of the corpus. After that we try to estimate the density of information in documents through the keywords and compare it with the number of concepts used for annotations. The introduced approach is tested with a financial thesaurus and corpora of financial news.

Keywords

Controlled vocabulary Thesaurus Corpus analysis Keywords extraction Annotation 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

We would like to thank Ioannis Pragidis for his work on improving the thesaurus, pointing us to the relevant data, and sharing his deep expertize in the subject domain.

References

  1. 1.
    Ahmad, K., Tariq, M., Vrusias, B., Handy, C.: Corpus-based thesaurus construction for image retrieval in specialist domains. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 502–510. Springer, Heidelberg (2003). doi: 10.1007/3-540-36618-0_36 CrossRefGoogle Scholar
  2. 2.
    Aussenac-Gilles, N., Biébow, B., Szulman, S.: Revisiting ontology design: a method based on corpus analysis. In: Dieng, R., Corby, O. (eds.) EKAW 2000. LNCS (LNAI), vol. 1937, pp. 172–188. Springer, Heidelberg (2000). doi: 10.1007/3-540-39967-4_13 CrossRefGoogle Scholar
  3. 3.
    Bechhofer, S., Miles, A.: Skos simple knowledge organization system reference. In: W3C recommendation, W3C (2009)Google Scholar
  4. 4.
    Birkhoff, G.: Lattice Theory, 3rd edn. Am. Math. Soc., Providence (1967)MATHGoogle Scholar
  5. 5.
    Borst, T., Neubert, J.: Case study: publishing stw thesaurus for economics as linked open data. In: W3C Semantic Web Use Cases and Case Studies (2009)Google Scholar
  6. 6.
    Jimeno-Yepes, A.J., Aronson, A.R.: Knowledge-based biomedical word sense disambiguation: comparison of approaches. BMC Bioinform. 11(1), 1–12 (2010)CrossRefGoogle Scholar
  7. 7.
    Kacfah Emani, C.: Automatic detection and semantic formalisation of business rules. In: Presutti, V., d’Amato, C., Gandon, F., d’Aquin, M., Staab, S., Tordai, A. (eds.) ESWC 2014. LNCS, vol. 8465, pp. 834–844. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-07443-6_57 CrossRefGoogle Scholar
  8. 8.
    Levy, F., Guisse, A., Nazarenko, A., Omrane, N., Szulman, S.: An environment for the joint management of written policies and business rules. In: 2010 22nd IEEE International Conference on Tools with Artificial Intelligence, vol. 2, pp. 142–149, October 2010Google Scholar
  9. 9.
    Magerman, D.M., Marcus, M.P.: Parsing a natural language using mutual information statistics. In: AAAI, vol. 90, pp. 984–989 (1990)Google Scholar
  10. 10.
    Mandala, R., Tokunaga, T., Tanaka, H.: Combining multiple evidence from different types of thesaurus for query expansion. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 191–197. ACM (1999)Google Scholar
  11. 11.
    Mani, I., Maybury, M.T.: Advances in Automatic Text Summarization, vol. 293. MIT Press, Cambridge (1999)Google Scholar
  12. 12.
    Neubert, J.: Bringing the “thesaurus for economics” on to the web of linked data. In: LDOW, 25964 (2009)Google Scholar
  13. 13.
    Rose, S., Engel, D., Cramer, N., Cowley, W.: Automatic keyword extraction from individual documents. In: Berry, M.W., Kogan, J. (eds.) Text Mining, pp. 1–20. Wiley, New York (2010)CrossRefGoogle Scholar
  14. 14.
    Shah, P.K., Perez-Iratxeta, C., Bork, P., Andrade, M.A.: Information extraction from full text scientific articles: where are the keywords? BMC Bioinform. 4(1), 1 (2003)CrossRefGoogle Scholar
  15. 15.
    Tan, A.-H., et al.: Text mining: the state of the art and the challenges. In: Proceedings of the PAKDD 1999 Workshop on Knowledge Discovery from Advanced Databases, vol. 8, pp. 65–70 (1999)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Semantic Web CompanyViennaAustria

Personalised recommendations