Advertisement

Implementing a Linguistic Query Language for Historic Texts

  • Lukas C. Faulstich
  • Ulf Leser
  • Thorsten Vitt
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4254)

Abstract

We describe the design and implementation of the linguistic query language DDDquery. This language aims at querying a large linguistic database storing a corpus of richly annotated historic German texts. We use a graph-based data model that supports multiple independent annotation layers on a shared text layer as well as alignments of text layers representing the same text or related texts (e.g., translations). The corpus is stored in an object-relational database system with a text retrieval extension.

DDDquery is based on XPath to leverage the familiarity of many users with this language. It is translated to SQL in a two phase compilation with first order logic as an intermediate language. This approach effectively decouples the query language from the schema of the underlying corpus.

We provide an overview of DDDquery, the underlying ODAG data model, its implementation as relational schema, the predicates of the intermediate language, and describe both phases of the translation process.

Keywords

Query Language Node Test Annotate Corpus Path Expression Sample Query 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Lüdeling, A., Poschenrieder, T., Faulstich, L.C.: DeutschDiachronDigital - Ein diachrones Korpus des Deutschen. In: Jahrbuch für Computerphilologie, vol. 6, pp. 119–136. Mentis Verlag (2004)Google Scholar
  2. 2.
    Faulstich, L.C., Leser, U., Lüdeling, A.: Storing and Querying Historical Texts in a Relational Database. Informatik-Bericht 176, Inst. für Informatik, Humboldt-Universität zu Berlin (2005)Google Scholar
  3. 3.
    Carletta, J., Kilgour, J., O’Donnell, T., Evert, S., Voormann, H.: The NITE object model library for handling structured linguistic annotation on multimodal data sets. In: 3rd Workshop on NLP and XML, NLPXML 2003 (2003)Google Scholar
  4. 4.
    Dekhtyar, A., Iacob, I.E.: A framework for management of concurrent XML markup. Data and Knowledge Engineering 52, 185–208 (2005)CrossRefGoogle Scholar
  5. 5.
    Dipper, S., Faulstich, L.C., Leser, U., Lüdeling, A.: Challenges in Modelling a Richly Annotated Diachronic Corpus of German. In: Workshop on XML-based richly annotated corpora, Lisbon, Portugal (2004)Google Scholar
  6. 6.
    Christ, O.: A modular and flexible architecture for an integrated corpus query system. In: COMPLEX 1994, Budapest (1994)Google Scholar
  7. 7.
    Lezius, W.: Ein Suchwerkzeug für syntaktisch annotierte Textkorpora. Ph.D thesis, Institut für maschinelle Textverarbeitung (IMS), Universität Stuttgart (2002)Google Scholar
  8. 8.
    Bird, S., Chen, Y., Davidson, S., Leea, H., Zheng, Y.: Extending XPath to Support Linguistic Queries. In: Workshop on Programming Language Technologies for XML (PLAN-X) (2005)Google Scholar
  9. 9.
    Vitt, T.: Speicherung linguistischer Korpora in Datenbanken. Studienarbeit, Institut für Informatik, Humboldt Universität zu Berlin (2004)Google Scholar
  10. 10.
    Grust, T., Keulen, M.V., Teubner, J.: Accelerating XPath evaluation in any RDBMS. ACM Transactions on Database Systems 29(1), 91–131 (2004)CrossRefGoogle Scholar
  11. 11.
    Trissl, S., Leser, U.: Querying ontologies in relational database systems. In: Ludäscher, B., Raschid, L. (eds.) DILS 2005. LNCS (LNBI), vol. 3615, pp. 63–79. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  12. 12.
    Vitt, T.: DDDquery: Anfragen an komplexe KorporaDiplomarbeit, Institut für Informatik. Humboldt-Universität zu, Berlin (2005)Google Scholar
  13. 13.
    Lai, C., Bird, S.: Querying and updating treebanks: A critical survey and requirements analysis. In: Proceedings of the Australasian Language Technology Workshop (2004)Google Scholar
  14. 14.
    Faulstich, L.C., Leser, U.: Implementing Linguistic Query Languages Using LoToSInformatik-Bericht 195, Institut für Informatik, Humboldt-Universität zu, Berlin (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Lukas C. Faulstich
    • 1
  • Ulf Leser
    • 1
  • Thorsten Vitt
    • 1
  1. 1.Institut für InformatikHumboldt-Universität zu BerlinBerlin

Personalised recommendations