Skip to main content

A Corpus-Based Methodology for Evaluating Metrics of Coherence for Text Structuring

  • Conference paper
Natural Language Generation (INLG 2004)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3123))

Included in the following conference series:

  • 468 Accesses

Abstract

This paper presents a novel corpus-based methodology for comparing metrics of coherence with respect to their potential usefulness for text structuring. Different definitions of such metrics, all using notions from Centering Theory, are discussed, and the methodology is applied to existing data derived from the MPIRO generation system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brennan, S., Friedman [Walker], M., Pollard, C.: A centering approach to pronouns. In: Proceedings of ACL 1987, pp. 155–162 (1987)

    Google Scholar 

  2. Dimitromanolaki, A., Androutsopoulos, I.: Learning to order facts for discourse planning in natural language generation. In: Proceedings of the 9th EuropeanWorkshop on Natural Language Generation (2003)

    Google Scholar 

  3. Grosz, B., Joshi, A., Weinstein, S.: Centering: A framework for modeling the local coherence of discourse. Computational Linguistics 21(2), 203–225 (1995)

    Google Scholar 

  4. Isard, A., Oberlander, J., Androutsopoulos, I., Matheson, C.: Speaking the users’ languages. IEEE Intelligent Systems Magazine 18(1), 40–45 (2003)

    Article  Google Scholar 

  5. Karamanis, N., Manurung, H.: Stochastic text structuring using the principle of continuity. In: Proceedings of INLG 2002, pp. 81–88 (2002)

    Google Scholar 

  6. Karamanis, N.: Entity Coherence for Descriptive Text Structuring. Ph.D. thesis, Division of Informatics, University of Edinburgh (2003)

    Google Scholar 

  7. Kibble, R., Power, R.: An integrated framework for text planning and pronominalisation. In: Proceedings of INLG 2000, pp. 77–84 (2000)

    Google Scholar 

  8. Kittredge, R., Korelsky, T., Rambow, O.: On the need for domain communication knowledge. Computational Intelligence 7, 305–314 (1991)

    Article  Google Scholar 

  9. Knott, A., Oberlander, J., O’Donnell, M., Mellish, C.: Beyond elaboration: The interaction of relations and focus in coherent text. In: Sanders, T., Schilperoord, J., Spooren, W. (eds.) Text Representation: Linguistic and Psycholinguistic Aspects, ch.7, pp. 181–196. John Benjamins, Amsterdam (2001)

    Google Scholar 

  10. Lapata, M.: Probabilistic text structuring: Experiments with sentence ordering. In: Proceedings of ACL 2003 (2003)

    Google Scholar 

  11. Mellish, C., Knott, A., Oberlander, J., O’Donnell, M.: Experiments using stochastic search for text planning. In: Proceedings of the 9th International Workshop on NLG, pp. 98–107 (1998)

    Google Scholar 

  12. Miltsakaki, M., Kukich, K.: The role of centering theory’s rough-shift in the teaching and evaluation of writing skills. In: Proceedings of ACL 2000 (2000)

    Google Scholar 

  13. O’Donnell, M., Mellish, C., Oberlander, J., Knott, A.: ILEX: An architecture for a dynamic hypertext generation system. Natural Language Engineering 7(3), 225–250 (2001)

    Google Scholar 

  14. Poesio, M., Stevenson, R., Di Eugenio, B., Hitzeman, J.: Centering: a parametric theory and its instantiations. Computational Linguistics (2004) (in press)

    Google Scholar 

  15. Reiter, E., Sripada, S.: Should corpora texts be gold standards for NLG? In: Proceedings of INLG 2002, pp. 97–104 (2002)

    Google Scholar 

  16. Strube, M., Hahn, U.: Functional centering: Grounding referential coherence in information structure. Computational Linguistics 25(3), 309–344 (1999)

    Google Scholar 

  17. Walker, M., Joshi, A., Prince, E.: Centering in naturally occuring discourse: An overview. In: Walker, M., Joshi, A., Prince, E. (eds.) Centering Theory in Discourse, pp. 1–30. Clarendon Press, Oxford (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Karamanis, N., Mellish, C., Oberlander, J., Poesio, M. (2004). A Corpus-Based Methodology for Evaluating Metrics of Coherence for Text Structuring. In: Belz, A., Evans, R., Piwek, P. (eds) Natural Language Generation. INLG 2004. Lecture Notes in Computer Science(), vol 3123. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27823-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-27823-8_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22340-5

  • Online ISBN: 978-3-540-27823-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics