Increasing Recall for Text Re-use in Historical Documents to Support Research in the Humanities
High precision text re-use detection allows humanists to discover where and how particular authors are quoted (e.g., the different sections of Plato’s work that come in and out of vogue). This paper reports on on-going work to provide the high recall text re-use detection that humanists often demand. Using an edition of one Greek work that marked quotations and paraphrases from the Homeric epics as our testbed, we were able to achieve a recall of at least 94% while maintaining a precision of 73%. This particular study is part of a larger effort to detect text re-use across 15 million words of Greek and 10 million words of Latin available or under development as openly licensed TEI XML.
Keywordshistorical text re-use hypertextuality Homer Athenaeus
Unable to display preview. Download preview PDF.
- 2.Potthast, M., Stein, B.: New Issues in Near-duplicate Detection Data Analysis, Machine Learning and Applications. In: Studies in Classification, Data Analysis, and Knowledge Organization, pp. 601–609. Springer, Heidelberg (2008)Google Scholar
- 6.Lee, J.: A computational model of text reuse in ancient literary texts. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, Prague, Czech Republic, Association for Computational Linguistics, pp. 472–479 (June 2007)Google Scholar
- 7.Bourdaillet, J., Ganascia, J.G., Pierre, U., Curie, M.: J.g: Alignment of noisy unstructured text data. In: Proc. of the IJCAI Workshop on Analytics for Noisy Unstructured Text Data (AND 2007) of the 20th International Joint Conference on Artificial Intelligence (IJCAI), pp. 139–146 (2007)Google Scholar
- 8.Trillini, R.H., Quassdorf, S.: A ’key to all quotations’? a corpus-based parameter model of intertextuality. LLC 25(3), 269–286 (2010)Google Scholar
- 9.Coffee, N., Koenig, J.P., Poornim, S., Forstall, C., Ossewaarde, R., Jacobson, S.: The tesserae project: Intertextual analysis of latin poetry (2011), http://dh2011abstracts.stanford.edu/xtf/view?docId=tei/ab-215.xml;query=;brand=default (last accessed February 14, 2012)
- 12.Broder, A.Z.: On the resemblance and containment of documents. In: Compression and Complexity of Sequences (SEQUENCES 1997), pp. 21–29. IEEE Computer Society (1997)Google Scholar