Probabilistic Automaton Model for Fuzzy English-Text Retrieval

  • Manabu Ohta
  • Atsuhiro Takasu
  • Jun Adachi
Conference paper

DOI: 10.1007/3-540-45268-0_4

Part of the Lecture Notes in Computer Science book series (LNCS, volume 1923)
Cite this paper as:
Ohta M., Takasu A., Adachi J. (2000) Probabilistic Automaton Model for Fuzzy English-Text Retrieval. In: Borbinha J., Baker T. (eds) Research and Advanced Technology for Digital Libraries. ECDL 2000. Lecture Notes in Computer Science, vol 1923. Springer, Berlin, Heidelberg

Abstract

Optical character reader (OCR) misrecognition is a serious problem when searching against OCR-scanned documents in databases such as digital libraries. This paper proposes fuzzy retrieval methods for English text that contains errors in the recognized text without cor- recting the errors manually. Costs are thereby reduced. The proposed methods generate multiple search terms for each input query term based on probabilistic automata reflecting both error-occurrence probabilities and character-connection probabilities. Experimental results of test-set retrieval indicate that one of the proposed methods improves the recall rate from 95.56% to 97.88% at the cost of a decrease in precision rate from 100.00% to 95.52% with 20 expanded search terms.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2000

Authors and Affiliations

  • Manabu Ohta
    • 1
  • Atsuhiro Takasu
    • 1
  • Jun Adachi
    • 1
  1. 1.National Institute of Informatics (NII)TokyoJapan

Personalised recommendations