Skip to main content
SpringerLink
Log in

Word Segmentation for Text in Japanese Ancient Writings Based on Probability of Character N-Grams

  • Conference paper
The Outreach of Digital Libraries: A Globalized Resource Network (ICADL 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7634))

Included in the following conference series:

Abstract

Currently, there are few available tools to separate ancient Japanese sentences into words. Therefore, it is difficult to extract archaic Japanese words from Japanese ancient writings. We propose a method of word segmentation for Japanese ancient writings. We calculate the likelihood of character n-grams to be words, and extract character n-grams with higher likelihood as archaic Japanese words. We conducted word separation experiments using the term likelihood with the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sproat, R., Shih, C.: A statistical method for finding word boundaries in Chinese text. Computer Processing of Chinese & Oriental Languages 4(4), 336–351 (1990)

    Google Scholar 

  2. Mochihashi, D., Yamada, T., Ueda, N.: Bayesian Unsupervised Word Segmentation with Nested Pitman-Yor Language Modeling. In: Proc. ACL-IJCNLP 2009, pp. 100–108 (2009)

    Google Scholar 

  3. Maeda, A., Sadat, F., Yoshikawa, M., Uemura, S.: Query term disambiguation for Web cross-language information retrieval using a search engine. In: Proc. IRAL 2000, pp. 25–32 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Information Science and Engineering, Ritsumeikan University, Japan

    Mamoru Yoshimura

  2. College of Information Science and Engineering, Ritsumeikan University, Japan

    Fuminori Kimura & Akira Maeda

Authors
  1. Mamoru Yoshimura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fuminori Kimura
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Akira Maeda
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. National Taiwan University, No. 1, Sec.4, Roosevelt Road, 10617, Taipei, Taiwan

    Hsin-Hsi Chen

  2. University of Technology Sydney, Broadway, PO Box 123, 2007, Sydney, NSW, Australia

    Gobinda Chowdhury

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yoshimura, M., Kimura, F., Maeda, A. (2012). Word Segmentation for Text in Japanese Ancient Writings Based on Probability of Character N-Grams. In: Chen, HH., Chowdhury, G. (eds) The Outreach of Digital Libraries: A Globalized Resource Network. ICADL 2012. Lecture Notes in Computer Science, vol 7634. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-34752-8_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-34752-8_38

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-34751-1

  • Online ISBN: 978-3-642-34752-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation