Advertisement

Grammatical analysis of English by statistical pattern recognition

  • Eric Steven Atwell
Speech And Text
Part of the Lecture Notes in Computer Science book series (LNCS, volume 301)

Abstract

Artificial Intelligence and Computational Linguistics researchers are currently debating the value of ‘Deep’ knowledge-representations in language processing and related computations. Incorporating deep knowledge as well as surface statistical pattern recognition requires much greater processing, but it has been assumed that, for many applications of Artificial Intelligence, purely surface statistical analyses cannot yield useful results. One NLP application provides a counter-argument to this widespread tenet: a system for grammatical error detection, using only probabilistic, Markovian, pattern-matching was devised, and in tests compared favourably with a much larger system which computed deep grammatical analyses of each sentence. Those who argue that statistical pattern recognition has no place in Computational Linguistics or Artificial Intelligence have still to prove their case.

Keywords

Expert System Natural Language Processing Deep Knowledge Computational Linguistics Pattern Recognition Technique 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1).
    Cohn, A G 1985 "Deep Knowledge Representation Techniques" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.Google Scholar
  2. 2).
    Hayes, P J 1979 "The Naive Physics Manifesto" in D Michie (ed), Expert Systems in the Micro Electronic Age Edinburgh University PressGoogle Scholar
  3. 3).
    Forbus, K 1984 "Qualitative Process Theory" in D Bobrow (ed), Qualitative Reasoning about Physical Systems North HollandGoogle Scholar
  4. 4).
    Alvey Directorate 1985 IKBS Report on the first Workshop on Deep Knowledge Institution of Electrical EngineersGoogle Scholar
  5. 5).
    Alvey Directorate 1986 KIBS Report on the second Workshop on Deep Knowledge Institution of Electrical EngineersGoogle Scholar
  6. 6).
    Atwell, E S 1987 "A parsing expert system which learns from corpus analysis" to appear in W Meijs (ed), Corpus Linguistics and Beyond: Proceedings of the ICAME 7th International Conference on English Language Research on Computerised Corpora Rodopi, Amsterdam.Google Scholar
  7. 7).
    Davis R and D Lenat 1982, Knowledge Based Systems in Artificial Intelligence McGraw HillGoogle Scholar
  8. 8).
    Cunningham, J 1985 "Comprehension by model-building as a basis for an expert system" in M Merry (ed), Expert Systems 85: proceedings of the fifth technical conference of the British Computer Society Specialist Group on Expert Systems Cambridge University Press.Google Scholar
  9. 9).
    Atwell, E S 1987 "Transforming a Parsed Corpus into a Corpus Parser", to appear in Proceedings of the ICAME 8th International Conference on English Language Research on Computerised Corpora (forthcoming)Google Scholar
  10. 10).
    Atwell, E S 1987 "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the International Conference on the Study of Particles (forthcoming).Google Scholar
  11. 11).
    Chomsky, N 1957 Syntactic Structures Mouton, The HagueGoogle Scholar
  12. 12).
    Winograd, T 1983 Language as a cognitive process; volume 1: syntax Addison-WesleyGoogle Scholar
  13. 13).
    Johnson, T 1985 Natural Language Computing: the commercial applications Ovum, LondonGoogle Scholar
  14. 14).
    Woods, W 1970 "Transition Network Grammars for Natural Language Analysis" in Communications of the Association for Computing Machinery 13(10): 591–606Google Scholar
  15. 15).
    Bresnan, J and R Kaplan 1982 "Lexical-Functional Grammar: a formal system for grammatical representation" in Joan Bresnan (ed), The Mental Representation of Grammatical Relations 173–281, MIT PressGoogle Scholar
  16. 16).
    Gazdar, G, E Klein, G Pullum, and I Sag 1985 Generalized Phrase Structure Grammar Blackwell, OxfordGoogle Scholar
  17. 17).
    Heidorn, G E, Jensen, K, Miller, L A, Byrd, R J, and Chodorow, M S, 1982 "The EPISTLE text-critiquing system" in IBM Systems Journal 21(3): 305–326Google Scholar
  18. 18).
    Jensen, K, Heidorn, G E, Miller, L A, and Ravin, Y 1983 "Parse fitting and prose fixing: getting a hold on ill-formedness" in American Journal of Computational Linguistics 9(3–4): 147–160Google Scholar
  19. 19).
    Carbonell, J and P Hayes 1983 "Recovery strategies for parsing extragrammatical language" in American Journal of Computational Linguistics 9(3–4): 123–146Google Scholar
  20. 20).
    Fass, D, and Y Wilks 1983 "Preference semantics, ill-formedness, and metaphor" in American Journal of Computational Linguistics 9(3–4): 178–187Google Scholar
  21. 21).
    Granger, R 1983) "The NOMAD system: expectation-based detection and correction of errors during understanding of syntactically and semantically ill-formed text" in American Journal of Computational Linguistics 9(3–4): 188–196Google Scholar
  22. 22).
    Hayes, P J, and G V Mouradian 1981 "Flexible Parsing" in American Journal of Computational Linguistics 7(4): 232–242Google Scholar
  23. 23).
    Kwasny, S, and N Sondheimer 1981 "Relaxation techniques for parsing grammatically ill-formed input in natural language understanding systems" in American Journal of Computational Linguistics 7(2): 99–108Google Scholar
  24. 24).
    Weischedel, R, and J Black 1980 "Responding intelligently to unparsable inputs" in American Journal of Computational Linguistics 6(2) 97–109Google Scholar
  25. 25).
    Weischedel, R, and N Sondheimer 1983 "Meta-rules as a basis for processing ill-formed input" in American Journal of Computational Linguistics 9(3–4):161–177Google Scholar
  26. 26).
    Atwell, E S 1983 "Constituent-Likelihood Grammar" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 34–67, Norwegian Computing Centre for the Humanities, Bergen University.Google Scholar
  27. 27).
    Atwell, E S (forthcoming), "Constituent-likelihood grammar" to appear in Roger Garside, Geoffrey Sampson and Geoffrey Leech (eds) The computational analysis of English LongmanGoogle Scholar
  28. 28).
    Atwell, E S, G Leech and R Garside 1984, "Analysis of the LOB Corpus: progress and prospects", in J Aarts and W Meijs (ed), Corpus Linguistics Rodopi.Google Scholar
  29. 29).
    Leech, G, R Garside, and E S Atwell 1983a: "Recent developments in the use of computer corpora in English language research" in Transactions of the Philological Society 1983: 23–40.Google Scholar
  30. 30).
    Leech, G, R Garside, and E S Atwell 1983b "The Automatic Grammatical Tagging of the LOB Corpus" in Newsletter of the International Computer Archive of Modern English (ICAME NEWS) 7: 13–33, Norwegian Computing Centre for the Humanities, Bergen UniversityGoogle Scholar
  31. 31).
    Johansson, S, E Atwell, R Garside and G Leech 1986, The Tagged LOB Corpus Norwegian Computing Centre for the Humanities, Bergen.Google Scholar
  32. 32).
    Atwell, E S 1986, "How to detect grammatical errors in a text without parsing it", Department of Computer Studies Research Report 212; to appear in Proceedings of the Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark (forthcoming).Google Scholar
  33. 33).
    Atwell, Eric Steven (forthcoming) "Measuring grammaticality of machine-readable text" to appear in Proceedings of the 1987 XIV International Congress of Linguists, Berlin, East Germany Google Scholar
  34. 34).
    Wolff, J G 1976 "Frequency, Conceptual Structure and Pattern Recognition" in British Journal of Psychology 67:377–390Google Scholar
  35. 35).
    Wolff, J G 1978 "The Discovery of Syntagmatic and Paradigmatic Classes" in ALLC Bulletin 6(1):141Google Scholar
  36. 36).
    Atwell, Eric Steven 1986 Extracting a Natural Language grammar from raw text Department of Computer Studies Research Report no.208, University of LeedsGoogle Scholar
  37. 37).
    Atwell, Eric Steven 1986 "A parsing expert system which learns from corpus analysis" in Willem Meijs (ed) Corpus Linguistics and Beyond: Proceedings of the 1986 Seventh International Conference on English Language Research on Computerised Corpora, Amsterdam, Netherlands Rodopi, AmsterdamGoogle Scholar
  38. 38).
    Atwell, Eric Steven, and Nikos Drakos (forthcoming), "Pattern Recognition Applied to the Acquisition of a Grammatical Classification System from Unrestricted English Text" to appear in Proceedings of the 1987 Association for Computational Linguistics Third European Chapter Conference, Copenhagen, Denmark Google Scholar
  39. 39).
    Atwell, Eric Steven (forthcoming) "An Expert System for the Automatic Discovery of Particles" to appear in Proceedings of the 1987 International Conference on the Study of Language Particles, West Berlin, West Germany Google Scholar
  40. 40).
    Thomas, A N 1961, "Now Kruschev Hots Up" in News of the World July 9 (LOB Corpus text sample A21)Google Scholar
  41. 41).
    'The Walrus’ 1961, "Of Shoes and Ships and Sealing Wax" in Yachting World December (LOB Corpus text sample E18)Google Scholar
  42. 42).
    (Anonymous) 1961, "Editorial Points" in Hair and Beauty 41: 6 (June) (LOB Corpus text sample E34)Google Scholar
  43. 43).
    Hamblin, H 1961, "Give Back My Dreams" in Smart Novels February 6 (LOB Corpus text sample P17)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1988

Authors and Affiliations

  • Eric Steven Atwell
    • 1
  1. 1.Centre for Computer Analysis of Language And Speech (CCALAS) Artificial Intelligence Division, School of Computer StudiesLeeds UniversityLeedsU.K.

Personalised recommendations