Skip to main content

The Use of Explicit User Models in a Generation System for Tailoring Answers to the User’s Level of Expertise

  • Conference paper

Part of the book series: Symbolic Computation ((1064))

Abstract

A question-answering program providing access to a large amount of data will be most useful if it can tailor its answers to each individual user. In particular, a user’s level of knowledge about the domain of discourse is an important factor in this tailoring if the answer provided is to be both informative and understandable to the user. In this research, we address the issue of how the user’s domain knowledge can affect an answer. By studying texts, we found that the user’s level of domain knowledge affected the kind of information provided and not just the amount of information, as was previously assumed. Depending on the user’s assumed domain knowledge, a description can be either parts-oriented or process-oriented. Thus the user’s level of expertise in a domain can guide a system in choosing the appropriate facts from the knowledge base to include in an answer. We propose two distinct descriptive strategies that can be used in a question-answering program, and show how they can be mixed to include the appropriate information from the knowledge base, given the user’s domain knowledge. We have implemented these strategies in TAILOR, a computer system that generates descriptions of devices. TAILOR uses one of the two discourse strategies identified in texts to construct a description for either a novice or an expert. It can merge the strategies automatically to produce a wide range of different descriptions to users who fall between the extremes of novice or expert, without requiring an a priori set of user stereotypes.

This research was supported in part by the Defence Advanced Research Projects Agency under contract N00039-84-C-0165, and the National Science Foundation grant ISI-84-51438.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anderson, R. C., R. J. Spiro and M. C. Anderson (1977): Schemata as Scaffolding for the Representation of Information in Connected Discourse. Technical Report 24, Center for the Study of Reading, Urbana, IL. [PARI*: 212]

    Google Scholar 

  2. Appelt, D. E. (1982): Planning Natural-Language Utterances. In: Proc. AAAI82, 59–62. [PARI*: 201]

    Google Scholar 

  3. Appelt, D. E. (1985): Planning English Sentences. Cambridge etc.: Cambridge Univ. Press. [WAHL*: 5, 16, 19; KOBS*: 53, 58ff., 62f.; PARI*: 201, 203]

    Google Scholar 

  4. Baker, D. L., R. B. Brownlee and R. W. Fuller (1957): Elements of Physics. Newton, MA: Allyn and Bacon. [PARI*: 205]

    Google Scholar 

  5. Britannica Junior Encyclopedia. Chicago: Encyclopedia Britannica Inc., 1963. [PARI*: 201, 205, 209]

    Google Scholar 

  6. The New Encyclopedia Britannica. Chicago: Encyclopedia Britannica Inc., 1984. [PARI*: 201, 205]

    Google Scholar 

  7. Carberry, S. (1983): Tracking User Goals in an Information-Seeking Environment. In: Proc. AAAI-83, 59–63. [WAHL*: 12; KOBS*: 59f.; CHIN*: 78; GARB*: 155; PARI*: 201, 203; FINI*: 413f.]

    Google Scholar 

  8. Carberry, S. (1988): Modeling the User’s Plans and Goals. In: Computational Linguistics 14(3), Special Issue on User Modeling (A. Kobsa and W. Wahlster, eds.), 23–37. [PARI*: 201; CARB*: 133; FINI*: 414]

    Google Scholar 

  9. Carberry, S.: Plan Recognition and its Use in Understanding Dialog. In this volume. [WAHL*: 12; RICH*: 39; KOBS*: 59; CHIN*: 78; QUIL*: 129; PARI*: 201; MCCO*: 251; JAME*: 256, 260, 278f.; SPAR*: 361f.; MORI*: 375f.; FINI*: 414]

    Google Scholar 

  10. Chevrolet Service Manual. Detroit, MI: General Motors Corporation, 1987. [PARI*: 201, 205]

    Google Scholar 

  11. Chi, M. T. H., R. Glaser and E. Rees (1981): Expertise in Problem Solving. In: R. J. Sternberg, ed.: Advances in the Psychology of Human Intelligence. Hillsdale, NJ: Lawrence Erlbaum. [PARI*: 211]

    Google Scholar 

  12. Chin, D. N. (1986): User Modelling in UC, the UNIX Consultant. In: Proc. of the CHI’86, Boston, MA, 24–28. [KOBS*: 57, 65; CHIN*: 74; PARI*: 202, 229; COHE*: 325, 330; FINI*: 414]

    Google Scholar 

  13. Cohen, R. and M. Jones: Incorporating User Models into Expert Systems for Educational Diagnosis. In this volume. [WAHL*: 19; CARB*: 161; PARI*: 231; MCCO*: 250; SPAR*: 362]

    Google Scholar 

  14. Collier’s Encyclopedia. New York: Crowell-Collier, 1962. [PARI*: 201, 205, 207]

    Google Scholar 

  15. Davison, A. (1984): Readibility Formulas and Comprehension. Comprehension Instruction, Perspectives and Suggestions. New York etc.: Longman. [PARI*: 201]

    Google Scholar 

  16. The New Encyclopedia of Science. Milwaukee, WI: Raintree Publishers, 1982. [PARI*: 201, 205]

    Google Scholar 

  17. Grice, H. P. (1975): Logic and Conversation. In: P. Cole and J. L. Morgan, eds.: Syntax and Semantics 3: Speech Acts. New York: Academic Press. [CARB*: 146, 156; PARI*: 201, 212; JAME*: 261, 272, 301; COHE*: 321]

    Google Scholar 

  18. Grimes, J. E. (1975): The Thread of Discourse. The Hague, The Netherlands: Mouton. [PARI*: 206]

    Google Scholar 

  19. Hobbs, J. (1978): Coherence and Coreference. Technical Note 168, SRI International, Menlo Park, CA. [PARI*: 206]

    Google Scholar 

  20. Hobbs, J. (1978): Why is a Discourse Coherent? Technical Report 176, SRI International, Menlo Park, CA. [PARI*: 206]

    Google Scholar 

  21. Hobbs, J. and D. Evans (1980): Conversation as Planned Behavior. Cognitive Science 4, 349–377. [PARI*: 206]

    Google Scholar 

  22. Hoeppner, W., K. Morik and H. Marburger (1984): Talking it Over: The Natural Language Dialog System HAM-ANS. Technical Report ANS-26, Research Unit for Information Science and Artificial Intelligence, Univ. of Hamburg, Fed. Rep. of Germany. [CHIN*: 78; PARI*: 202]

    Google Scholar 

  23. Kaplan, S. J. (1982): Cooperative Responses from a Portable Natural Language Query System. Artificial Intelligence 19, 165–188. [WAHL*: 19, 26; PARI*: 201; FINI*: 416]

    Google Scholar 

  24. Kay, M. (1979): Functional Grammar. In: Proc. of the 5th Meeting of the Berkeley Linguistics Society, Berkeley, CA, 142–158. [PARI*: 223]

    Google Scholar 

  25. Lancaster, J. S. and J. L. Kolodner (1987): Problem Solving in a Natural Task as a Function of Experience. Technical Report, School of Information and Computer Science, Georgia Institute of Technology, Atlanta, GA. [PARI*: 211]

    Google Scholar 

  26. Lebowitz, M. (1983): RESEARCHER: An Overview. In: Proc. AAAI-83, 232–235. [PARI*:202]

    Google Scholar 

  27. Lebowitz, M. (1985): RESEARCHER: An Experimental Intelligent Information System. In: Proc. IJCAI-85, 858–862. [PARI*: 202]

    Google Scholar 

  28. Lebowitz, M. (1986): An Experiment in Intelligent Information Systems: RESEARCHER. In: R. Davies, ed.: Intelligent Library and Information Systems. London: Ellis Horwood. [PARI*: 202]

    Google Scholar 

  29. Lehnert, W. (1977): A Conceptual Theory of Question Answering. In: Proc. IJCAI-77, 158–164. [PARI*: 202]

    Google Scholar 

  30. Mann, W. C. (1984): Discourse Structure for Text Generation. Technical Report ISURR-84–127, Information Sciences Institute, Marina del Rey, CA. [PARI*: 206]

    Google Scholar 

  31. Mark, H. F., D. F. Othmer, C. G. Overberger and G. T. Seaborg, eds.; Executive Editor: M. Grayson; Associate Editor: D. Eckroth (1987): Encyclopedia of Chemical Technology. New York: John Wiley and Sons. [PARI*: 213]

    Google Scholar 

  32. McCoy, K. F. (1983): Correcting Misconceptions: What to Say When the User is Mistaken. In: Proc. of the CHI’83 Conference on Human Factors in Computing Systems, Boston, MA, 197–201. [PARI*: 201]

    Google Scholar 

  33. McCoy, K. F. (1986): The ROMPER System: Responding to Object-Related Misconceptions Using Perspective. In: Proc. of the 24th Annual Meeting of the Association for Computational Linguistics, New York, NY, 97–105. [PARI*: 201f.; COHE*: 325, 330]

    Google Scholar 

  34. McCoy, K. F. (1988): Reasoning on a Dynamically Highlighted User Model to Respond to Misconceptions. In: Computational Linguistics 14(3), Special Issue on User Modeling (A. Kobsa and W. Wahlster, eds.), 52–63. [PARI*: 201f.; MCCO*: 233; SPAR*: 362]

    Google Scholar 

  35. McCoy, K. F.: Highlighting a User Model to Respond to Misconceptions. In this volume. [WAHL*: 7, 27; CHIN*: 101; QUIL*: 126; CARB*: 152, 161; PARI*: 201; JAME*: 260; MORI*: 375; FINI*: 416]

    Google Scholar 

  36. McKeown, K. R. (1985): Text Generation: Using Discourse Strategies and Focus Constraints to Generate Natural Language Text. Cambridge: Cambridge Univ. Press. [PARI*: 202f., 206, 211, 223; JAME*: 279; COHE*: 325]

    Google Scholar 

  37. McKeown, K. R., M. Wish and K. Matthews (1985): Tailoring Explanations for the User. In: Proc. IJCAI-85, 794–798. [WAHL*: 12; PARI*: 201, 203; MCCO*: 251; FINI*: 415]

    Google Scholar 

  38. McKeown, K. R. and C. L. Paris (1987): Functional Unification Grammar Revisited. In: Proc. of the 25th Annual Meeting of the Association for Computational Linguistics, Stanford Univ., Stanford, CA, 97–103. [PARI*: 223]

    Google Scholar 

  39. The New Book of Knowledge: The Children’s Encyclopedia. New York: Grolier Inc., 1967. [PARI*: 201, 205]

    Google Scholar 

  40. Paris, C. L. (1984): Determining the Level of Expertise. In: Proc. of the 1st Annual Workshop on Theoretical Issues in Conceptual Information Processing, Atlanta, GA, 128–135. [PARI*: 212, 229]

    Google Scholar 

  41. Paris, C. L. (1985): Description Strategies for Naive and Expert Users. In: Proc. of the 23rd Annual Meeting of the Association for Computational Linguistics, Chicago, IL, 238–246. [PARI*: 225; COHE*: 330]

    Google Scholar 

  42. Paris, C. L. and T. Kwee (1985): Guide to the Unification Process and its Implementation: Progress Report on Extending the Grammar Technical Report, Computer Science Dept., Columbia Univ., NY. [PARI*: 223]

    Google Scholar 

  43. Paris, C. L. (1987): The Use of Explicit User Models in Text Generation: Tailoring to a User’s Level of Expertise. Ph.D. Thesis, Dept. of Computer Science, Columbia Univ., NY. [PARI*: 211, 223f.]

    Google Scholar 

  44. Paris, C. L. and K. R. McKeown (1987): Discourse Strategies for Describing Complex Physical Objects. In: G. Kempen, ed.: Natural Language Generation: Recent Advances in Artificial Intelligence, Psychology and Linguistics. Dordrecht/Boston: Kluwer. [PARI*: 224]

    Google Scholar 

  45. Quilici, A., M. Dyer and M. Flowers (1988): Recognizing and Responding to Plan-Oriented Misconceptions. In: Computational Linguistics 14(3), Special Issue on User Modeling (A. Kobsa and W. Wahlster, eds.), 38–51. [QUEL*: 108; PARI*: 201]

    Google Scholar 

  46. Rich, E. (1979): User Modelling Via Stereotypes. Cognitive Science 3, 329–354. [WAHL*: 5, 11, 13f.; RICH*: 36; KOBS*: 53, 67; CHIN*: 78f., 83; PARI*: 201, 229; SPAR*: 342, 362; FINI*: 414ff.]

    Google Scholar 

  47. Rich, E.: Stereotypes and User Modeling. In this volume. [WAHL*: 13; CHIN*: 78f.; PARI*: 201; MCCO*: 235; JAME*: 256, 294; COHE*: 329; MORI*: 376; FINI*: 416, 422]

    Google Scholar 

  48. Sheperd, H. R. (1926): The Fine Art of Writing. New York: Macmillan. [PARI*: 206]

    Google Scholar 

  49. Sleeman, D. H. (1982): Inferring (Mal) Rules From Pupil’s Protocols. In: Proc. of the 6th European Conference on Artificial Intelligence, Orsay, France, 160–164. [PARI*: 211; MCCO*: 237]

    Google Scholar 

  50. Sleeman, D. H. (1985): UMFE: A User Modeling Front End Subsystem. International Journal of Man-Machine Studies 23, 71–88. [WAHL*: 15; RICH*: 36; KOBS*: 53, 56f.; PARI*: 229; SPAR*: 361; KASS*: 408; FINI*: 416]

    Google Scholar 

  51. Tennant, H. (1978): The Evaluation of Natural Language Question Answerers. Technical Report, Univ. of Illinois at Urbana-Champaign, IL. [PARI*: 203]

    Google Scholar 

  52. Verwiebe, F. L., G. R. van Hooft and R. R. Suchy (1962): Physics: A Basic Science. Princeton, NJ: van Nostrand. [PARI*: 205]

    Google Scholar 

  53. Wallis, J. W. and E. H. Shortliffe (1982): Explanatory Power for Medical Expert Systems: Studies in the Representation of Causal Relationships for Clinical Consultation. Technical Report STAN-CS-82–923, Heuristic Programming Project, Dept. of Medicine and Computer Science, Stanford Univ., Stanford, CA. [PARI*: 201f., 211; COHE*: 329; FINI*: 415]

    Google Scholar 

  54. Wasserman, K. and M. Lebowitz (1983): Representing Complex Physical Ob- jects. Cognition and Brain Theory 6, 333–352. [PARI*: 222]

    Google Scholar 

  55. Wasserman, K. (1985): Unifying Representation and Generalization: Understanding Hierarchically Structured Objects. Ph.D. Thesis, Dept. of Computer Science, Columbia Univ., NY. [PARI*: 222]

    Google Scholar 

  56. Weissler, A. and P. Weissler (1973): A Woman’s Guide to Fixing the Car. New York: Walker and Company. [PARI*: 201, 205]

    Google Scholar 

  57. Wilson, P. T. and R. C. Anderson (1986): What They Don’t Know Will Hurt Them: The Role of Prior Knowledge in Comprehension. In: J. Orasanu, ed.: Reading Comprehension: From Research to Practice. Hillsdale, NJ: Erlbaum. [PARI*: 201, 212]

    Google Scholar 

  58. Woods, W. (1973): An Experimental Parsing System for Transition Network Grammars. In: R. Rustin, ed.: Natural Language Processing. New York: Algorithmics Press. [PARI*: 223]

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1989 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Paris, C.L. (1989). The Use of Explicit User Models in a Generation System for Tailoring Answers to the User’s Level of Expertise. In: Kobsa, A., Wahlster, W. (eds) User Models in Dialog Systems. Symbolic Computation. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-83230-7_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-83230-7_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-83232-1

  • Online ISBN: 978-3-642-83230-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics