Skip to main content
SpringerLink
Log in

Tutorial Dialog in Natural Language

  • Chapter
Advances in Intelligent Tutoring Systems

Part of the book series: Studies in Computational Intelligence ((SCI,volume 308))

Abstract

This chapter reviews our past and ongoing investigations into conversational interaction during human tutoring and our attempts to build intelligent tutoring systems (ITS) to simulate this interaction. We have previously modeled the strategies, actions, and dialogue of novice tutors in an ITS, called AutoTutor, with learning gains comparable to novice tutors. There is evidence, however, that expert human tutors may foster exceptional learning gains beyond those reported for some categories of human tutors. We have undertaken a rigorous, large scale study of expert human tutors and are using these data to create Guru, an expert ITS for high school biology. Based on our analyses, expert human tutoring has several distinctive features which differ from novice human tutoring. These distinctive features have implications for the development of an expert ITS, and we briefly describe how these are being addressed in Guru.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Aleven, V., Koedinger, K.R.: An effective metacognitive strategy: Learning by doing and explaining with a computer-based cognitive tutor. Cognitive Science 26, 147–179 (2002)

    Article  Google Scholar 

  • Aleven, V., McLaren, B.M., Sewall, J., Koedinger, K.R.: The cognitive tutor authoring tools (CTAT): Preliminary evaluation of efficiency gains. Intelligent Tutoring Systems 2006, 61–70 (2006)

    Article  Google Scholar 

  • Anderson, J.R., Corbett, A.T., Koedinger, K.R., Pelletier, R.: Cognitive tutors: lessons learned. The Journal of the Learning Sciences 4(2), 167–207 (1995)

    Article  Google Scholar 

  • Aronson, J.: Improving academic achievement: Impact of physchological factors on education. Academic Press, San Diego (2002)

    Google Scholar 

  • Biswas, G.: Designing learning by teaching agents: The Betty’s Brain system. Int. J. Artif. Intell. Ed. 18(3), 181–208 (2008)

    Google Scholar 

  • Bloom, B.S.: The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher 13(6), 4–16 (1984)

    Google Scholar 

  • Cade, W.L., Copeland, J.L., Person, N.K., D’Mello, S.K.: Dialogue modes in expert tutoring. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 470–479. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  • Chi, M., Leeuw, N., Chiu, M., LaVancher, C.: Eliciting Self-Explanations Improves Understanding. Cognitive Science 18(3), 439–477 (1994)

    Google Scholar 

  • Chi, M.T.H., Siler, S.A., Jeong, H., Yamauchi, T., Hausmann, R.G.: Learning from tutoring. Cognitive Science 25, 471–533 (2001)

    Article  Google Scholar 

  • Chi, M.T.H., Siler, S.A., Jeong, H.: Can tutors monitor students’ understanding accurately? Cognition and Instruction 22(3), 363–387 (2004)

    Article  Google Scholar 

  • Chi, M., Roy, M., Hausmann, R.: Observing tutorial dialogues collaboratively: Insights about human tutoring effectiveness from vicarious learning. Cognitive science 32(2), 301–341 (2008)

    Article  Google Scholar 

  • Cohen, P.A., Kulik, J.A., Kulik, C.L.C.: Educational outcomes of tutoring: a meta analysis of _ndings. American Educational Research Journal 19, 237–248 (1982)

    Google Scholar 

  • Collins, A., Warnock, E.H., Aiello, N., Miller, M.L.: Reasoning from incomplete knowledge. In: Bobrow, D., Collins, A. (eds.) Representation and Understanding: Studies in Cognitive Science. Academic Press, New York (1975)

    Google Scholar 

  • Corbett, A.: Cognitive computer tutors: Solving the two-sigma problem. In: Bauer, M., Gmytrasiewicz, P.J., Vassileva, J. (eds.) UM 2001. LNCS (LNAI), vol. 2109, p. 137. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  • Corbett, A.: Cognitive tutor algebra I: Adaptive student modeling in widespread classroom use. In: Technology and Assessment: Thinking Ahead. Proceedings from a Workshop. National Academy Press, Washington (2002)

    Google Scholar 

  • Cromley, J.G., Azevedo, R.: What do reading tutors do? a naturalistic study of more and less experienced tutors in reading. Discourse Processes 40(2), 83–113 (2005)

    Article  Google Scholar 

  • Deerwester, S.C., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.A.: Indexing by latent semantic analysis. Journal of the American Society of Information Science 41(6), 391–407 (1990)

    Article  Google Scholar 

  • Derry, S.J., Lajoie, S.P.: Computers as cognitive tools. Erlbaum, Hillsdale (1993)

    Google Scholar 

  • Derry, S.J., Potts, M.K.: How tutors model students: A study of personal constructs in adaptive tutoring. American Educational Research Journal 35(1), 65–99 (1998)

    Article  Google Scholar 

  • D’Mello, S., Olney, A.M., Person, N.: Mining collaborative patterns in tutorial dialogues. Journal of Educational Data Mining (in press)

    Google Scholar 

  • Dumais, S.: Improving the retrieval of information from external sources. Behavior Research Methods Instruments and Computers 23(2), 229–236 (1991)

    Google Scholar 

  • Evens, M., Spitkovsky, J., Boyle, P., Michael, J., Rovick, A.: Synthesizing tutorial dialogues. In: Proceedings of the 15th Annual Conference of the Cognitive Science Society. Lawrence Erlbaum Associates, Mahwah (1993)

    Google Scholar 

  • Fisher, K., Wandersee, J., Moody, D.: Mapping biology knowledge. Kluwer Academic Pub., Dordrecht (2000)

    Google Scholar 

  • Fox, B.: The human tutoring dialogue project. Lawrence Erlbaum Associates, Inc., Hillsdale (1993)

    Google Scholar 

  • Gagn, R.M.: The conditions of learning and theory of instruction. In: Holt, R., Winston Glass, M., Kim, J., Evens, M., Michael, J., Rovick, A. (eds.) Novice vs. expert tutors: A comparison of style. Midwest Artificial Intelligence and Cognitive Science Conference (1985)

    Google Scholar 

  • Gordon, S., Schmierer, K., Gill, R.: Conceptual graph analysis: Knowledge acquisition for instructional system design. Human Factors: The Journal of the Human Factors and Ergonomics Society 35(3), 459–481 (1993)

    Google Scholar 

  • Graesser, A.C., Franklin, S.P.: Quest: A cognitive model of question answering. Discourse Processes 13, 279–303 (1990)

    Article  Google Scholar 

  • Graesser, A.C., Person, N.K.: Question asking during tutoring. American Educational Research Journal 31(1), 104–137 (1994)

    Google Scholar 

  • Graesser, A.C., Person, N.K., Magliano, J.P.: Collaborative dialogue patterns in naturalistic one-to-one tutoring. Applied Cognitive Psychology 9, 1–28 (1995)

    Article  Google Scholar 

  • Graesser, A.C., Lu, S., Jackson, G.T., Mitchell, H., Ventura, M., Olney, A., Louwerse, M.M.: AutoTutor: A tutor with dialogue in natural language. Behavioral Research Methods, Instruments, and Computers 36, 180–193 (2004)

    Google Scholar 

  • Graesser, A.C., Person, N.K., Harter, D., et al.: Teaching tactics and dialog in AutoTutor. International Journal of Artificial Intelligence in Education 12(3), 257–279 (2001)

    Google Scholar 

  • Graesser, A.C., Olney, A.M., Haynes, B.C., Chipman, P.: AutoTutor: A cognitive system that simulates a tutor that facilitates learning through mixed-initiative dialogue. In: Forsythe, C., Bernard, M.L., Goldsmith, T.E. (eds.) Cognitive Systems: Human Cognitive Models in Systems Design. Erlbaum, Mahwah (2005a)

    Google Scholar 

  • Graesser, A.C., Chipman, P., Haynes, B., Olney, A.: AutoTutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education 48(4), 612–618 (2005b)

    Article  Google Scholar 

  • Graesser, A.C., DMello, S.K., Cade, W.L.: Instruction based on tutoring. In: Mayer, R., Alexander, P. (eds.) Handbook of Research on Learning and Instruction, Routledge, New York (in press)

    Google Scholar 

  • Jackson, G.T., Person, N.K., Graesser, A.C.: Adaptive tutorial dialogue in autotutor. In: Proceedings of the workshop on Dialog-based Intelligent Tutoring Systems at the 7th International conference on Intelligent Tutoring Systems, Universidade Federal de Alagoas, Brazil, pp. 368–372 (2004)

    Google Scholar 

  • Johansson, R., Nugues, P.: Dependency-based syntactic-semantic analysis with PropBank and NomBank. In: CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning, Morristown, NJ (2008)

    Google Scholar 

  • Jordan, P., Siler, S.: Student initiative and questioning strategies in computer mediated human tutoring dialogues. In: Proceedings of ITS, Workshop on Empirical Methods for Tutorial Dialogue Systems (2002)

    Google Scholar 

  • Lajoie, S., Faremo, S., Wiseman, J.: Tutoring strategies for effective instruction in internal medicine. International Journal of Artificial Intelligence and Education 12, 293–309 (2001)

    Google Scholar 

  • Landauer, T.K., Dumais, S.T.: A solution to plato’s problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review 104, 211–240 (1997)

    Article  Google Scholar 

  • Landauer, T.K., McNamara, D.S., Dennis, S., Kintsch, W. (eds.): Handbook of Latent Semantic Analysis. Lawrence Erlbaum, Mahwah (2007)

    Google Scholar 

  • Larsson, S., Traum, D.: Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit. Natural Language Engineering, 323–340 (2000)

    Google Scholar 

  • Lepper, M.R., Aspinwall, L.G., Mumme, D.L., Chabay, R.W.: Self-perception and social-perception processes in tutoring: Subtle social control strategies of expert tutors. In: Olson, J.M., Zanna, M.P. (eds.) Self-inference processes: The Ontario Symposium, Erlbaum, Hillsdale (1990)

    Google Scholar 

  • Lepper, M.R., Woolverton, M., Mumme, D., Gurtner, J.: Motivational techniques of expert human tutors: Lessons for the design of computer based tutors. In: Lajoie, S., Derry, S. (eds.) Computers as cognitive tools. Erlbaum, Hillsdale (1993)

    Google Scholar 

  • Lepper, M.R., Woolverton, M.: The wisdom of practice: Lessons learned from the study of highly effective tutors. In: Improving academic achievement: Impact of psychological factors on education. Academic Press, San Diego (2002)

    Google Scholar 

  • Lesgold, A., Lajoie, S., Bunzo, M., Eggan, G.: SHERLOCK: A coached practiceenvironment for an electronics troubleshooting job. In: Larkin, J.H., Chabay, R.W. (eds.) Computer assisted instruction and intelligent tutoring systems: Shared goals and complementary approaches, Lawrence Earlbaum, Hillsdale (1992)

    Google Scholar 

  • Litman, D., Forbes-riley, K.: Correlations between dialogue acts and learning in spoken tutoring dialogues. Nat. Lang. Eng. 12(2), 161–176 (2006)

    Article  Google Scholar 

  • McTear, M.: Modelling spoken dialogues with state transition diagrams: experiences with the CSLU toolkit. In: Fifth International Conference on Spoken Language Processing, Sydney, Australia (1998)

    Google Scholar 

  • Meyers, A., Reeves, R., Macleod, C., Szekely, R., Zielinska, V., Young, B., Grishman, R.: The NomBank project: An interim report. In: Meyers, A. (ed.) HLTNAACL 2004 Workshop, Frontiers in Corpus Annotation, Boston (2004)

    Google Scholar 

  • Moore, J.D.: Participating in explanatory dialogues: Interpreting and responding to questions in context. The MIT Press, Cambridge (1994)

    Google Scholar 

  • Murray, T.: Authoring Knowledge-Based tutors: Tools for content, instructional strategy, student model, and interface design. Journal of the Learning Sciences 7(1), 5 (1998)

    Article  Google Scholar 

  • Novak, J.D., Canas, A.J.: The theory underlying concept maps and how to construct them. Technical report, Institute for Human and Machine Cognition (2006)

    Google Scholar 

  • Olney, A., Louwerse, M., Mathews, E., Marineau, J., Hite-Mitchell, H., Graesser, A.: Utterance classification in AutoTutor. In: Proceedings of the HLT-NAACL 2003 Workshop on Building Educational Applications Using Natural Language Processing, Philadelphia. Association for Computational Linguistics, pp. 1–8 (2003)

    Google Scholar 

  • Olney, A.M.: Gnututor: An open source intelligent tutoring. system based on AutoTutor. In: Proceedings of the 2009 AAAI Fall Symposium on Cognitive and Metacognitive Educational Systems, Washington (2009)

    Google Scholar 

  • Olney, A.M.: Extraction of concept maps from textbooks for domain modeling. In: Proceedings of the International Conference on Intelligent Tutoring Systems (in press)

    Google Scholar 

  • Palinscar, A.S., Brown, A.: Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction 1, 117–175 (1984)

    Article  Google Scholar 

  • Palmer, M., Gildea, D., Kingsbury, P.: The Proposition Bank: An annotated corpus of semantic roles. Comput. Linguist. 31(1), 71–106 (2005)

    Article  Google Scholar 

  • Person, N.K., Graesser, A.C., Magliano, J.P., Kreuz, R.J.: Inferring what the student knows in one-to-one tutoring: the role of student questions and answers. Learning and individual differences 6(2), 205–229 (1994)

    Article  Google Scholar 

  • Person, N.K., Kreuz, R.J., Zwaan, R., Graesser, A.C.: Pragmatics and pedagogy: Conversational rules and politeness strategies inhibit effective tutoring. Cognition and Instruction 13, 161–188 (1995)

    Article  Google Scholar 

  • Person, N., Graesser, A.: Evolution of discourse during cross-age tutoring. In: O’Donnell, A.M., King, A. (eds.) Cognitive perspectives on peer learning. Lawrence Erlbaum, Mahwah (1999)

    Google Scholar 

  • Person, N., Graesser, A.: Fourteen facts about human tutoring: Food for thought for ITS developers. In: AI-ED 2003 Workshop Proceedings on Tutorial Dialogue Systems: With a View Toward the Classroom, pp. 335–344 (2003)

    Google Scholar 

  • Person, N.K., Lehman, B., Ozbun, R.: Pedagogical and motivational dialogue moves used by expert tutors. Presented at the 17th Annual Meeting of the Society for Text and Discourse. Glasgow, Scotland (2007a)

    Google Scholar 

  • Person, N.K., Mallott, L.: Question generation in expert tutoring. Presented at the 17th Annual Meeting of the Society for Text and Discourse, Glasgow, Scotland (2007b)

    Google Scholar 

  • Person, N.K., Moses, J., Willson, W.: Question asking in expert and non-expert tutoring sessions. Presented at the 2007 AERA Annual Meeting, Chicago (2007c)

    Google Scholar 

  • Rogoff, B., Gardner, W.: Adult guidance of cognitive development. In: Rogoff, B., Lave, J. (eds.) Everyday cognition: Its development in social context. Harvard University Press, Cambridge (1984)

    Google Scholar 

  • Shah, F., Evens, M., Michael, J., Rovick, A.: Classifying Student Initiatives and Tutor Responses in Human Keyboard-to-Keyboard Tutoring Sessions. Discourse Processes 33(1), 23–52 (2002)

    Article  Google Scholar 

  • Sinclair, J., Coulthard, R.M.: Towards an Analysis of Discourse: the English used by teachers and pupils. Oxford University Press, London (in press)

    Google Scholar 

  • Sleeman, D., Brown, J.S. (eds.): Intelligent tutoring systems. Academic Press, New York (1982)

    Google Scholar 

  • Sowa, J.F.: Conceptual graphs. In: Van Harmelen, F., Lifschitz, V., Porter, B. (eds.) Handbook of knowledge representation. Elsevier Science, San Diego (2007)

    Google Scholar 

  • Sowa, J.F.: Concept mapping. JFSowa.com (2010), http://www.jfsowa.com/talks/cmapping.pdf (Accessed May 15, 2010)

  • VanLehn, K., Jones, R., Chi, M.: A Model of the Self-Explanation Effect. The Journal of the Learning Sciences 2(1), 1–59 (1992)

    Article  Google Scholar 

  • VanLehn, K., Jordan, P., Rose, C., Bhembe, D., Bottner, M., Gaydos, A., Makatchev, M., Pappuswamy, U., Ringenberg, M., Roque, A., et al.: The architecture of Why2-Atlas: A coach for qualitative physics essay writing. In: Cerri, S.A., Gouardéres, G., Paraguaçu, F. (eds.) ITS 2002. LNCS, vol. 2363, pp. 158–167. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  • Vanlehn, K.: The behavior of tutoring systems. Int. J. Artif. Intell. Ed. 16(3), 227–265 (2006)

    Google Scholar 

  • VanLehn, K., Graesser, A.C., Jackson, G.T., Jordan, P., Olney, A., Rose, C.: When are tutorial dialogues more effective than reading? Cognitive Science 31, 3–62 (2007)

    Google Scholar 

  • Wiley, J., Jensen, M.: When three heads are better than two. In: Proceedings of the 28th annual conference of the cognitive science society, pp. 2375–2380 (2006)

    Google Scholar 

  • Wiley, J., Bailey, J.: Effects of collaboration and argumentation on learning from web pages. In: Erkens, G. (ed.) Collaborative learning, reasoning, and technology. Lawrence Erlbaum, Mahwah (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Memphis, Memphis, TN, 38152, USA

    Andrew M. Olney & Arthur C. Graesser

  2. Rhodes College, Memphis, TN, 38112, USA

    Natalie K. Person

Authors
  1. Andrew M. Olney
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arthur C. Graesser
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Natalie K. Person
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Quebec, Montreal, Canada

    Roger Nkambou

  2. Télé-université, UQAM, Montreal, Canada

    Jacqueline Bourdeau

  3. Osaka University, Osaka, Japan

    Riichiro Mizoguchi

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Olney, A.M., Graesser, A.C., Person, N.K. (2010). Tutorial Dialog in Natural Language. In: Nkambou, R., Bourdeau, J., Mizoguchi, R. (eds) Advances in Intelligent Tutoring Systems. Studies in Computational Intelligence, vol 308. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14363-2_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14363-2_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14362-5

  • Online ISBN: 978-3-642-14363-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation