Advertisement

Evaluating the Effectiveness of Tutorial Dialogue Instruction in an Exploratory Learning Context

  • Rohit Kumar
  • Carolyn Rosé
  • Vincent Aleven
  • Ana Iglesias
  • Allen Robinson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4053)

Abstract

In this paper we evaluate the instructional effectiveness of tutorial dialogue agents in an exploratory learning setting. We hypothesize that the creative nature of an exploratory learning environment creates an opportunity for the benefits of tutorial dialogue to be more clearly evidenced than in previously published studies. In a previous study we showed an advantage for tutorial dialogue support in an exploratory learning environment where that support was administered by human tutors [9]. Here, using a similar experimental setup and materials, we evaluate the effectiveness of tutorial dialogue agents modeled after the human tutors from that study. The results from this study provide evidence of a significant learning benefit of the dialogue agents.

Keywords

Intelligent Tutor System Pretest Score Rankine Cycle Thermodynamic Cycle Dialogue Support 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Aleven, V., Rosé, C.P.: Authoring plug-in tutor agents by demonstration: Rapid rapid tutor development. In: Proceedings of AI in Education (2005)Google Scholar
  2. 2.
    Bloom, B.S.: The 2 Sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher 13, 4–16 (1984)Google Scholar
  3. 3.
    Cohen, P.A., Kulik, J.A., Kulik, C.C.: Educational outcomes of tutoring: A meta-analysis of findings. American Educational Research Journal 19, 237–248 (1982)Google Scholar
  4. 4.
    Forbus, K.D., Whalley, P.B., Evrett, J.O., Ureel, L., Brokowski, M., Baher, J., Kuehne, S.E.: CyclePad: An Articulate Virtual Laboratory for Engineering Thermodynamics. Artificial Intelligence 114(1-2), 297–347 (1999)MATHCrossRefGoogle Scholar
  5. 5.
    Graesser, A., VanLehn, K.: the TRG, & the NLT, Why2 Report: Evaluation of Why/Atlas, Why/AutoTutor, and Accomplished Human Tutors on Learning Gains for Qualitative Physics Problems and Explanations, LRDC Tech. Report, University of Pittsburgh (2002)Google Scholar
  6. 6.
    Graesser, A.C., Jackson, G.T., Mathews, E.C., Mitchell, H.H., Olney, A., Ventura, M., Chipman, P., Franceschetti, D., Hu, X., Louwerse, M.M., Person, N.K.: The Tutoring ResearchGroup: Why/AutoTutor: A Test of Learning Gains from a Physics Tutor with Natural Language Dialog. In: Proceedings of the Cognitive Science Society (2003)Google Scholar
  7. 7.
    Koedinger, K.R., Aleven, V., Heffernan, N.T., McLaren, B.M., Hockenberry, M.: Opening the Door to Non-programmers: Authoring Intelligent Tutor Behavior by Demonstration. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 162–174. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Person, N., Bautista, L., Graesser, A., Mathews, E.: The Tutoring Research Group. In: Moore, J.D., Redfield, C.L., Johnson, W.L. (eds.) Artificial Intelligence in Education: AI-ED in the Wired and Wireless Future, Proceedings of AI-ED 2001, pp. 286–293. IOS Press, Amsterdam (2001)Google Scholar
  9. 9.
    Rosé, C.P., Aleven, V., Carey, R., Robinson, A., Wu, C.: A First Evaluation of the Instructional Value of Negotiatble Problem Solving Goals on the Exploratory Learning Continuum. In: Proceedings of AI in Education (2005)Google Scholar
  10. 10.
    Penstein Rosé, C., Torrey, C., Aleven, V., Wu, A.R.C., Forbus, K.D.: CycleTalk: Toward a dialogue agent that guides design with an articulate simulator. In: Lester, J.C., Vicari, R.M., Paraguaçu, F. (eds.) ITS 2004. LNCS, vol. 3220, pp. 401–411. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  11. 11.
    Rosé, C.P., Jordan, P., Ringenberg, M., Siler, S., VanLehn, K., Weinstein, A.: Interactive Conceptual Tutoring in Atlas-Andes. In: Proceedings of AI in Education (2001)Google Scholar
  12. 12.
    VanLehn, K., Graesser, A., Tanner, J., Jordan, P., Olney, A., Rosé, C.P.: When is reading just as effective as one-on-one interactive tutoring? In: Proceedings of the Annual Meeting of the Cognitive Science Society (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Rohit Kumar
    • 1
  • Carolyn Rosé
    • 1
  • Vincent Aleven
    • 1
  • Ana Iglesias
    • 1
  • Allen Robinson
    • 1
  1. 1.Carnegie Mellon UniversityPittsburghUSA

Personalised recommendations