Experimental Evaluation of Automatic Hint Generation for a Logic Tutor

  • John C. Stamper
  • Michael Eagle
  • Tiffany Barnes
  • Marvin Croy
Conference paper

DOI: 10.1007/978-3-642-21869-9_45

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6738)
Cite this paper as:
Stamper J.C., Eagle M., Barnes T., Croy M. (2011) Experimental Evaluation of Automatic Hint Generation for a Logic Tutor. In: Biswas G., Bull S., Kay J., Mitrovic A. (eds) Artificial Intelligence in Education. AIED 2011. Lecture Notes in Computer Science, vol 6738. Springer, Berlin, Heidelberg

Abstract

In our prior work we showed it was feasible to augment a logic tutor with a data-driven Hint Factory that uses data to automatically generate context-specific hints for an existing computer aided instructional tool. Here we investigate the impact of automatically generated hints on educational outcomes in a robust experiment that shows that hints help students persist in deductive logic courses. Three instructors taught two semester-long courses, each teaching one semester using a logic tutor with hints, and one semester using the tutor without hints, controlling for the impact of different instructors on course outcomes. Our results show that students in the courses using a logic tutor augmented with automatically generated hints attempted and completed significantly more logic proof problems, were less likely to abandon the tutor, and performed significantly better on a post-test implemented within the tutor.

Keywords

data mining machine learning logic tutor 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • John C. Stamper
    • 1
  • Michael Eagle
    • 2
  • Tiffany Barnes
    • 2
  • Marvin Croy
    • 3
  1. 1.Human-Computer InstituteCarnegie Mellon UniversityUSA
  2. 2.Department of Computer ScienceUniversity of North Carolina at CharlotteUSA
  3. 3.Department of PhilosophyUniversity of North Carolina at CharlotteUSA

Personalised recommendations