Skip to main content

Predicting State Test Scores Better with Intelligent Tutoring Systems: Developing Metrics to Measure Assistance Required

  • Conference paper
Intelligent Tutoring Systems (ITS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 4053))

Included in the following conference series:

Abstract

The ASSISTment system was used by over 600 students in 2004-05 school year as part of their math class. While in [7] we reported student learning within the ASSISTment system, in this paper we focus on the assessment aspect. Our approach is to use data that the system collected through a year to tracking student learning and thus estimate their performance on a high-stake state test (MCAS) at the end of the year. Because our system is an intelligent tutoring system, we are able to log how much assistance students needed to solve problems (how many hints students requested and how many attempts they had to make). In this paper, our goal is to determine if the models we built by taking the assistance information into account could predict students’ test scores better. We present some positive evidence that shows our goal is achieved.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Baker, R.S., Roll, I., Corbett, A.T., Koedinger, K.R.: Do Performance Goals Lead Students to Game the System? In: Proceedings of the 12th International Conference on Artificial Intelligence and Education, pp. 57–64 (2005)

    Google Scholar 

  2. Beck, J.E., Jia, P., Mostow, J.: Automatically assessing oral reading fluency in a computer tutor that listens. Technology, Instruction, Cognition and Learning 2, 61–81 (2004)

    Google Scholar 

  3. Campione, J.C., Brown, A.L., Bryant, N.R.: Individual differences in learning and memory. In: Sternberg, R.J. (ed.) In Human abilities: An information-processing approach, pp. 103–126. W.H. Freeman, New York (1985)

    Google Scholar 

  4. Feng, M., Heffernan, N.T.: Informing Teachers Live about Student Learning: Reporting in the ASSISTment System. In: The 12th Annual Conference on Artificial Intelligence in Education Workshop on Usage Analysis in Learning Systems (2005)

    Google Scholar 

  5. Feng, M., Heffernan, N.T., Koedinger, K.R.: Addressing the Testing Challenge with a Web-Based E-Assessment System that Tutors as it Assesses. In: The 15th International World Wide Web Conference, Scotland (in press), http://web.cs.wpi.edu/~mfeng/pub/www06.pdf

  6. Grigorenko, E.L., Sternberg, R.J.: Dynamic Testing. Psychological Bulletin 124, 75–111 (1998)

    Article  Google Scholar 

  7. Razzaq, L., Feng, M., Nuzzo-Jones, G., Heffernan, N.T., et al.: The ASSISTment Project: Blending Assessment and Assisting. In: Proceedings of the 12th Annual Conference on Artificial Intelligence in Education (2005)

    Google Scholar 

  8. Razzaq, L., Heffernan, N.T.: Scaffolding vs. Hints in the ASSISTment System. In: The 8th International Conference on Intelligent Tutoring Systems (in press), http://nth.wpi.edu/pubs_and_grants/ITS2006/Submissons/Leena/razzaq.doc

  9. Singer, J.D., Willett, J.B.: Applied Longitudinal Data Analysis: Modelling Change and Occurrence. Oxford University Press, New York (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Feng, M., Heffernan, N.T., Koedinger, K.R. (2006). Predicting State Test Scores Better with Intelligent Tutoring Systems: Developing Metrics to Measure Assistance Required. In: Ikeda, M., Ashley, K.D., Chan, TW. (eds) Intelligent Tutoring Systems. ITS 2006. Lecture Notes in Computer Science, vol 4053. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11774303_4

Download citation

  • DOI: https://doi.org/10.1007/11774303_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-35159-7

  • Online ISBN: 978-3-540-35160-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics