Skip to main content

Functional, Frustrating and Full of Potential: Learners’ Experiences of a Prototype for Automated Essay Feedback

  • Conference paper
Computer Assisted Assessment. Research into E-Assessment (CAA 2014)

Abstract

OpenEssayist is an automated feedback system designed to support university students as they write essays for assessment. A first generation prototype of this system was tested on a cohort of postgraduate distance learners at the UK Open University from September to December 2013. A case study approach was used to examine three participants’ experiences of the prototype. Findings from the case studies offered insight into how different users may perceive the usefulness, future potential and end-user of such a tool. This study has important implications for the next phase of development, when the role of OpenEssayist in supporting students’ learning will need to be more clearly understood.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: OpenEssayist: extractive summarisation and formative assessment of free-text essays. In: Proceedings of the 1st International Workshop on Discourse-Centric Learning Analytics, Leuven, Belgium (April 2013a)

    Google Scholar 

  2. Van Labeke, N., Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E.: What is my essay really saying? Using extractive summarization to motivate reflection and redrafting. In: Proceedings of the AIED Workshop on Formative Feedback in Interactive Learning Environments, Memphis, TN (July 2013b)

    Google Scholar 

  3. Bruning, R., Dempsey, M., Kauffman, D.F., McKim, C.: Examining dimensions of self-efficacy for writing. Journal of Educational Psychology 105(1), 25–38 (2013)

    Article  Google Scholar 

  4. Whitelock, D.: Activating assessment for learning: Are we on the way with Web 2.0? In: Lee, M.J.W., McLoughlin, C. (eds.) Web 2.0-Based E-Learning: Applying Social Informatics for Tertiary Teaching, pp. 319–342. IGI Global, Hershey (2010)

    Chapter  Google Scholar 

  5. Burstein, J.C., Chodorow, M., Leacock, C.: Criterion(SM) Online Essay Evaluation: An Application for Automated Evaluation of Student Essays. In: Proceedings of the Fifteenth Conference on Innovative Applications of Artificial Intelligence, Acapulco, Mexico, pp. 3–10 (2003)

    Google Scholar 

  6. Rudner, L.M., Garcia, V., Welch, C.: An Evaluation of IntelliMetricTM Essay Scoring System. The Journal of Technology, Learning and Assessment 4(4) (2006)

    Google Scholar 

  7. Landauer, T.K., Laham, D., Foltz, P.: Automatic Essay Assessment. Assessment in Education: Principles, Policy & Practice 10(3), 295–308 (2003)

    Article  Google Scholar 

  8. Alden, B., Van Labeke, N., Whitelock, D., Richardson, J.T.E., Pulman, S., Field, D.: Using student experience as a model for designing an automatic feedback system for short essays. International Journal of E-Assessment (in press)

    Google Scholar 

  9. Chandrasegaran, A., Ellis, M., Poedjosoedarmo, G.: Essay Assist—Developing software for writing skills improvement in partnership with students. Regional Language Centre Journal 36(2), 137–155 (2005)

    Google Scholar 

  10. Roscoe, R.D., Varner, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The Writing Pal Intelligent Tutoring System: Usability Testing and Development. Computers and Composition (in press), http://129.219.222.66/pdf/Roscoe2012WritingPalTutor.pdf (accessed April 14, 2013)

  11. Bryman, A.: Social Research Methods, 2nd edn. Oxford University Press, Oxford (2004)

    Google Scholar 

  12. Whitelock, D., Field, D., Pulman, S., Richardson, J.T.E., van Labeke, N.: Designing and testing visual representations of draft essays for higher education students. Paper Presented at the Discourse-Centric Learning Analytics (DCLA) Workshop, LAK 14 (March 2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Alden Rivers, B., Whitelock, D., Richardson, J.T.E., Field, D., Pulman, S. (2014). Functional, Frustrating and Full of Potential: Learners’ Experiences of a Prototype for Automated Essay Feedback. In: Kalz, M., Ras, E. (eds) Computer Assisted Assessment. Research into E-Assessment. CAA 2014. Communications in Computer and Information Science, vol 439. Springer, Cham. https://doi.org/10.1007/978-3-319-08657-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08657-6_4

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08656-9

  • Online ISBN: 978-3-319-08657-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics