Abstract
Writing quality is an important component in defining students’ capabilities. However, providing comprehensive feedback to students about their writing is a cumbersome and time-consuming task that can dramatically impact the learning outcomes and learners’ performance. The aim of this paper is to introduce a fully automated method of generating essay feedback in order to help improve learners’ writing proficiency. Using the TASA (Touchstone Applied Science Associates, Inc.) corpus and the textual complexity indices reported by the ReaderBench framework, more than 740 indices were reduced to five components using a Principal Component Analysis (PCA). These components may represent some of the basic linguistic constructs of writing. Feedback on student writing for these five components is generated using an extensible rule engine system, easily modifiable through a configuration file, which analyzes the input text and detects potential feedback at various levels of granularity: sentence, paragraph or document levels. Our prototype consists of a user-friendly web interface to easily visualize feedback based on a combination of text color highlighting and suggestions of improvement.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Roscoe, R.D., Varner, L.K., Crossley, S.A., McNamara, D.S.: Developing pedagogically-guided algorithms for intelligent writing feedback. Int. J. Learn. Technol. 25(8(4)), 362–381 (2013)
Attali, Y., Burstein, J.: Automated essay scoring with e-rater V.2.0. In: Annual Meeting of the International Association for Educational Assessment, p. 23. Association for Educational Assessment, Philadelphia (2004)
Warschauer, M., Ware, P.: Automated writing evaluation: defining the classroom research agenda. Lang. Teach. Res. 10, 1–24 (2006)
Crossley, S.A., Kyle, K., McNamara, D.S.: To aggregate or not? Linguistic features in automatic essay scoring and feedback systems. J. Writ. Assess. 8(1), 1–16 (2015)
McNamara, D.S., Crossley, S.A., Roscoe, R., Allen, L.K., Dai, J.: A hierarchical classification approach to automated essay scoring. Assess. Writ. 23, 35–59 (2015)
Oelke, D., Spretke, D., Stoffel, A., Keim, D.A.: Visual readability analysis: how to make your writings easier to read. IEEE Trans. Visual Comput. Graph. 18(5), 662–674 (2012)
McNamara, D.S., Graesser, A., Cai, Z., Dai, J.: Coh-Metrix Common Core TERA version 1.0, vol. 2018 (2013). http://coh-metrix.commoncoretera.com
Zeno, S.M., Ivens, S.H., Millard, R.T., Duvvuri, R.: The Educator’s Word Frequency Guide. Touchstone Applied Science Associates Inc., Brewster (1995)
Dascalu, M., Stavarache, L.L., Dessus, P., Trausan-Matu, S., McNamara, D.S., Bianco, M.: ReaderBench: an integrated cohesion-centered framework. In: EC-TEL 2015, pp. 505–508. Springer, Toledo (2015)
Dascalu, M.: Analyzing discourse and text complexity for learning and collaborating. In: Studies in Computational Intelligence, vol. 534. Springer, Cham (2014)
Dascalu, M., McNamara, D.S., Trausan-Matu, S., Allen, L.K.: Cohesion network analysis of CSCL participation. Behav. Res. Methods, 1–16 (2017)
Dascalu, M., Allen, K.A., McNamara, D.S., Trausan-Matu, S., Crossley, S.A.: Modeling comprehension processes via automated analyses of dialogism. In: CogSci 2017, pp. 1884–1889. Cognitive Science Society, London (2017)
Stone, P.J., Dunphy, D.C., Smith, M.S.: The general inquirer: a computer approach to content analysis (1966)
Jolliffe, I.T.: Principal component analysis and factor analysis. In: Principal Component Analysis, pp. 115–128. Springer (1986)
Acknowledgments
This research was partially supported by the README project “Interactive and Innovative application for evaluating the readability of texts in Romanian Language and for improving users’ writing styles”, contract no. 114/15.09.2017, MySMIS 2014 code 119286, as well as the FP7 2008-212578 LTfLL project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Botarleanu, RM., Dascalu, M., Sirbu, MD., Crossley, S.A., Trausan-Matu, S. (2019). ReadME – Generating Personalized Feedback for Essay Writing Using the ReaderBench Framework. In: Knoche, H., Popescu, E., Cartelli, A. (eds) The Interplay of Data, Technology, Place and People for Smart Learning. SLERD 2018 2018. Smart Innovation, Systems and Technologies, vol 95. Springer, Cham. https://doi.org/10.1007/978-3-319-92022-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-92022-1_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-92021-4
Online ISBN: 978-3-319-92022-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)