Abstract
The academic revisions by instructors is a critical step of the writing process, revealing deficiencies to the students, such as lack of argumentation. Argumentation is needed to communicate clearly ideas and to convince the reader of the stated claims. This paper presents three models to identify argumentative paragraphs in different sections (Problem Statement, Justification, and Conclusion) of theses and determine their level of argumentation. The task is achieved using machine learning techniques with lexical features. The models came from an annotated collection of student writings, which served for training. We performed experiments to evaluate argumentative paragraph identification in the sections, reaching encouraging results compared to previously proposed approaches. Several feature configurations and learning algorithms were tested to reach the models. We applied the models in a web-based argument assessment system to provide access to students, and instructors.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
Advanced College-level Technician degree, study program offered in some countries.
References
Al-Rfou, R., Perozzi, B., Skiena, S.: Polyglot: distributed word representations for multilingual NLP. In: Proceedings of the 17th Conference on Computational Natural Language Learning, pp. 183–192. ACL, Sofia, August 2013
Burstein, J., Chodorow, M., Leacock, C.: Criterion\(^{SM}\) online essay evaluation: an application for automated evaluation of student essays. In: Proceedings of the 15th Conference on Innovative Applications of Artificial Intelligence, pp. 3–10 (2003)
Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychosoc. Meas. 20(1), 37–46 (1960)
Florou, E., Konstantopoulos, S., Koukourikos, A., Karampiperis, P.: Argument extraction for supporting public policy formulation. In: Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pp. 49–54 (2013)
González-López, S., López-López, A.: Colección de tesis y propuesta de investigación en tics: un recurso para su análisis y estudio. In: XIII Congreso Nacional de Investigación Educativa, pp. 1–15 (2015)
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)
Kirschner, C., Eckle-Kohler, J., Gurevych, I.: Linking the thoughts: analysis of argumentation structures in scientific publications. In: Proceedings of the 2nd Workshop on Argumentation Mining, pp. 1–11. ACL, June 2015
Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)
Loll, F., Pinkwart, N.: LASAD: flexible representations for computer-based collaborative argumentation. Int. J. Hum. Comput. Stud. 71(1), 91–109 (2013)
López Ferrero, C., García Negroni, M.: La argumentación en los géneros académicos. In: Actas del Congreso Internacional La Argumentación, pp. 1121–1129. Universidad de Buenos Aires, Buenos Aires (2003)
Lynch, C., Ashley, K.D.: Modeling student arguments in research reports. In: Proceedings of the 4th Conference on Advances in Applied Human Modeling and Simulation, pp. 191–201. CRC Press, Inc. (2012)
Mochales, R., Moens, M.F.: Study on the structure of argumentation in case law. In: Proceedings of the 2008 Conference on Legal Knowledge and Information Systems, pp. 11–20. IOS Press (2008)
Mochales, R., Moens, M.F.: Argumentation mining. Artif. Intell. Law 19(1), 1–22 (2011)
Moens, M.F., Boiy, E., Palau, R.M., Reed, C.: Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law, pp. 225–230. ACM (2007)
Peldszus, A., Stede, M.: From argument diagrams to argumentation mining in texts: a survey. Int. J. Cogn. Inform. Nat. Intell. (IJCINI) 7(1), 1–31 (2013)
Roscoe, R.D., Allen, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The writing Pal intelligent tutoring system: usability testing and development. Comput. Compos. 34, 39–59 (2014)
Acknowledgement
The first author was partially supported by CONACYT, México, under scholarship 357381.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
García-Gorrostieta, J.M., López-López, A. (2018). Identifying Argumentative Paragraphs: Towards Automatic Assessment of Argumentation in Theses. In: Silberztein, M., Atigui, F., Kornyshova, E., Métais, E., Meziane, F. (eds) Natural Language Processing and Information Systems. NLDB 2018. Lecture Notes in Computer Science(), vol 10859. Springer, Cham. https://doi.org/10.1007/978-3-319-91947-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-91947-8_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-91946-1
Online ISBN: 978-3-319-91947-8
eBook Packages: Computer ScienceComputer Science (R0)