Skip to main content

Identifying Argumentative Paragraphs: Towards Automatic Assessment of Argumentation in Theses

  • Conference paper
  • First Online:
Natural Language Processing and Information Systems (NLDB 2018)

Abstract

The academic revisions by instructors is a critical step of the writing process, revealing deficiencies to the students, such as lack of argumentation. Argumentation is needed to communicate clearly ideas and to convince the reader of the stated claims. This paper presents three models to identify argumentative paragraphs in different sections (Problem Statement, Justification, and Conclusion) of theses and determine their level of argumentation. The task is achieved using machine learning techniques with lexical features. The models came from an annotated collection of student writings, which served for training. We performed experiments to evaluate argumentative paragraph identification in the sections, reaching encouraging results compared to previously proposed approaches. Several feature configurations and learning algorithms were tested to reach the models. We applied the models in a web-based argument assessment system to provide access to students, and instructors.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://ccc.inaoep.mx/~jesusmiguelgarcia/detection_arg_par/.

  2. 2.

    Advanced College-level Technician degree, study program offered in some countries.

References

  1. Al-Rfou, R., Perozzi, B., Skiena, S.: Polyglot: distributed word representations for multilingual NLP. In: Proceedings of the 17th Conference on Computational Natural Language Learning, pp. 183–192. ACL, Sofia, August 2013

    Google Scholar 

  2. Burstein, J., Chodorow, M., Leacock, C.: Criterion\(^{SM}\) online essay evaluation: an application for automated evaluation of student essays. In: Proceedings of the 15th Conference on Innovative Applications of Artificial Intelligence, pp. 3–10 (2003)

    Google Scholar 

  3. Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychosoc. Meas. 20(1), 37–46 (1960)

    Article  Google Scholar 

  4. Florou, E., Konstantopoulos, S., Koukourikos, A., Karampiperis, P.: Argument extraction for supporting public policy formulation. In: Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pp. 49–54 (2013)

    Google Scholar 

  5. González-López, S., López-López, A.: Colección de tesis y propuesta de investigación en tics: un recurso para su análisis y estudio. In: XIII Congreso Nacional de Investigación Educativa, pp. 1–15 (2015)

    Google Scholar 

  6. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explor. Newsl. 11(1), 10–18 (2009)

    Article  Google Scholar 

  7. Kirschner, C., Eckle-Kohler, J., Gurevych, I.: Linking the thoughts: analysis of argumentation structures in scientific publications. In: Proceedings of the 2nd Workshop on Argumentation Mining, pp. 1–11. ACL, June 2015

    Google Scholar 

  8. Landis, J.R., Koch, G.G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)

    Article  Google Scholar 

  9. Loll, F., Pinkwart, N.: LASAD: flexible representations for computer-based collaborative argumentation. Int. J. Hum. Comput. Stud. 71(1), 91–109 (2013)

    Article  Google Scholar 

  10. López Ferrero, C., García Negroni, M.: La argumentación en los géneros académicos. In: Actas del Congreso Internacional La Argumentación, pp. 1121–1129. Universidad de Buenos Aires, Buenos Aires (2003)

    Google Scholar 

  11. Lynch, C., Ashley, K.D.: Modeling student arguments in research reports. In: Proceedings of the 4th Conference on Advances in Applied Human Modeling and Simulation, pp. 191–201. CRC Press, Inc. (2012)

    Google Scholar 

  12. Mochales, R., Moens, M.F.: Study on the structure of argumentation in case law. In: Proceedings of the 2008 Conference on Legal Knowledge and Information Systems, pp. 11–20. IOS Press (2008)

    Google Scholar 

  13. Mochales, R., Moens, M.F.: Argumentation mining. Artif. Intell. Law 19(1), 1–22 (2011)

    Article  Google Scholar 

  14. Moens, M.F., Boiy, E., Palau, R.M., Reed, C.: Automatic detection of arguments in legal texts. In: Proceedings of the 11th International Conference on Artificial Intelligence and Law, pp. 225–230. ACM (2007)

    Google Scholar 

  15. Peldszus, A., Stede, M.: From argument diagrams to argumentation mining in texts: a survey. Int. J. Cogn. Inform. Nat. Intell. (IJCINI) 7(1), 1–31 (2013)

    Article  Google Scholar 

  16. Roscoe, R.D., Allen, L.K., Weston, J.L., Crossley, S.A., McNamara, D.S.: The writing Pal intelligent tutoring system: usability testing and development. Comput. Compos. 34, 39–59 (2014)

    Article  Google Scholar 

Download references

Acknowledgement

The first author was partially supported by CONACYT, México, under scholarship 357381.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jesús Miguel García-Gorrostieta .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

García-Gorrostieta, J.M., López-López, A. (2018). Identifying Argumentative Paragraphs: Towards Automatic Assessment of Argumentation in Theses. In: Silberztein, M., Atigui, F., Kornyshova, E., Métais, E., Meziane, F. (eds) Natural Language Processing and Information Systems. NLDB 2018. Lecture Notes in Computer Science(), vol 10859. Springer, Cham. https://doi.org/10.1007/978-3-319-91947-8_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-91947-8_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-91946-1

  • Online ISBN: 978-3-319-91947-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics