Abstract
Our study integrates automated natural language-oriented assessment and analysis methodologies into feasible reading comprehension tasks. With the newly developed T-MITOCAR toolset, prose text can be automatically converted into an association net which has similarities to a concept map. The “text to graph” feature of the software is based on several parsing heuristics and can be used both to assess the learner’s understanding by generating graphical information from his or her text and to generate conceptual graphs from text which can be used as learning materials. In this study we investigate the effects of association nets made available to learners prior to reading. The results reveal that the automatically created graphs are highly similar to classical expert graphs. However, neither the association nets nor the expert graphs had a significant effect on learning, although the latter have been reported to have an effect in previous studies.
Similar content being viewed by others
References
Abrams, M. H. (1993). A glossary of literary terms. Fort Worth, TX: Harcourt Brace College Publishers.
Al-Diban, S. (2002). Diagnose mentaler modelle. Hamburg: Verlag Dr. Kovac.
Brill, E. (1995). Unsupervised learning of dismabiguation rules for part of speech tagging. Paper presented at the Second Workshop on Very Large Corpora, WVLC-95, Boston.
Cañas, A. J., Hill, R., Carff, R., Suri, N., Lott, J., Eskridge, T., et al. (2004). CmapTools: A knowledge modeling and sharing environment. In A. J. Cañas, J. D. Novak, & F. M. González (Eds.), Concept maps: theory, methodology, technology, proceedings of the First International Conference on Concept Mapping (pp. 125–133). Pamplona: Universidad Pública de Navarra.
Christmann, U., & Groeben, N. (1999). Psychologie des Lesens. In B. Franzmann, K. Hasemann, D. Löffler, & E. Schön (Eds.), Handbuch lesen (pp. 145–223). München: Saur.
Crinon, J., & Legros, D. (2002). The semantic effects of consulting a textual database on rewriting. Learning and Instruction, 12(6), 605–626.
Dinter, F. R. (1993). Mentale Modelle als Konstrukt der empirischen Erziehungswissenschaft. [Mental models as constructs of the empirical learning science]. Saarbrücken: Universität Saarbrücken.
Eliaa, I., Gagatsisa, A., & Demetriou, A. (2007). The effects of different modes of representation on the solution of one-step additive problems. Learning and Instruction, 17(6), 658–672.
Groeben, N. (1992). Leserpsychologie: Textverständnis—textverständlichkeit. Münster: Aschendorff.
Hardy, I., & Stadelhofer, B. (2006). Concept Maps wirkungsvoll als Strukturierungshilfen einsetzen. Welche Rolle spielt die Selbstkonstruktion? Zeitschrift für Pädagogische Psychologie, 20(3), 175–187.
Ifenthaler, D. (2006). Diagnose lernabhängiger Veränderung mentaler Modelle. Entwicklung der SMD-Technologie als methodologisches Verfahren zur relationalen, strukturellen und semantischen Analyse individueller Modellkonstruktionen. Freiburg: FreiDok.
Ifenthaler, D. (2009). Model-based feedback for improving expertise and expert performance. Technology, Instruction, Cognition and Learning, 7(2), 83–101.
Ifenthaler, D. (2010a). Relational, structural, and semantic analysis of graphical representations and concept maps. Educational Technology Research and Development, 58(1), 81–97.
Ifenthaler, D. (2010b). Scope of graphical indices in educational diagnostics. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge. New York: Springer.
Ifenthaler, D., & Seel, N. M. (2005). The measurement of change: Learning-dependent progression of mental models. Technology, Instruction, Cognition and Learning, 2(4), 317–336.
Jensen, F. V. (2001). Bayesian networks and decision graphs. New York: Springer.
Johnson, T. E., O’Connor, D. L., Spector, J. M., Ifenthaler, D., & Pirnay-Dummer, P. (2006). Comparative study of mental model research methods: Relationships among ACSMM, SMD, MITOCAR & DEEP methodologies. In A. J. Cañas & J. D. Novak (Eds.), Concept maps: Theory, methodology, technology. Proceedings of the Second International Conference on Concept Mapping (Vol. 1, pp. 87–94). San José: Universidad de Costa Rica.
Johnson, T. E., Ifenthaler, D., Pirnay-Dummer, P., & Spector, J. M. (2009). Using concept maps to assess individuals and team in collaborative learning environments. In P. L. Torres & R. C. V. Marriott (Eds.), Handbook of research on collaborative learning using concept mapping (pp. 358–381). Hershey, PA: Information Science Publishing.
Jonassen, D. H., & Cho, Y. H. (2008). Externalizing mental models with mindtools. In D. Ifenthaler, P. Pirnay-Dummer, & J. M. Spector (Eds.), Understanding models for learning and instruction. Essays in honor of Norbert M. Seel (pp. 145–160). New York: Springer.
Jonassen, D. H., Reeves, T. C., Hong, N., Harvey, D., & Peters, K. (1997). Concept mapping as cognitive learning and assessment tools. Journal of Interactive Learning Research, 8(3/4), 289–308.
Langer, I., Schulz, V., Thun, F., & Tausch, R. (1974). Verständlichkeit in der Schule, Verwaltung, Politik und Wissenschaft. München: Reinhardt.
Mayer, R. E. (1989). Models for understanding. Review of Educational Research, 59(1), 43–64.
Novak, J. D. (1998). Learning, creating, and using knowledge: Concept maps as facilitative tools in schools and corporations. Mahwah, NJ: Lawrence Erlbaum Associates.
Pirnay-Dummer, P. (2006). Expertise und Modellbildung: MITOCAR. Freiburg: FreiDok.
Pirnay-Dummer, P. (2007). Model inspection trace of concepts and relations. A heuristic approach to language-oriented model assessment. Paper presented at the AREA 2007, Chicago, IL.
Pirnay-Dummer, P. (2010). Complete structure comparison. In D. Ifenthaler, P. Pirnay-Dummer, & N. M. Seel (Eds.), Computer-based diagnostics and systematic analysis of knowledge. New York: Springer.
Pirnay-Dummer, P., & Rohde, J. (2009). How knowledge assessment methods may be utilized to help learners with their assignments. Using automated assessment tools to provide coaching support during writing tasks. Paper presented at the AERA Annual Meeting, San Diego, CA, USA.
Pirnay-Dummer, P., & Spector, J. M. (2008). Language, association, and model re-representation. How features of language and human association can be utilized for automated knowledge assessment. Paper presented at the AREA 2008, New York.
Pirnay-Dummer, P., & Walter, S. (2009). Bridging the world’s knowledge to individual knowledge using latent semantic analysis and web ontologies to complement classical and new knowledge assessment technologies. Technology, Instruction, Cognition and Learning, 7(1), 21–45.
Pirnay-Dummer, P., Ifenthaler, D., & Rohde, J. (2009). Text-guided automated self-assessment. In D. Kinshuk, G. Sampson, J. M. Spector, P. Isaias & D. Ifenthaler (Eds.), Proceedings of the IADIS international conference on cognition and exploratory learning in the digital age (pp. 311–316). Rome: IADIS Press.
Pirnay-Dummer, P., Ifenthaler, D., & Spector, J. M. (2010). Highly integrated model assessment technology and tools. Educational Technology Research and Development, 58(1), 3–18.
Pollio, H. R. (1966). The structural basis of word association behavior. The Hague: Mouton.
Scheele, B., & Groeben, N. (1984). Die Heidelberger Struktur-Lege-Technik (SLT). Eine Dialog-Konsens-Methode zur Erhebung subjektiver Theorien mittlerer Reichweite. Weinheim: Beltz.
Schlomske, N., & Pirnay-Dummer, P. (2009). Model based assessment of learning dependent change within a two semester class. Educational Technology Research and Development, 57(6), 753–765. doi:10.1007/s11423-009-9125-x.
Schnotz, W. (2001). Kognitive Prozesse bei der sprach- und bildgestützten Konstruktion mentaler Modelle. In L. Sichelschmidt & H. Strohner (Eds.), Sprache, Sinn und Situation (pp. 43–57). Wiesbaden: Deutscher Universitätsverlag.
Seel, N. M. (1991). Weltwissen und Mentale Modelle [World knowledge and mental models]. Göttingen: Hogrefe.
Seel, N. M. (2003). Model centered learning and instruction. Technology, Instruction, Cognition and Learning, 1(1), 59–85.
Seel, N. M., & Dinter, F. R. (1995). Instruction and mental model progression: Learner-dependent effects of teaching strategies on knowledge acquisition and analogical transfer. Educational Research and Evaluation, 1(1), 4–35.
Seel, N. M., & Schenk, K. (2003). Multimedia environments as cognitive tools for enhancing model-based learning and problem solving. An evaluation report. Evaluation and Program Planning, 26(2), 215–224.
Smith, W. G. (1894). Mediate association. Mind, 3(11), 289–304.
Smith, W. G. (1918). Methods for studying controlled word associations. Psychobiology, 1(6), 369–428.
Sowa, J. F. (1984). Conceptual structures: Information processing in mind and machine. Reading, MA: Addison-Wesley.
Tversky, A. (1977). Features of similarity. Psychological Review, 84, 327–352.
Wells, F. L. (1911). Some properties of the free association time. Psychological Review, 18, 1–24.
Williams, F. (1968). Reasoning with statistics. New York: Holt, Rinehart and Winston.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pirnay-Dummer, P., Ifenthaler, D. Reading guided by automated graphical representations: How model-based text visualizations facilitate learning in reading comprehension tasks. Instr Sci 39, 901–919 (2011). https://doi.org/10.1007/s11251-010-9153-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11251-010-9153-2