Development of Task Understanding and Monitoring in Information Retrieval Environments: Demystifying Metacognitive and Self-Regulatory Mechanisms in Graduate Learners Using Topic Maps Indexing Technologies to Improve Essay-Writing Skills
The empirical research reported in this chapter explores learner metacognition and self-regulation in information retrieval environments equipped with a powerful indexing technology called Topic Maps. The theoretical foundation for our work lies in the nexus of theories of self-regulation and those of cognitive information retrieval. Through a series of mixed-method studies conducted at the Topic Maps laboratory at Concordia University, we describe academic self-regulatory processes associated with graduate learners’ understandings of ill-structured academic writing tasks and attempt to relate them to learners’ metacognitive ability to judge their own performance on iterations of these writing tasks. The thirty-eight participants in the studies described in this chapter used the Topic Maps technology throughout a semester to navigate a repository of instructor-annotated essays. The repository was designed not only to help learners complete their own writing assignments, but also to improve their task understanding and better calibrate their performance from one instantiation of the writing assignment to the next. Results are discussed in light of the novel intra-sample statistical analyses used to uncover relationships between academic performance, metacognition and task understanding.
KeywordsInformation Retrieval Academic Task Online Learning Environment Metacognitive Monitoring Indexing Technology
The work reported herein is made possible through grants received by the government of Québec’s fonds québecois de recherché sur la société et la culture as well as from faculty of Arts and Sciences at Concordia University. The authors would like to thank Stef Rucco, Technical Manager of the Department of Education at Concordia University, for his help in setting up, upgrading and securing the Ontopia Knowledge Suite on the department servers.
- Aleven, V. (2006). An intelligent learning environment for case-based argumentation. Technology, Instruction, Cognition and Learning, 4(2), 191–241.Google Scholar
- Biggs, J. B. (1991). Student learning in the context of school. In J. B. Biggs (Ed.), Teaching for learning: The view from cognitive psychology (pp. 7–29). Hawthorn, VA: The Australian Council for Educational Research Ltd.Google Scholar
- Biggs, J. B., & Collis, K. (1982). Evaluating the quality of learning: The SOLO taxonomy. New York: Academic.Google Scholar
- Bourdeau, J., Mizoguchi, R., Hayashi, Y., Psyche, V., & Nkambou, R. (2007). When the domain of the ontology is education. Proceedings of LORNET 2007, User Centered Knowledge Environments: From Theory to Practice, the Fourth Annual LORNET Conference I2LOR 2007 of the LORNET Research Network. Montreal, QC: Lornet.Google Scholar
- Canadian Council on Learning [CCL] (2007). Post-secondary education in Canada: Strategies for success. Retrieved November 30, 2010, from http://www.ccl-cca.ca/CCL/Reports/PostSecondaryEducation?Language=EN.
- Crampes, M., & Bourdeau, J. (2004). Editorial du numéro spécial, Ontologies pour les EIAH, Revue Sciences et Technologies de l’Information et de la Communication pour l’Education et la Formation, 11, 223–230. Retrieved November 30, 2010, from http://sticef.univ-lemans.fr/num/vol2004/sticef_2004_edito_special.htm.
- Ingwersen, P. (2000). Cognitive information retrieval. Annual Review of Information Science and Technology, 34, 3–52.Google Scholar
- International Organization for Standardisation [ISO] (2002). Topic maps. Retrieved November 30, 2010, from http://www.y12.doe.gov/sgml/sc34/document/0129.pdf.
- Magnan, F., & Paquette, G. (2006). Telos: An ontology-driven e-learning OS. In S. Weibelzahl & A. Cristea (Eds.) Proceedings of Workshops held at the Fourth International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH2006). Lecture Notes in Learning and Teaching. Dublin: National College of Ireland.Google Scholar
- Nietfeld, J. L., Cao, L., & Osborne, J. W. (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. The Journal of Experimental Education, 74(1), 7–28.Google Scholar
- Pepper, S. (2002). The TAO of Topic Maps. Retrieved November 30, 2010, from http://www.ontopia.net/topicmaps/materials/tao.html.
- Pressley, M., & Schneider, W. (1997). Introduction to memory development during childhood and adolescence. Mahwah, NJ: Erlbaum.Google Scholar
- Shaikh, K., Zuberi, A., & Venkatesh, V. (2012). Exploring counter-theoretical instances of graduate learners’ self-regulatory processes when using online repositories. International Journal of Technologies in Higher Education, 9, 6–19.Google Scholar
- Shaw, S., & Venkatesh, V. (2005). The missing link to enhanced course management systems: Adopting learning content management systems in the educational sphere. In P. McGee, C. Carmean, & A. Jafari (Eds.), Course management systems for learning: Beyond accidental pedagogy (pp. 206–231). Hershey, PA: Idea Group.CrossRefGoogle Scholar
- Simard, A., Broome, J., Drury, M., Haddon, B., O’Neil, B., & Pasho, D. (2007). Understanding knowledge services at Natural Resources Canada. Retrieved November 30, 2010, from http://dsp-psd.pwgsc.gc.ca/collection_2007/nrcan-rncan/M4-45-2006E.pdf.
- Thiede, K. W., Dunlosky, J., Griffin, T. D., & Wiley, J. (2005). Understanding the delayed-keyword effect on metacomprehension accuracy. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(6), 1267–1280.Google Scholar
- Venkatesh, V., & Shaikh, K. (2008). Investigating task understanding in online repositories equipped with Topic Map indexes: Implications for improving self-regulatory processes in graduate learners. International Journal of Technologies in Higher Education, 5(3), 22–35.Google Scholar
- Venkatesh, V., & Shaikh, K. (2011). Uncovering relationships between task understanding and monitoring proficiencies in post-secondary learners: Comparing work task and learner as statistical units of analyses. Education Research International, 2011, Article ID 735643, 11 pages. Retrieved June 20, 2011 from: http://downloads.hindawi.com/journals/edu/2011/735643.pdf.
- Venkatesh, V., Shaikh, K., & Zuberi, A. (2010). Topic maps as indexing tools in the educational sphere: Theoretical foundations, review of empirical research and future challenges. In K. Perusich (Ed.), Cognitive maps (pp. 1–12). Vienna, Austria: In-Tech.Google Scholar
- Venkatesh, V., Shaw, S., Dicks, D., Lowerison, G., Zhang, D., & Sanjakdar, R. (2007). Topic maps: Adopting user-centred indexing technologies in course management systems. Journal of Interactive Learning Research, 18(3), 429–450.Google Scholar
- Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Mahwah, NJ: Erlbaum.Google Scholar
- Zimmerman, B. J., & Moylan, A. R. (2009). Self-regulation: Where metacognition and motivation intersect. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition and education (pp. 299–315). New York: Routledge.Google Scholar