Abstract
This study investigated how instructionalstrategies can support learners' knowledgeacquisition and metacomprehension of complexsystems in a computer-based trainingenvironment, and how individual characteristicsinteract with these manipulations. Incorporating diagrams into the trainingfacilitated performance on measures ofintegrative knowledge (i.e., the integrationand application of task-relevant knowledge),but had no significant effect on measures ofdeclarative knowledge (i.e., mastery of basicfactual knowledge). Diagrams additionallyfacilitated the development of accurate mentalmodels (as measured via a card sorting task)and significantly improved the instructionalefficiency of the training (i.e., higher levelof performance was achieved with less mentaleffort). Finally, diagrams effectivelyscaffolded participants' metacognition,improving their metacomprehension accuracy(i.e., their ability to accurately monitortheir comprehension). These beneficial effectsof diagrams on learners' cognitive andmetacognitive processes were found to bestrongest for participants with low verbalability. Results are discussed in terms ofimplications for the design of adaptivelearning systems.
Similar content being viewed by others
References
Annett, J. (1989). Training of skilled performance. In A.M. Colley & J.R. Beech, eds, Acquisition and Performance of Cognitive Skills, pp. 61–84. New York, NY: John Wiley & Sons.
Bjork, R.A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A.P. Shimamura, eds, Metacognition: Knowing about Knowing, pp. 185–205. Cambridge, MA: The MIT Press.
Britton, B.K., Stimson, M., Stennett, B. & Gulgoz, S (1998). Learning from instructional text: Test of an individual-differences model. Journal of Educational Psychology90: 476–491.
Brown, A.L. (1978). Knowing when, where, and how to remember: A problem of meta-cognition. In R. Glaser, ed, Advances in Instructional Psychology (Vol. 1), pp. 77–165. Hillsdale, NJ: LEA.
Brown, K.G. & Ford, J.K. (2002). Using computer technology in training: Building an infrastructure of active learning. In K. Kraiger, ed, Creating, Implementing, and Managing Effective Training and Development: State-of-the-Art Lessons for Practice, pp. 192–233. San Francisco, CA: Jossey-Bass.
Davidson, J.E., Deuser, R. & Sternberg, R.J. (1994). The role of metacognition in problem solving. In J. Metcalfe & A.P. Shimamura, eds, Metacognition: Knowing about Knowing, pp. 207–226. Cambridge, MA: The MIT Press.
Dunlosky, J., Rawson, K.A. & McDonald, S.L (in press). Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material. To appear in T. Perfect & B. Schwartz. eds, Applied Metacognition. Cambridge, UK: Cambridge University.
Evans, W.E., III, Jentsch, F., Hitt, J.M., II, Bowers, C.A. & Salas, E. (2001). Mental model assessment: Is there convergence among different methods? Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, pp. 293–296. Santa Monica, CA: HFES.
Everson, H.T. & Tobias, S. (1998). The ability to estimate knowledge and performance in college: A metacognitive analysis. Instructional Science26: 65–79.
Ferguson, E.S. (1977). The mind's eye: Nonverbal thought in technology. Science197: 827–836.
Fiore, S.M., Cuevas, H.M. & Oser, R.L. (in press). A picture is worth a thousand connections: The facilitative effects of diagrams on task performance and mental model development. Computers in Human Behavior.
Fiore, S.M., Cuevas, H.M., Scielzo, S. & Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research. Computers in Human Behavior18: 125–140.
Fiore, S.M., Fowlkes, J., Martin-Milham, L. & Oser, R.L. (2000). Convergence or divergence of expert models: On the utility of knowledge structure assessment in training research. Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomic Society,Vol. 2, pp. 427–430. Santa Monica, CA: HFES.
Flavell, J.H. (1979). Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. American Psychologist34: 906–911.
Fleishman, E.A. & Mumford, M.D. (1989). Individual attributes and training performance. In I.L. Goldstein, ed, Training and Development in Organizations, pp. 183–255. San Francisco, CA: Jossey-Bass.
Ford, J.K., Smith, E.M., Weissbein, D.A., Gully, S.M. & Salas, E. (1998). Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. Journal of Applied Psychology83: 218–233.
Glaser, R. (1989). Expertise in learning: How do we think about instructional processes now that we have discovered knowledge structure? In D. Klahr & D. Kotosfky, eds, Complex Information Processing: The Impact of Herbert A. Simon, pp. 269–282. Hillsdale, NJ: LEA.
Gourgey, A.E. (1998). Metacognition in basic skills instruction. Instructional Science26: 81–96.
Gyselinck, V. & Tardieu, H. (1999). The role of illustrations in text comprehension: What, when, for whom, and why? In H. van Oostenddorp & S.R. Goldman, eds, The Construction of Mental Representations During Reading, pp. 195–218. Mahwah, NJ: LEA.
Hall, L.K. & Cremer, E.M. (2000, November). Metacognitive judgments of exam performance. Presented at the 41st Meeting of the Psychonomic Society, New Orleans, LA. Retrieved from http://www.owu.edu/lkhall/psychonomics000.pdf.
Hartman, H.J. (2001a). Developing students metacognitive knowledge and skills. In H.J. Hartman, ed, Metacognition in Learning and Instruction: Theory, Research, and Practice, pp. 33–68. The Netherlands: Kluwer Academic.
Hartman, H.J. (2001b). Metacognition in science teaching and learning. In H.J. Hartman, ed, Metacognition in Learning and Instruction: Theory, Research, and Practice, pp. 173–201. The Netherlands: Kluwer Academic.
Hegarty, M., Carpenter, P.A. & Just, M.A. (1996). Diagrams in the comprehension of scientific texts. In R. Barr & M. Kamil, eds, Handbook of Reading Research, Vol. 2, pp. 641–648. Mahwah, NJ: LEA.
Hegarty, M. & Just, M.A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language32: 717–742.
Hofer, B.K., Yu, S.L. & Pintrich, P.R. (1998). Teaching college students to be self-regulated learners. In D.H. Schunk, & B.J. Zimmerman, eds, Self-Regulated Learning: From Teaching to self-Reflective Practice, pp. 57–85. New York, NY: Guilford Publications.
Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Exercises Book. Englewood, CO: Jeppesen Sanderson, Inc.
Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Maneuvers Manual, 6th edn. Englewood, CO: Jeppesen Sanderson, Inc.
Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Manual, 15th edn. Englewood, CO: Jeppesen Sanderson, Inc.
Johnson-Laird, P.N. (1983). Mental Models: Toward a Cognitive Science of Language, Inference, and Consciousness. Cambridge, MA: Harvard University Press.
Jonassen, D.H., Beissner, K. & Yacci, M. (1993). Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge. Hillsdale, NJ: LEA.
Jonassen, D.H. & Grabowski, B.L. (1993). Handbook of Individual Differences, Learning, and Instruction. Hillsdale, NJ: LEA.
Kalyuga, S., Chandler, P & Sweller, P. (1999). Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology13: 351–371.
Kelemen, W.L., Frost, P.J. & Weaver, C.A., III. (2000). Individual differences in meta-cognition: Evidence against a general metacognitive ability. Memory and Cognition28: 92–107.
Kieras, D.E. (1988). What mental model should be taught: Choosing instructional content for complex engineered systems. In J. Psotka, L.D. Massey & S.A. Mutter, eds, Intelligent Tutoring Systems: Lessons Learned, pp. 85–111. Hillsdale, NJ: LEA.
Kieras, D.E. & Bovair, S. (1984). The role of a mental model in learning to operate a device. Cognitive Science8: 255–273.
King, A. (1992). Facilitating elaborative learning through guided student-generated questioning. Educational Psychologist27: 111–126.
Kruley, P., Sciama, S.C. & Glenberg, A.M. (1994). On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies. Memory and Cognition22: 261–272.
Maki, R.H. (1998). Metacomprehension of text: Influence of absolute confidence level on bias and accuracy. In D. Medin, ed, The Psychology of Learning and Motivation, Vol. 38, pp. 223–248. New York: Academic Press.
Maki, R.H., Jonas, D. & Kallod, M. (1994). The relationship between comprehension and metacomprehension ability. Psychonomic Bulletin and Review1: 126–129.
Maqsud, M. (1998). Effects of metacognitive instruction on mathematics achievement and attitude towards mathematics of low mathematics achievers. Educational Research40: 237–243.
Marcus, N. Cooper, M. & Sweller, J. (1996). Understanding instructions. Journal of Educational Psychology88: 49–63.
Mayer, R.E. (1989). Systematic thinking fostered by illustration in scientific text. Journal of Educational Psychology81: 240–246.
Mayer, R.E. (1998). Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science26: 46–63.
Mayer, R.E. (1999). Instructional technology. In F.T. Durso, R.S. Nickerson, R.W. Schvaneveldt, S.T. Dumais, D.S. Lindsay, & M.T.H. Chi, eds, Handbook of Applied Cognition, pp. 551–569. Chichester, England: John Wiley & Sons.
Mayer, R.E. & Anderson, R.B. (1991). Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology83: 484–490.
Mayer, R.E. & Gallini, J.K. (1990). When is an illustration worth ten thousand words? Journal of Educational Psychology82: 715–726.
Mayer, R.E. & Sims, V.K. (1994). For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. Journal of Educational Psychology86: 389–401.
McInerney, V., McInerney, D.M. & Walsh, H.W. (1997). Effects of metacognitive strategy training within a cooperative group learning context on computer achievement and anxiety: An aptitude-treatment interaction study. Journal of Educational Psychology89: 686–695.
Moore, D., Zabrucky, K & Commander, N.E. (1997). Metacomprehension and comprehension performance in younger and older adults. Educational Gerontology23: 467–475.
Oser, R.L., Cannon-Bowers, J.A., Salas, E., & Dwyer, D.J. (1999). Enhancing human performance in technology-rich environments: Guidelines for scenario-based training. In E. Salas, ed, Human/Technology Interaction in Complex Systems, Vol. 9, pp. 175–202. Stamford, CT: JAI Press.
Oser, R.L., Gualtieri, J.W., Cannon-Bowers, J.A. & Salas, E. (1999). Training team problem solving skills: An event-based approach. Computers in Human Behavior15: 441–462.
Osman, M.E. & Hannafin, M.J. (1992). Metacognition research and theory: Analysis and implications for instructional design. Educational Technology Research and Development40: 83–99.
Paas, F.G.W.C. & Van Merrienboer, J.J.G. (1993). The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human Factors35: 737–743.
Paas, F.G.W.C., Van Merrienboer, J.J.G. & Adam, J.J. (1994). Measurement of cognitive load in instructional research. Perceptual and Motor Skills79: 419–430.
Paivio, A. (1971). Imagery and Verbal Processes. New York: Holt, Rinehart & Winston.
Paivio, A. (1975). Perceptual comparisons through the mind's eye. Memory and Cognition3: 635–647.
Proctor, R.W. & Dutta, A (1995). Skill Acquisition and Human Performance. Thousand Oaks, CA: Sage Publications.
Salas, E., Kosarzycki, M.P., Burke, C.S., Fiore, S.M. & Stone, D.L. (2002). Emerging themes in distance learning research and practice: Some food for thought. International Journal of Management Reviews4: 135–153.
Schraw, G. (1998). Promoting general metacognitive awareness. Instructional Science26: 113–125.
Shanteau, J. (1992). How much information does an expert use? Is it relevant? Acta Psychologica81: 75–86.
Schmidt, A.M. & Ford, J.K. (2001, April). Promoting active learning through metacognitive instruction. Paper presented at the 16th Annual Conference of the Society of Industrial and Organizational Psychology, San Diego, CA.
Smith, E.M., Ford, J.K. & Kozlowski, S.W.J. (1997). Building adaptive expertise: Implications for training design strategies. In M.A. Quinones & A. Ehrenstein, eds, Training for a Rapidly Changing Workplace: Applications of Psychological Research, pp. 89–118. Washington, D. C.: American Psychological Association.
Snow, R.E. (1997). Individual differences. In R.D. Tennyson, F. Schott, N.M. Seel, & S. Dijkstra, eds, Instructional Design: International Perspectives, Volume 1: Theory, Research, and Models, pp. 215–241. Mahwah, NJ: LEA.
Stenning, K. & Oberlander, J. (1995). A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science19: 97–140.
Sternberg, R.J. (1998). Metacognition, abilities, and developing expertise: What makes an expert student? Instructional Science26: 127–140.
Suthers, D. (1999). Effects of alternate representations of evidential relations on collaborative learning discourse. In Proceedings of CSCL99. pp. 611–621. Stanford, CT, December.
Suthers, D., Weiner, A., Connelly, J. & Paolucci, M. (1995). Belvedere: Engaging students in critical discussion of science and public policy issues. In Proceedings of AIED-95.
Van Oostendorp, H. & Goldman, S.R., eds (1999). The Construction of Mental Representations During Reading. Mahwah, NJ: LEA.
Volet, S.E. (1991). Modelling and coaching of relevant metacognitive strategies for enhancing university students' learning. Learning and Instruction1: 319–336.
Weinstein, C.E. & Mayer, R.E. (1986). The teaching of learning strategies. In M.C. Wittrock, ed, Handbook of Research on Teaching, 3rd edn., pp. 315–327. New York, NY: Macmillan.
Wilson J.R. & Rutherford, A. (1989). Mental models: Theory and application in human factors. Human Factors31: 617–634.
Winne, P.H. & Stockley, D.B. (1998). Computing technologies as sites for developing self-regulated learning. In D.H. Schunk & B.J. Zimmerman, eds, Self-Regulated Learning: From Teaching to Self-Reflective Practice, pp. 106–136. New York, NY: Guilford Publications.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Cuevas, H.M., Fiore, S.M. & Oser, R.L. Scaffolding cognitive and metacognitive processes in low verbal ability learners: Use of diagrams in computer-based training environments. Instructional Science 30, 433–464 (2002). https://doi.org/10.1023/A:1020516301541
Issue Date:
DOI: https://doi.org/10.1023/A:1020516301541