Skip to main content
Log in

Scaffolding cognitive and metacognitive processes in low verbal ability learners: Use of diagrams in computer-based training environments

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

This study investigated how instructionalstrategies can support learners' knowledgeacquisition and metacomprehension of complexsystems in a computer-based trainingenvironment, and how individual characteristicsinteract with these manipulations. Incorporating diagrams into the trainingfacilitated performance on measures ofintegrative knowledge (i.e., the integrationand application of task-relevant knowledge),but had no significant effect on measures ofdeclarative knowledge (i.e., mastery of basicfactual knowledge). Diagrams additionallyfacilitated the development of accurate mentalmodels (as measured via a card sorting task)and significantly improved the instructionalefficiency of the training (i.e., higher levelof performance was achieved with less mentaleffort). Finally, diagrams effectivelyscaffolded participants' metacognition,improving their metacomprehension accuracy(i.e., their ability to accurately monitortheir comprehension). These beneficial effectsof diagrams on learners' cognitive andmetacognitive processes were found to bestrongest for participants with low verbalability. Results are discussed in terms ofimplications for the design of adaptivelearning systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Annett, J. (1989). Training of skilled performance. In A.M. Colley & J.R. Beech, eds, Acquisition and Performance of Cognitive Skills, pp. 61–84. New York, NY: John Wiley & Sons.

    Google Scholar 

  • Bjork, R.A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A.P. Shimamura, eds, Metacognition: Knowing about Knowing, pp. 185–205. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Britton, B.K., Stimson, M., Stennett, B. & Gulgoz, S (1998). Learning from instructional text: Test of an individual-differences model. Journal of Educational Psychology90: 476–491.

    Google Scholar 

  • Brown, A.L. (1978). Knowing when, where, and how to remember: A problem of meta-cognition. In R. Glaser, ed, Advances in Instructional Psychology (Vol. 1), pp. 77–165. Hillsdale, NJ: LEA.

    Google Scholar 

  • Brown, K.G. & Ford, J.K. (2002). Using computer technology in training: Building an infrastructure of active learning. In K. Kraiger, ed, Creating, Implementing, and Managing Effective Training and Development: State-of-the-Art Lessons for Practice, pp. 192–233. San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Davidson, J.E., Deuser, R. & Sternberg, R.J. (1994). The role of metacognition in problem solving. In J. Metcalfe & A.P. Shimamura, eds, Metacognition: Knowing about Knowing, pp. 207–226. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Dunlosky, J., Rawson, K.A. & McDonald, S.L (in press). Influence of practice tests on the accuracy of predicting memory performance for paired associates, sentences, and text material. To appear in T. Perfect & B. Schwartz. eds, Applied Metacognition. Cambridge, UK: Cambridge University.

  • Evans, W.E., III, Jentsch, F., Hitt, J.M., II, Bowers, C.A. & Salas, E. (2001). Mental model assessment: Is there convergence among different methods? Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, pp. 293–296. Santa Monica, CA: HFES.

    Google Scholar 

  • Everson, H.T. & Tobias, S. (1998). The ability to estimate knowledge and performance in college: A metacognitive analysis. Instructional Science26: 65–79.

    Google Scholar 

  • Ferguson, E.S. (1977). The mind's eye: Nonverbal thought in technology. Science197: 827–836.

    Google Scholar 

  • Fiore, S.M., Cuevas, H.M. & Oser, R.L. (in press). A picture is worth a thousand connections: The facilitative effects of diagrams on task performance and mental model development. Computers in Human Behavior.

  • Fiore, S.M., Cuevas, H.M., Scielzo, S. & Salas, E. (2002). Training individuals for distributed teams: Problem solving assessment for distributed mission research. Computers in Human Behavior18: 125–140.

    Google Scholar 

  • Fiore, S.M., Fowlkes, J., Martin-Milham, L. & Oser, R.L. (2000). Convergence or divergence of expert models: On the utility of knowledge structure assessment in training research. Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomic Society,Vol. 2, pp. 427–430. Santa Monica, CA: HFES.

    Google Scholar 

  • Flavell, J.H. (1979). Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. American Psychologist34: 906–911.

    Google Scholar 

  • Fleishman, E.A. & Mumford, M.D. (1989). Individual attributes and training performance. In I.L. Goldstein, ed, Training and Development in Organizations, pp. 183–255. San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Ford, J.K., Smith, E.M., Weissbein, D.A., Gully, S.M. & Salas, E. (1998). Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. Journal of Applied Psychology83: 218–233.

    Google Scholar 

  • Glaser, R. (1989). Expertise in learning: How do we think about instructional processes now that we have discovered knowledge structure? In D. Klahr & D. Kotosfky, eds, Complex Information Processing: The Impact of Herbert A. Simon, pp. 269–282. Hillsdale, NJ: LEA.

    Google Scholar 

  • Gourgey, A.E. (1998). Metacognition in basic skills instruction. Instructional Science26: 81–96.

    Google Scholar 

  • Gyselinck, V. & Tardieu, H. (1999). The role of illustrations in text comprehension: What, when, for whom, and why? In H. van Oostenddorp & S.R. Goldman, eds, The Construction of Mental Representations During Reading, pp. 195–218. Mahwah, NJ: LEA.

    Google Scholar 

  • Hall, L.K. & Cremer, E.M. (2000, November). Metacognitive judgments of exam performance. Presented at the 41st Meeting of the Psychonomic Society, New Orleans, LA. Retrieved from http://www.owu.edu/lkhall/psychonomics000.pdf.

  • Hartman, H.J. (2001a). Developing students metacognitive knowledge and skills. In H.J. Hartman, ed, Metacognition in Learning and Instruction: Theory, Research, and Practice, pp. 33–68. The Netherlands: Kluwer Academic.

    Google Scholar 

  • Hartman, H.J. (2001b). Metacognition in science teaching and learning. In H.J. Hartman, ed, Metacognition in Learning and Instruction: Theory, Research, and Practice, pp. 173–201. The Netherlands: Kluwer Academic.

    Google Scholar 

  • Hegarty, M., Carpenter, P.A. & Just, M.A. (1996). Diagrams in the comprehension of scientific texts. In R. Barr & M. Kamil, eds, Handbook of Reading Research, Vol. 2, pp. 641–648. Mahwah, NJ: LEA.

    Google Scholar 

  • Hegarty, M. & Just, M.A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language32: 717–742.

    Google Scholar 

  • Hofer, B.K., Yu, S.L. & Pintrich, P.R. (1998). Teaching college students to be self-regulated learners. In D.H. Schunk, & B.J. Zimmerman, eds, Self-Regulated Learning: From Teaching to self-Reflective Practice, pp. 57–85. New York, NY: Guilford Publications.

    Google Scholar 

  • Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Exercises Book. Englewood, CO: Jeppesen Sanderson, Inc.

    Google Scholar 

  • Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Maneuvers Manual, 6th edn. Englewood, CO: Jeppesen Sanderson, Inc.

    Google Scholar 

  • Jeppesen Sanderson Training Systems (1996). Jeppesen Sanderson Private Pilot Manual, 15th edn. Englewood, CO: Jeppesen Sanderson, Inc.

    Google Scholar 

  • Johnson-Laird, P.N. (1983). Mental Models: Toward a Cognitive Science of Language, Inference, and Consciousness. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Jonassen, D.H., Beissner, K. & Yacci, M. (1993). Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge. Hillsdale, NJ: LEA.

    Google Scholar 

  • Jonassen, D.H. & Grabowski, B.L. (1993). Handbook of Individual Differences, Learning, and Instruction. Hillsdale, NJ: LEA.

    Google Scholar 

  • Kalyuga, S., Chandler, P & Sweller, P. (1999). Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology13: 351–371.

    Google Scholar 

  • Kelemen, W.L., Frost, P.J. & Weaver, C.A., III. (2000). Individual differences in meta-cognition: Evidence against a general metacognitive ability. Memory and Cognition28: 92–107.

    Google Scholar 

  • Kieras, D.E. (1988). What mental model should be taught: Choosing instructional content for complex engineered systems. In J. Psotka, L.D. Massey & S.A. Mutter, eds, Intelligent Tutoring Systems: Lessons Learned, pp. 85–111. Hillsdale, NJ: LEA.

    Google Scholar 

  • Kieras, D.E. & Bovair, S. (1984). The role of a mental model in learning to operate a device. Cognitive Science8: 255–273.

    Google Scholar 

  • King, A. (1992). Facilitating elaborative learning through guided student-generated questioning. Educational Psychologist27: 111–126.

    Google Scholar 

  • Kruley, P., Sciama, S.C. & Glenberg, A.M. (1994). On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies. Memory and Cognition22: 261–272.

    Google Scholar 

  • Maki, R.H. (1998). Metacomprehension of text: Influence of absolute confidence level on bias and accuracy. In D. Medin, ed, The Psychology of Learning and Motivation, Vol. 38, pp. 223–248. New York: Academic Press.

    Google Scholar 

  • Maki, R.H., Jonas, D. & Kallod, M. (1994). The relationship between comprehension and metacomprehension ability. Psychonomic Bulletin and Review1: 126–129.

    Google Scholar 

  • Maqsud, M. (1998). Effects of metacognitive instruction on mathematics achievement and attitude towards mathematics of low mathematics achievers. Educational Research40: 237–243.

    Google Scholar 

  • Marcus, N. Cooper, M. & Sweller, J. (1996). Understanding instructions. Journal of Educational Psychology88: 49–63.

    Google Scholar 

  • Mayer, R.E. (1989). Systematic thinking fostered by illustration in scientific text. Journal of Educational Psychology81: 240–246.

    Google Scholar 

  • Mayer, R.E. (1998). Cognitive, metacognitive, and motivational aspects of problem solving. Instructional Science26: 46–63.

    Google Scholar 

  • Mayer, R.E. (1999). Instructional technology. In F.T. Durso, R.S. Nickerson, R.W. Schvaneveldt, S.T. Dumais, D.S. Lindsay, & M.T.H. Chi, eds, Handbook of Applied Cognition, pp. 551–569. Chichester, England: John Wiley & Sons.

    Google Scholar 

  • Mayer, R.E. & Anderson, R.B. (1991). Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology83: 484–490.

    Google Scholar 

  • Mayer, R.E. & Gallini, J.K. (1990). When is an illustration worth ten thousand words? Journal of Educational Psychology82: 715–726.

    Google Scholar 

  • Mayer, R.E. & Sims, V.K. (1994). For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning. Journal of Educational Psychology86: 389–401.

    Google Scholar 

  • McInerney, V., McInerney, D.M. & Walsh, H.W. (1997). Effects of metacognitive strategy training within a cooperative group learning context on computer achievement and anxiety: An aptitude-treatment interaction study. Journal of Educational Psychology89: 686–695.

    Google Scholar 

  • Moore, D., Zabrucky, K & Commander, N.E. (1997). Metacomprehension and comprehension performance in younger and older adults. Educational Gerontology23: 467–475.

    Google Scholar 

  • Oser, R.L., Cannon-Bowers, J.A., Salas, E., & Dwyer, D.J. (1999). Enhancing human performance in technology-rich environments: Guidelines for scenario-based training. In E. Salas, ed, Human/Technology Interaction in Complex Systems, Vol. 9, pp. 175–202. Stamford, CT: JAI Press.

    Google Scholar 

  • Oser, R.L., Gualtieri, J.W., Cannon-Bowers, J.A. & Salas, E. (1999). Training team problem solving skills: An event-based approach. Computers in Human Behavior15: 441–462.

    Google Scholar 

  • Osman, M.E. & Hannafin, M.J. (1992). Metacognition research and theory: Analysis and implications for instructional design. Educational Technology Research and Development40: 83–99.

    Google Scholar 

  • Paas, F.G.W.C. & Van Merrienboer, J.J.G. (1993). The efficiency of instructional conditions: An approach to combine mental effort and performance measures. Human Factors35: 737–743.

    Google Scholar 

  • Paas, F.G.W.C., Van Merrienboer, J.J.G. & Adam, J.J. (1994). Measurement of cognitive load in instructional research. Perceptual and Motor Skills79: 419–430.

    Google Scholar 

  • Paivio, A. (1971). Imagery and Verbal Processes. New York: Holt, Rinehart & Winston.

    Google Scholar 

  • Paivio, A. (1975). Perceptual comparisons through the mind's eye. Memory and Cognition3: 635–647.

    Google Scholar 

  • Proctor, R.W. & Dutta, A (1995). Skill Acquisition and Human Performance. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Salas, E., Kosarzycki, M.P., Burke, C.S., Fiore, S.M. & Stone, D.L. (2002). Emerging themes in distance learning research and practice: Some food for thought. International Journal of Management Reviews4: 135–153.

    Google Scholar 

  • Schraw, G. (1998). Promoting general metacognitive awareness. Instructional Science26: 113–125.

    Google Scholar 

  • Shanteau, J. (1992). How much information does an expert use? Is it relevant? Acta Psychologica81: 75–86.

    Google Scholar 

  • Schmidt, A.M. & Ford, J.K. (2001, April). Promoting active learning through metacognitive instruction. Paper presented at the 16th Annual Conference of the Society of Industrial and Organizational Psychology, San Diego, CA.

  • Smith, E.M., Ford, J.K. & Kozlowski, S.W.J. (1997). Building adaptive expertise: Implications for training design strategies. In M.A. Quinones & A. Ehrenstein, eds, Training for a Rapidly Changing Workplace: Applications of Psychological Research, pp. 89–118. Washington, D. C.: American Psychological Association.

    Google Scholar 

  • Snow, R.E. (1997). Individual differences. In R.D. Tennyson, F. Schott, N.M. Seel, & S. Dijkstra, eds, Instructional Design: International Perspectives, Volume 1: Theory, Research, and Models, pp. 215–241. Mahwah, NJ: LEA.

    Google Scholar 

  • Stenning, K. & Oberlander, J. (1995). A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science19: 97–140.

    Google Scholar 

  • Sternberg, R.J. (1998). Metacognition, abilities, and developing expertise: What makes an expert student? Instructional Science26: 127–140.

    Google Scholar 

  • Suthers, D. (1999). Effects of alternate representations of evidential relations on collaborative learning discourse. In Proceedings of CSCL99. pp. 611–621. Stanford, CT, December.

  • Suthers, D., Weiner, A., Connelly, J. & Paolucci, M. (1995). Belvedere: Engaging students in critical discussion of science and public policy issues. In Proceedings of AIED-95.

  • Van Oostendorp, H. & Goldman, S.R., eds (1999). The Construction of Mental Representations During Reading. Mahwah, NJ: LEA.

    Google Scholar 

  • Volet, S.E. (1991). Modelling and coaching of relevant metacognitive strategies for enhancing university students' learning. Learning and Instruction1: 319–336.

    Google Scholar 

  • Weinstein, C.E. & Mayer, R.E. (1986). The teaching of learning strategies. In M.C. Wittrock, ed, Handbook of Research on Teaching, 3rd edn., pp. 315–327. New York, NY: Macmillan.

    Google Scholar 

  • Wilson J.R. & Rutherford, A. (1989). Mental models: Theory and application in human factors. Human Factors31: 617–634.

    Google Scholar 

  • Winne, P.H. & Stockley, D.B. (1998). Computing technologies as sites for developing self-regulated learning. In D.H. Schunk & B.J. Zimmerman, eds, Self-Regulated Learning: From Teaching to Self-Reflective Practice, pp. 106–136. New York, NY: Guilford Publications.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cuevas, H.M., Fiore, S.M. & Oser, R.L. Scaffolding cognitive and metacognitive processes in low verbal ability learners: Use of diagrams in computer-based training environments. Instructional Science 30, 433–464 (2002). https://doi.org/10.1023/A:1020516301541

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1020516301541

Navigation