Skip to main content
Log in

Supporting learning with interactive multimedia through active integration of representations

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

When learners explore dynamic and interactive visualisations they are often not able to interact with them in a systematic and goal-oriented way. Frequently, even supporting learners in processes of discovery learning does not lead to better learning outcomes. This can be due to missing pre-requisite knowledge such as the coherent mental integration of the pictorial and symbolic sources of information. In order to support learners in this process, we encouraged them to interactively and externally relate different static sources of information to each other before exploring dynamic and interactive visualisations. We evaluated the benefit of this instructional support in two experimental studies concerning the domains of statistics and mechanics. It revealed that the active integration of static representations before processing dynamic visualisations resulted in better performance and can provide a basis for a more systematic and goal-oriented experimentation behaviour during simulation-based discovery learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • S. Ainsworth (1999) ArticleTitleThe functions of multiple representations Computers and Education 33 131–152

    Google Scholar 

  • S. Ainsworth P.A. Bibby D.J. Wood (2002) ArticleTitleExamining the effects of different multiple representational systems in learning primary mathematics Journal of the Learning Sciences 11 25–62

    Google Scholar 

  • S. Ainsworth N. Labeke Particlevan (2004) ArticleTitleMultiple forms of dynamic representation Learning and Instruction 14 241–255

    Google Scholar 

  • K. Blaschke D. Heuer (2000) ArticleTitleDynamik-Lernen mit multimedial-experimentell unterstütztem Werkstatt-Unterricht [Learning dynamics in multimedia projects] Physik in der Schule 38 1–6

    Google Scholar 

  • D. Bodemer R. Ploetzner I. Feuerlein H. Spada (2004) ArticleTitleThe active integration of information during learning with dynamic and interactive visualizations Learning and Instruction 14 325–341

    Google Scholar 

  • R. Brünken S. Steinbacher W. Schnotz D. Leutner (2001) ArticleTitleMentale Modelle und Effekte der Präsentations- und Abrufkodalität beim Lernen mit Multimedia [Mental models and the effects of presentation and retrieval mode in multimedia learning] Zeitschrift für Pädagogische Psychologie 15 15–27

    Google Scholar 

  • P. Chandler J. Sweller (1991) ArticleTitleCognitive load theory and the format of instruction Cognition and Instruction 8 293–332

    Google Scholar 

  • P. Chandler J. Sweller (1992) ArticleTitleThe split-attention effect as a factor in the design of instruction British Journal of Educational Psychology 62 233–246

    Google Scholar 

  • T. Jong Particlede W.R. Joolingen Particlevan (1998) ArticleTitleScientific discovery learning with computer simulations of conceptual domains Review of Educational Research 68 179–201

    Google Scholar 

  • D. Gentner (1983) ArticleTitleStructure-mapping: A theoretical framework for analogy Cognitive Science 7 155–170

    Google Scholar 

  • D. Gentner A.B. Markman (1997) ArticleTitleStructure mapping in analogy and similarity American Psychologist 52 45–56

    Google Scholar 

  • S. Kalyuga P. Chandler J. Sweller (1999) ArticleTitleManaging split-attention and redundancy in multimedia instruction Applied Cognitive Psychology 13 351–371

    Google Scholar 

  • D. Klahr K. Dunbar (1988) ArticleTitleDual space search during scientific reasoning Cognitive Science 12 1–48

    Google Scholar 

  • R. Kozma (2003) ArticleTitleThe material features of multiple representations and their cognitive and social affordances for science understanding Learning and Instruction 13 205–226

    Google Scholar 

  • R.B. Kozma J. Russell T. Jones N. Marx J. Davis (1996) The use of multiple linked representations to facilitate science understanding S. Vosniadou E. Corte ParticleDe R. Glaser H. Mandl (Eds) International Perspectives on the Design of Technology Supported Learning Environments Erlbaum Hillsdale, NJ 41–61

    Google Scholar 

  • J.H. Larkin H.A. Simon (1987) ArticleTitleWhy a diagram is (sometimes) worth ten thousands words Cognitive Science 11 65–99

    Google Scholar 

  • D. Leutner (1993) ArticleTitleGuided discovery learning with computer-based simulation games: effects of adaptive and non-adaptive instructional support Learning and Instruction 3 113–132

    Google Scholar 

  • R.K. Lowe (1999) ArticleTitleExtracting information from an animation during complex visual learning European Journal of Psychology of Education 14 225–244

    Google Scholar 

  • R.K. Lowe (2003) ArticleTitleAnimation and learning: Selective processing of information in dynamic graphics Learning and Instruction 13 157–176

    Google Scholar 

  • R.E. Mayer (1997) ArticleTitleMultimedia learning: Are we asking the right questions Educational Psychologist 32 1–19

    Google Scholar 

  • R.E. Mayer (2001) Multimedia Learning Cambridge University Press NY

    Google Scholar 

  • M. Njoo T. Jong Particlede (1993) Supporting exploratory learning by offering structured overviews of hypotheses D.M. Towne T. Jong Particlede H. Spada (Eds) Simulation-based Experiential Learning Springer Publishers Berlin 207–223

    Google Scholar 

  • R. Ploetzner D. Bodemer I. Feuerlein (2001) Facilitating the mental integration of multiple sources of information in multimedia learning environments C. Montgomerie J. Viteli (Eds) Proceedings of the World Conference on Educational Multimedia, Hypermedia & Telecommunications Association for the Advancement of Computing in Education Norfolk, VA 1501–1506

    Google Scholar 

  • Ploetzner, R., Bodemer,D. & Neudert, S. (in press) Successful and unsuccessful use of dynamic visualisations in instructional texts. In R.K. Lowe & W. Schnotz, eds, Learning with Animations. New York: Cambridge University Press.

  • C.M. Reigeluth E. Schwartz (1989) ArticleTitleAn instructional theory for the design of computer-based simulations Journal of Computer-Based Instruction 16 1–10

    Google Scholar 

  • P. Reimann (1991) ArticleTitleDetecting functional relations in a computerized discovery environment Learning and Instruction 1 45–65

    Google Scholar 

  • L.P. Rieber S.-C. Tzeng K. Tribble (2004) ArticleTitleDiscovery learning, representation, and explanation within a computer-based simulation: Finding the right mix Learning and Instruction 14 307–323

    Google Scholar 

  • L. Schauble R. Glaser K. Raghavan M. Reiner (1991) ArticleTitleCausal models and experimentation strategies in scientific reasoning The Journal of the Learning Sciences 1 201–239

    Google Scholar 

  • W. Schnotz M. Bannert (1999) ArticleTitleEinflüsse der Visualisierungsform auf die Konstruktion mentaler Modelle beim Text- und Bildverstehen [Influence of the type of visualization on the construction of mental models during picture and text comprehension] Zeitschrift für Experimentelle Psychologie 46 217–236

    Google Scholar 

  • W. Schnotz M. Bannert (2003) ArticleTitleConstruction and interference in learning from multiple representation Learning and Instruction 13 141–156

    Google Scholar 

  • W. Schnotz J. Boeckheler H. Grzondziel (1999) ArticleTitleIndividual and co-operative learning with interactive animated pictures European Journal of Psychology of Education 14 245–265

    Google Scholar 

  • T. Seufert (2003) ArticleTitleSupporting coherence formation in learning from multiple representations Learning and Instruction 13 227–237

    Google Scholar 

  • J. Swaak W.R. Joolingen Particlevan T. Jong Particlede (1998) ArticleTitleSupporting simulation-based learning: The effects of model progression and assignments on definitional and intuitive knowledge Learning and Instruction 8 235–252

    Google Scholar 

  • J. Sweller (1988) ArticleTitleCognitive load during problem solving: Effects on learning Cognitive Science 12 257–285

    Google Scholar 

  • J. Sweller J.J.G. Merriënboer Particlevan F.G.W.C. Paas (1998) ArticleTitleCognitive architecture and instructional design Educational Psychology Review 10 251–296

    Google Scholar 

  • R.A. Tarmizi J. Sweller (1988) ArticleTitleGuidance during mathematical problem solving Journal of Educational Psychology 80 424–436

    Google Scholar 

  • W.R. Joolingen ParticleVan T. Jong Particlede (1991) ArticleTitleSupporting hypothesis generation by learners exploring an interactive computer simulation Instructional Science 20 389–404

    Google Scholar 

  • W.R. Joolingen ParticleVan T. Jong Particlede (1997) ArticleTitleAn extended dual search space model of scientific discovery learning Instructional Science 25 307–346

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Daniel Bodemer.

Additional information

in final form: 16 November 2004

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bodemer, D., Ploetzner, R., Bruchmüller, K. et al. Supporting learning with interactive multimedia through active integration of representations. Instr Sci 33, 73–95 (2005). https://doi.org/10.1007/s11251-004-7685-z

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11251-004-7685-z

Keywords

Navigation