Journal of Computing in Higher Education

, Volume 23, Issue 1, pp 15–37 | Cite as

If a picture is worth a thousand words is video worth a million? Differences in affective and cognitive processing of video and text cases

  • Aman YadavEmail author
  • Michael M. Phillips
  • Mary A. Lundeberg
  • Matthew J. Koehler
  • Katherine Hilden
  • Kathryn H. Dirkin


In this investigation we assessed whether different formats of media (video, text, and video + text) influenced participants’ engagement, cognitive processing and recall of non-fiction cases of people diagnosed with HIV/AIDS. For each of the cases used in the study, we designed three informationally-equivalent versions: video, text, and video + text. Thirty participants experienced one version in each format, thought aloud as they read or viewed the case, discussed their reactions to the stories during an interview, and completed an affective and engagement survey. Participants were again interviewed 6 weeks later to assess their memory for the cases. Results from protocol analysis indicate that the video and video + text versions of the stories led to higher levels of both engagement and sympathy with the characters, and recall of particular information; however, interactions between medium and content were important. We argue the main benefit of video lies in engaging students emotionally in the content.


Cognitive processes/development ANOVA/MANOVA Factor analysis Survey research Learning processes/strategies 



We would like to thank Mark Bergland and Karen Klyczek, Biology Department of University of Wisconsin-River Falls for their support. This research was partially funded by NSF Grant DUE 0229156. Any opinion, finding, conclusions or recommendations expressed in this publication are those of the authors and do not necessarily reflect the views of any of the supporting institutions.


  1. Aikenhead, G. S. (2006). Science education for everyday life: Evidence-based practice. New York: Teachers College Press.Google Scholar
  2. Ashcraft, M. (1989). Human memory and cognition. Glenview, IL: Scott, Foresman and Company.Google Scholar
  3. Baggett, P. (1979). Structurally equivalent stories in movie and text and the effect of the medium on recall. Journal of Verbal Learning and Verbal Behavior, 18, 333–356.CrossRefGoogle Scholar
  4. Birdwhistell, R. L. (1970). Kinesics and context: Essays on body motion communication. Philadelphia: University of Pennsylvania Press.Google Scholar
  5. Brophy, J. (1999). Toward a model of the value aspects of motivation in education: Developing appreciation for particular learning domains and activities. Educational Psychologist, 34, 75–85.CrossRefGoogle Scholar
  6. Brophy, J. (2004). Motivating students to learn (2nd ed.). Boston, MA: McGraw Hill.Google Scholar
  7. Clark, R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53(4), 445–459.Google Scholar
  8. Clark, R. E. (1994). Media will never influence learning. Educational Technology Research and Development, 42(2), 21–29.CrossRefGoogle Scholar
  9. Clark, J. M., & Paivio, A. (1991). Dual coding theory and education. Educational Psychology Review, 3, 149–210.CrossRefGoogle Scholar
  10. Cody, R., & Lee, C. (1990). Behaviors, beliefs, and intentions in skin cancer prevention. Journal of Behavioral Medicine, 13(4), 373–389.CrossRefGoogle Scholar
  11. Dewey, J. (1916). Democracy and education: An introduction to the philosophy of education. New York: MacMillan.Google Scholar
  12. Field, A. (2009). Discovering statistics using SPSS. Thousand Oaks, CA: Sage Publication.Google Scholar
  13. Hidi, S. (1990). Interest and its contribution as a mental resource for learning. Review of Educational Research, 60(4), 549–572.Google Scholar
  14. Jennings, T. (2007). Addressing diversity in US teacher preparation programs: A survey of elementary and secondary programs’ priorities and challenges from across the United States of America. Teaching and Teacher Education, 23, 1258–1271.CrossRefGoogle Scholar
  15. Kintsch, W., & van Dijk, T. (1975). Recalling and summarizing stories. Language, 40, 98–116.Google Scholar
  16. Koehler, M. J., Yadav, A., Phillips, M. M., & Cavazos-Kottke, S. C. (2005). What is video good for? Examining how media and story genre interact. Journal of Educational Multimedia and Hypermedia, 14(3), 249–272.Google Scholar
  17. Kozma, R. B. (1994). Will media influence learning? Reframing the debate. Educational Technology Research and Development, 42(2), 7–19.CrossRefGoogle Scholar
  18. Lewalter, D. (2003). Cognitive strategies for learning from static and dynamic visuals. Learning and Instruction, 13(2), 177–189.CrossRefGoogle Scholar
  19. Lundeberg, M. A. (1987). Metacognitive aspects of reading comprehension: Studying understanding in legal case analysis. Reading Research Quarterly, 22(4), 407–432.CrossRefGoogle Scholar
  20. Machula, R. S. (1978). Media and affect: A comparison of video-tape, audio-tape, and print. Journal of Educational Technology Systems, 7(2), 167–185.CrossRefGoogle Scholar
  21. Mandler, G. (1967). Organization and memory. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory (pp. 327–372). New York: Academic Press.Google Scholar
  22. Mayer, R. E., Heiser, J., & Lonn, S. (2001). Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology, 93(1), 187–198.CrossRefGoogle Scholar
  23. Mayer, R. E., Stull, A., DeLeeuw, K., Almeroth, K., Bimber, B., Chun, D., et al. (2009). Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes. Contemporary Educational Psychology, 34, 51–57.CrossRefGoogle Scholar
  24. Mayer, R. E., & Wittrock, M. C. (2006). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (pp. 287–304). Mahwah, NJ: Erlbaum.Google Scholar
  25. Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91(2), 358–368.CrossRefGoogle Scholar
  26. Osgood, C. E., Suci, G., & Tannenbaum, P. (1957). The measurement of meaning. Urbana, IL: University of Illinois Press.Google Scholar
  27. Paivio, A. (1990). Mental representations: A dual coding approach. New York: Oxford University Press.Google Scholar
  28. Piaget, J. (1981). Intelligence and affectivity: Their relationship during child development. Annual Reviews Monograph. Palo Alto, CA: Annual Reviews.Google Scholar
  29. Pizarro, D. A., & Salovey, P. (2002). On being and becoming a good person: The role of emotional intelligence in moral development and behavior. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education (pp. 247–266). San Diego: Academic Press.CrossRefGoogle Scholar
  30. Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale, NJ: Erlbaum.Google Scholar
  31. Reffel, J. (1997). Cued vs. free recall in long-term memory of the fifty United States. Current Psychology, 16(3), 308–315. doi: 10.1007/s12144-997-1004-1.CrossRefGoogle Scholar
  32. Sadoski, M., Goetz, E. T., & Rodriguez, M. (2000). Engaging texts: Effects of concreteness on comprehensibility, interest, and recall in four text types. Journal of Educational Psychology, 92, 85–95.CrossRefGoogle Scholar
  33. Sinatra, G. M., Linnenbrink-Garcia, L., Pugh, K. J., Hofer, B., DeLisi, A., Lan, C. F., Broughton, S. H., Muis, K. R., Franco, G., Kendeou, P., & Behrens, S. F. (2009). Controversial conceptual change: The role of emotions, interest and epistemic beliefs. Symposium presented at the American Educational Research Conference, San Diego, CA.Google Scholar
  34. Strauss, A., & Corbin, J. (1990). Basics of qualitative research: Grounded theory procedures and techniques. Thousand Oaks, CA: Sage Publications.Google Scholar
  35. Sweller, J., & Chandler, P. (1994). Why some material is difficult to learn. Cognition and Instruction, 12(3), 185–233.CrossRefGoogle Scholar
  36. UNAIDS: Joint United Nations Programme on HIV/AIDS. (2008). Report on the global AIDS epidemic. Retrieved April 22, 2009 from the UNAIDS Web site:

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Aman Yadav
    • 1
    Email author
  • Michael M. Phillips
    • 2
  • Mary A. Lundeberg
    • 3
  • Matthew J. Koehler
    • 3
  • Katherine Hilden
    • 4
  • Kathryn H. Dirkin
    • 5
  1. 1.Department of Educational StudiesPurdue UniversityWest LafayetteUSA
  2. 2.School of Psychological SciencesUniversity of Northern ColoradoGreeleyUSA
  3. 3.Educational Psychology and Educational TechnologyMichigan State UniversityEast LansingUSA
  4. 4.School of Teacher Education & LeadershipRadford UniversityRadfordUSA
  5. 5.Department of Teacher Education & Professional DevelopmentCentral Michigan UniversityMount PleasantUSA

Personalised recommendations