Abstract
We present an empirical investigation of a classroom training fostering vocational students’ consideration of source information when deciding about science-based controversies. The training was specifically aimed at raising students’ awareness of the division of cognitive labor and the resulting need to take a source’s competence into account when deciding whom to trust. Data were collected from a training group and a waiting list control group in a pretest–posttest design. The results show that students benefitted from the training in terms of their inclination to agree with pertinent expert sources rather than low-pertinent experts and to refer to the source of information to justify their judgment. Source memory was not affected by the training.
Similar content being viewed by others
Notes
The source memory test consisted of only four items, since an increase of the number of items would have required students to read an equivalent number of controversies. This in turn might have negatively affected students’ attention and motivation towards the end of the test phase.
References
Amstad, T. (1978). Wie verständlich sind unsere Zeitungen? [How understandable are our newspapers?] (Unpublished doctoral dissertation). University of Zürich, Switzerland.
Baker, L. (1989). Metacognition, comprehension monitoring, and the adult reader. Educational Psychology Review, 1, 3–38. doi:10.1007/BF01326548.
Bannert, M. (2003). Effekte metakognitiver Lernhilfen auf den Wissenserwerb in vernetzten Lernumgebungen [Effects of metacognitive learning aids in networked learning environments]. Zeitschrift für Pädagogische Psychologie, 17, 13–25. doi:10.1024//1010-0652.17.1.13.
Barzilai, S., & Eshet-Alkalai, Y. (2015). The role of epistemic perspectives in comprehension of multiple author viewpoints. Learning and Instruction, 36, 86–103. doi:10.1016/j.learninstruc.2014.12.003.
Bortz, J. (2004). Statistik für Human- und Sozialwissenschaftler (Vol. 6). Berlin: Springer.
Braasch, J. L. G., Bråten, I., Strømsø, H. I., Anmarkrud, Ø., & Ferguson, L. E. (2013). Promoting secondary school students’ evaluation of source features of multiple documents. Contemporary Educational Psychology, 38, 180–195. doi:10.1016/j.cedpsych.2013.03.003.
Braasch, J., Rouet, J.-F., Vibert, N., & Britt, M. (2012). Readers’ use of source information in text comprehension. Memory and Cognition, 40, 450–465. doi:10.3758/s13421-011-0160-6.
Britt, M. A., & Aglinskas, C. (2002). Improving student’s ability to identify and use source information. Cognition and Instruction, 20, 485–522. doi:10.1207/S1532690XCI2004_2.
Bromme, R., & Goldman, S. (2014). The public’s bounded understanding of science. Educational Psychologist, 49, 59–69. doi:10.1080/00461520.2014.921572.
Bromme, R., Kienhues, D., & Porsch, T. (2010). Who knows what and who can we believe? Epistemological beliefs are beliefs about knowledge (mostly) attained from others. In L. Bendixen & F. Feucht (Eds.), Personal epistemology in the classroom: Theory, research, and implications for practice (pp. 163–193). Cambridge: Cambridge University Press.
Bromme, R., & Thomm, E. (2015). Knowing who knows: Laypersons’ capabilities to judge experts’ pertinence for science topics. Cognitive Science. doi:10.1111/cogs.12252.
Brossard, D., & Scheufele, D. A. (2013). Science, New Media, and the Public. Science, 339(6115), 40–41. doi:10.1126/science.1232329.
Chinn, C., Rinehart, R. W., & Buckland, L. A. (2014). Epistemic cognition and evaluating information: Applying the AIR model of epistemic cognition. In D. N. Rapp & J. Braasch (Eds.), Processing inaccurate information. Theoretical and applied perspectives from cognitive science and the educational sciences (pp. 425–453). Massachusetts: MIT Press.
Colwell, J., Hunt-Barron, S., & Reinking, D. (2013). Obstacles to Developing Digital Literacy on the Internet in Middle School Science Instruction. Journal of Literacy Research, 45, 295–324. doi:10.1177/1086296x13493273.
Gerjets, P., Kammerer, Y., & Werner, B. (2011). Measuring spontaneous and instructed evaluation processes during Web search: Integrating concurrent thinking-aloud protocols and eye-tracking data. Learning and Instruction, 21, 220–231. doi:10.1016/j.learninstruc.2010.02.005.
Harris, P. L. (2012). Trusting what you’re told. Cambridge, MA: Belknap of Harvard UP.
Jaswal, V. K., & Malone, L. S. (2007). Turning Bbelievers into skeptics: 3-year-olds’ sensitivity to cues to speaker credibility. Journal of Cognition and Development, 8, 263–283. doi:10.1080/15248370701446392.
Kammerer, Y., Amann, D., & Gerjets, P. (2015). When adults without university education search the Internet for health information: The roles of Internet-specific epistemic beliefs and a source evaluation intervention. Computers in Human Behavior, 48, 297–309. doi:10.1016/j.chb.2015.01.045.
Kammerer, Y., & Gerjets, P. (2012). The impact of discrepancies across web pages on high-school students’ trustworthiness evaluations. In E. de Vries & K. Scheiter (Eds.), Staging knowledge and experience: How to take advantage of representational technologies in education and training? Proceedings of the EARLI SIG 2 Meeting (pp. 97–99). Grenoble, France, EARLI SIG 2.
Keil, F. C. (2010). The feasibility of folk science. Cognitive Science, 34, 826–862. doi:10.1111/j.1551-6709.2010.01108.x.
Keil, F. C. (2012). Running on empty? How folk science gets by with less. Current Directions in Psychological Science, 21, 329–334. doi:10.1177/0963721412453721.
Keil, F. C., Stein, C., Webb, L., Billings, V. D., & Rozenblit, L. (2008). Discerning the division of cognitive labor: An emerging understanding of how knowledge is clustered in other minds. Cognitive Science, 32, 259–300. doi:10.1080/03640210701863339.
Koenig, M. A., & Harris, P. L. (2005). Preschoolers mistrust ignorant and inaccurate speakers. Child Development, 76, 1261–1277. doi:10.1111/j.1467-8624.2005.00849.x.
Kuiper, E., Volman, M., & Terwel, J. (2009). Developing Web literacy in collaborative inquiry activities. Computers & Education, 52, 668–680. doi:10.1016/j.compedu.2008.11.010.
Leu, D. J., Coiro, J., Castek, J., Hartman, D. K., Henry, L. A., & Reinking, D. (2008). Research on instruction and assessment in the new literacies of online reading comprehension. In C. Collins Block, S. Parris &, P. Afflerbach (Eds.), Comprehension instruction: Research-based best practices (Vol. 2, pp. 321–346). New York: Guilford.
Leu, D. J., Forzani, E., Rhoads, C., Maykel, C., Kennedy, C., & Timbrell, N. (2015). The new literacies of online research and comprehension: Rethinking the reading achievement gap. Reading Research Quarterly, 50, 1–23. doi:10.1002/rrq.85.
Leu, D. J., & Kinzer, C. K. (2000). The convergence of literacy instruction and networked technologies for information and communication. Reading Research Quarterly, 35, 108–127. doi:10.1598/RRQ.35.1.8.
Leu, D. J., Zawilinski, L., Castek, J., Banerjee, M., Housand, B., Liu, Y., & O‘Neil, M. (2007). What is new about the new literacies of online reading comprehension? In L. Rush, J. Eakle, & A. Berger (Eds.), Secondary school literacy: What research reveals for classroom practices (pp. 37–68). Urbana, IL: National Council of Teachers of English.
Macedo-Rouet, M., Braasch, J., Britt, M. A., & Rouet, J.-F. (2013). Teaching fourth and fifth graders to evaluate information sources during text comprehension. Cognition and Instruction, 31, 204–226. doi:10.1080/07370008.2013.769995.
Maier, J., & Richter, T. (2013). Text-belief consistency effects in the comprehension of multiple texts with conflicting information. Cognition and Instruction, 31, 151–175. doi:10.1080/07370008.2013.769997.
Mason, L., Boldrin, A., & Ariasi, N. (2010a). Epistemic metacognition in context: Evaluating and learning online information. Metacognition and Learning, 5, 67–90. doi:10.1007/s11409-009-9048-2.
Mason, L., Boldrin, A., & Ariasi, N. (2010b). Searching the Web to learn about a controversial topic: Are students epistemically active?. Instructional Science, 38, 607–633. doi:10.1007/s11251-008-9089-y.
Mason, L., Junyent, A. A., & Tornatora, M. C. (2014). Epistemic evaluation and comprehension of web-source information on controversial science-related topics: Effects of a short-term instructional intervention. Computers & Education, 76, 143–157. doi:10.1016/j.compedu.2014.03.016.
Mayer, R. C., Davis, J. H., & Schoorman, F. D. (1995). An Integrative Model Of Organizational Trust. Academy of Management Review, 20, 709–734. doi:10.5465/amr.1995.9508080335.
McCrudden, M., & Schraw, G. (2007). Relevance and goal-focusing in text processing. Educational Psychology Review, 19, 113–139. doi:10.1007/s10648-006-9010-7.
Nokes, J. D., Dole, J. A., & Hacker, D. J. (2007). Teaching high school students to use heuristics while reading historical texts. Journal of Educational Psychology, 99, 492–504. doi:10.1037/0022-0663.99.3.492.
Otero, J. M., & Graesser, A. C. (2001). PREG: Elements of a model of question asking. Cognition and Instruction, 19, 143–175. doi:10.1207/S1532690XCI1902_01.
Perfetti, C. A., Rouet, J.-F., & Britt, M. A. (1999). Toward a theory of documents representation. In H. van Oostendorp & S. R. Goldman (Eds.), The construction of mental representations during reading (pp. 99–122). Mahwah, NJ: Lawrence Erlbaum Associates.
Porsch, T., & Bromme, R. (2010). Which science disciplines are pertinent? Impact of epistemological beliefs on students’ choices. Paper presented at the 9th International Conference of the Learning Sciences, Chicago, IL.
Rapp, D. N. (2008). How do readers handle incorrect information during reading? Memory and Cognition, 36, 688–701. doi:10.3758/MC.36.3.688.
Richter, T., Schroeder, S., & Wöhrmann, B. (2009). You don’t have to believe everything you read: Background knowledge permits fast and efficient validation of information. Journal of Personality and Social Psychology, 96, 538–558. doi:10.1037/a0014038.
Rouet, J. F., & Britt, M. A. (2011). Relevance processes in multiple document comprehension. In M. T. McCrudden, J. P. Magliano, & G. Schraw (Eds.), Text relevance and learning from text (pp. 19–52). Greenwich, CT: Information Age Publishing.
Schaffner, E. (2010). Effekte kognitiver und motivationaler Faktoren auf das Verstehen und Lernen von Texten [Effects of cognitive and motivational factors on the comprehension of texts]. Berlin: FU Berlin.
Scharrer, L., Stadtler, M., & Bromme, R. (2014). You’d better ask an expert: Mitigating the comprehensibility effect on laypeople’s decisions about science-based knowledge claims. Applied Cognitive Psychology, 28, 465–471. doi:10.1002/acp.3018.
Schneider, W., Schlagmüller, M., & Ennemoser, M. (2007). LGVT 6-12. Lesegeschwindigkeits-und Verständnistest für die Klassenstufen 6-12. Göttingen: Hogrefe.
Stadtler, M., & Bromme, R. (2008). Effects of the metacognitive tool met.a.ware on the web search of laypersons. Computers in Human Behavior, 24, 716–737. doi:10.1016/j.chb.2007.01.023.
Stadtler, M., & Bromme, R. (2014). The content–source integration model: A taxonomic description of how readers comprehend conflicting scientific information. In D. N. Rapp & J. L. G. Braasch (Eds.), Processing inaccurate information: Theoretical and applied perspectives from cognitive science and the educational sciences (pp. 379–402). Cambridge, MA: MIT Press.
Stadtler, M., Bromme, R., & Rouet, J.-F. (2014a). „Science meets reading“: Worin bestehen die Kompetenzen zum Lesen multipler Dokumente zu Wissenschaftsthemen und wie fördert man sie? [„Science meets reading“: What are the competencies of reading multiple documents on science topics and how to foster them?]. Unterrichtswissenschaft, 42, 55–68.
Stadtler, M., Scharrer, L., Brummernhenrich, B., & Bromme, R. (2013). Dealing with uncertainty: Readers’ memory for and use of conflicting information from science texts as function of presentation format and source expertise. Cognition and Instruction, 31, 130–150. doi:10.1080/07370008.2013.769996.
Stadtler, M., Scharrer, L., Skodzik, T., & Bromme, R. (2014b). Comprehending multiple documents on scientific controversies: Effects of reading goals and signaling rhetorical relationships. Discourse Processes, 51, 93–116. doi:10.1080/0163853X.2013.855535.
Statistisches Bundesamt. (2015). Bildung und Kultur. Berufliche Schulen. Schuljahr 2014/2015. https://www.destatis.de/DE/Publikationen/Thematisch/BildungForschungKultur/Schulen/BeruflicheSchulen.html.
Strømsø, H. I., Bråten, I., Britt, M. A., & Ferguson, L. (2013). Spontaneous sourcing among students reading multiple documents. Cognition and Instruction, 31, 176–203. doi:10.1080/07370008.2013.769994.
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive load theory. Explorations in the learning sciences, instructional systems and performance technologies. New York: Springer.
Thomm, E. & Bromme, R. (2015). Is the who the why of conflict? Examining laypeople’s sensitivity to source information when evaluating and explaining scientific conflicts (manuscript submitted for publication).
Walraven, A., Brand-Gruwel, S., & Boshuizen, H. P. A. (2009). How students evaluate information and sources when searching the World Wide Web for information. Computers & Education, 52, 234–246. doi:10.1016/j.compedu.2008.08.003.
Walraven, A., Brand-Gruwel, S., & Boshuizen, H. A. (2013). Fostering students’ evaluation behaviour while searching the internet. Instructional Science, 41, 125–146. doi:10.1007/s11251-012-9221-x.
Wiley, J., Goldman, S. R., Graesser, A. C., Sanchez, C. A., Ash, I. K., & Hemmerich, J. A. (2009). Source evaluation, comprehension, and learning in internet science inquiry tasks. American Educational Research Journal, 46, 1060–1106. doi:10.3102/0002831209333183.
Wineburg, S. S. (1991). Historical problem solving: A study of the cognitive processes used in the evaluation of documentary and pictorial evidence. Journal of Educational Psychology, 83, 73–87. doi:10.1037/0022-0663.83.1.73.
Acknowledgments
We are grateful to Annegret Hansch, Moritz Desinger, Jasmin Hettinger, Sonja Krettek, and Tobina Schubert for their help in implementing the training and data collection. We also thank the teachers of the participating school for their support. This research was supported by the Deutsche Forschungsgemeinschaft (DFG).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stadtler, M., Scharrer, L., Macedo-Rouet, M. et al. Improving vocational students’ consideration of source information when deciding about science controversies. Read Writ 29, 705–729 (2016). https://doi.org/10.1007/s11145-016-9623-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11145-016-9623-2