Skip to main content

Designing Learning Experiences to Encourage Development of Critical Thinking Skills

  • Conference paper
  • First Online:
Adaptive Instructional Systems. Design and Evaluation (HCII 2021)

Abstract

Today, various actors are exploiting and misusing online social media to spread disinformation and to create false narratives. This paper summarizes an education and training approach targeted to help people think more critically about potential disinformation. The approach we outline emphasizes the development and maturation of general critical-thinking skills, in contrast to technical skills (e.g., social network analysis). However, it also offers opportunity to apply these skills in a scaffolded, adaptive environment that supports the learner in putting concepts into use. The approach draws on the situated-learning paradigm to support skill development and reflects empirically-based best practices for pedagogy for critical thinking. This analysis and review provides context to inform the design of a learning environment to enable targeted practice of critical thinking skills. The paper outlines the high-level design, describes several specific “experiential lessons” and overviews a few technical challenges that remain to be overcome to make the training feasible for wide-scale use.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Singer, P.W., Brooking, E.T.: LikeWar: The Weaponization of Social Media. Eamon Dolan Books (2018)

    Google Scholar 

  2. Phillips-Wren, G., Power, D.J., Mora, M.: Cognitive bias, decision styles, and risk attitudes in decision making and DSS. J. Decis. Syst. 28, 63–66 (2019)

    Article  Google Scholar 

  3. Saab, F., Elhajj, I.H., Kayssi, A., Chehab, A.: Modelling cognitive bias in crowdsourcing systems. Cogn. Syst. Res. 58, 1–18 (2019)

    Article  Google Scholar 

  4. Tetlock, P.E., Gardner, D.: Superforecasting: The Art and Science of Prediction. Crown Publishers, New York (2015)

    Google Scholar 

  5. Fay, R.G., Montague, N.R.: Witnessing your own cognitive bias: a compendium of classroom exercises. Issues Account. Educ. 30, 13–34 (2014)

    Article  Google Scholar 

  6. Dunbar, N.E., et al.: Implicit and explicit training in the mitigation of cognitive bias through the use of a serious game. Comput. Hum. Behav. 37, 307–318 (2014)

    Article  Google Scholar 

  7. Sellier, A.-L., Scopelliti, I., Morewedge, C.K.: Debiasing training improves decision making in the field. Psychol. Sci. 30, 1371–1379 (2019)

    Article  Google Scholar 

  8. Greifeneder, R., Jaffé, M.E., Newman, E.J., Schwarz, N. (eds.): The Psychology of Fake News: Accepting, Sharing, and Correcting Misinformation. Routledge, Milton Park (2020)

    Google Scholar 

  9. Marín-López, I., Zych, I., Monks, C.P., Ortega-Ruiz, R.: Empathy, morality and social and emotional competencies in interpersonal interactions online. In: Coetzee, M. (ed.) Thriving in Digital Workspaces, pp. 217–233. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-24463-7_11

    Chapter  Google Scholar 

  10. Beskow, D.M., Carley, K.M.: Bot-hunter: A Tiered Approach to Detecting & Characterizing Automated Activity on Twitter. SBP-BRiMS (2018)

    Google Scholar 

  11. Kahneman, D.: Thinking, Fast and Slow. Doubleday, New York (2011)

    Google Scholar 

  12. Tversky, A., Kahneman, D.: Judgment under uncertainty: hueristics and biases. Science 185, 1124–1131 (1981)

    Article  Google Scholar 

  13. Nickerson, R.S.: Confirmation bias: a ubiquitous phenomenon in many guises. Rev. Gen. Psychol. 2, 175–220 (1998)

    Article  Google Scholar 

  14. Haselton, M.G., Nettle, D., Andrews, P.W.: The evolution of cognitive bias. In: Buss, D. (ed.) The Handbook of Evolutionary Psychology. Wiley, Hoboken (2005)

    Google Scholar 

  15. Dwyer, C.P.: Critical Thinking: Conceptual Perspectives and Practical Guidelines. Cambridge University Press/Sheridan Books, Cambridge (2017)

    Book  Google Scholar 

  16. Dwyer, C.P., Hogan, M.J., Stewart, I.: An integrated critical thinking framework for the 21st century. Think. Skills Creativity 12, 43–52 (2014)

    Article  Google Scholar 

  17. Adams, J.A.: Part trainers. In: Finch, G. (ed.) Educational and Training Media: A Symposium. National Academy of the Sciences, Washington, D.C. (1960)

    Google Scholar 

  18. Hitchcock, D.: The effectiveness of computer-assisted instruction in critical thinking. Informal Logic 24, 183–218 (2004)

    Article  Google Scholar 

  19. Astleitner, H.: Teaching critical thinking online. J. Instr. Psychol. 29, 53–76 (2002)

    Google Scholar 

  20. Pea, R.D.: The social and technological dimensions of scaffolding and related theoretical concepts for learning, education, and human activity. J. Learn. Sci. 13, 423–451 (2004)

    Article  Google Scholar 

  21. Wray, R.E., Woods, A., Priest, H.A.: Applying Gaming Principles to Support Evidence-based Instructional Design. In: I/ITSEC 2012, Orlando (2012)

    Google Scholar 

  22. Schatz, S., Wray, R., Folsom-Kovarik, J.T., Nicholson, D.: Adaptive perceptual training in a virtual environment. In: Human Factors and Ergonomic Systems (HFES-2012), Boston (2012)

    Google Scholar 

  23. Wray, R.E., Lane, H.C., Stensrud, B., Core, M., Hamel, L., Forbell, E.: Pedagogical experience manipulation for cultural learning. In: Workshop on Culturally-Aware Tutoring Systems at the AI in Education Conference Brighton, England (2009)

    Google Scholar 

  24. Folsom-Kovarik, J.T., Wray, R.E., Hamel, L.: Adaptive assessment in an instructor-mediated system. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 571–574. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_61

    Chapter  Google Scholar 

  25. Gress, A., Folsom-Kovarik, J.T., Davidson, I.: Transfer learning in intelligent tutoring systems: results, challenges, and new directions. In: FLAIRS 2017. AAAI Press (2017)

    Google Scholar 

  26. Folsom-Kovarik, J.T., Newton, C., Haley, J., Wray, R.E.: Modeling proficiency in a tailored, situated training environment. In: Behavior Representation in Modeling and Simulation (BRIMS) Conference, Washington, D.C. (2014)

    Google Scholar 

  27. Folsom-Kovarik, J.T., Woods, A., Wray, R.E.: Designing an authorable scenario representation for instructor control over computationally tailored narrative in training. In: Proceedings of the 29th International FLAIRS Conference. AAAI Press, Key Largo (2016)

    Google Scholar 

  28. Wray, R.E., Woods, A., Haley, J., Folsom-Kovarik, J.T.: Evaluating instructor configurability for adaptive training. In: Proceedings of the 7th International Conference on Applied Human Factors and Ergonomics, Orlando (AHFE 2016). Springer, Heidelberg (2016)

    Google Scholar 

  29. Facione, P.A.: The Delphi report: Committee on Pre-college Philosophy. California Academic Press, Millbrae (1990)

    Google Scholar 

  30. Vygotsky, L.S.: Mind and Society: The Development of Higher Psychological Processes. Harvard University Press, Cambridge (1978)

    Google Scholar 

  31. Durlach, P.J., Lesgold, A.M. (eds.): Adaptive Technologies for Training and Education. Cambridge, New York (2012)

    Google Scholar 

  32. Wray, R.E., Woods, A.: A cognitive systems approach to tailoring learner practice. In: Proceedings of the 2013 Advances in Cognitive Systems Conference, Baltimore, MD (2013)

    Google Scholar 

  33. Wray, R.E., Bridgman, R., Haley, J., Hamel, L., Woods, A.: Event-based keyframing: transforming observation data into compact and meaningful form. In: Proceedings of the 22nd International Conference on Artificial Intelligence, Las Vegas. Springer, Cham (2020)

    Google Scholar 

  34. Wearne, A., Wray, R.E.: Exploration of behavioral markers to support adaptive learning. In: Kurosu, M. (ed.) HCI 2018. LNCS, vol. 10903, pp. 355–365. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-91250-9_28

    Chapter  Google Scholar 

  35. Stowers, K., Brady, L., Huh, Y., Wray, R.E.: Assessing the role of behavioral markers in adaptive learning for emergency medical services. In: Nazir, S., Teperi, A.-M., Polak-Sopińska, A. (eds.) AHFE 2018. AISC, vol. 785, pp. 184–193. Springer, Cham (2019). https://doi.org/10.1007/978-3-319-93882-0_19

    Chapter  Google Scholar 

  36. Hehman, E., Stolier, R.M., Freeman, J.B.: Advanced mouse-tracking analytic techniques for enhancing psychological science. Group Process. Intergroup Relat. 18, 384–401 (2015)

    Article  Google Scholar 

  37. Microsoft. https://www.microsoft.com/en-us/research/blog/turing-nlg-a-17-billion-parameter-language-model-by-microsoft/

  38. Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., Sutskever, I.: Language Models are Unsupervised Multitask Learners. Open AI (2019)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Office of Naval Research via contracts N68335-18-C-0724, N68335-20-C-0085, and N68335-20-C0952. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the Department of Defense or Office of Naval Research. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert Wray .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Massey, L., Smith, R., Whitaker, E.T., Wray, R. (2021). Designing Learning Experiences to Encourage Development of Critical Thinking Skills. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Design and Evaluation. HCII 2021. Lecture Notes in Computer Science(), vol 12792. Springer, Cham. https://doi.org/10.1007/978-3-030-77857-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77857-6_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77856-9

  • Online ISBN: 978-3-030-77857-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics