Skip to main content

Designs for Learning Analytics to Support Information Problem Solving

  • Chapter
  • First Online:
Informational Environments

Abstract

Learners working on major learning projects, such as an undergraduate thesis, frequently engage in information problem solving (IPS). In round-trip IPS, learners set goals and develop a work plan, search for and filter sources, critically analyze and mine key information, and draft and revise a final product. Information problem solving is a prime site for self-regulated learning (SRL) whereby learners formulate and carry out self-designed experiments to improve IPS skills and expand knowledge about the topic of the learning project. We describe nStudy, a software system developed to gather ambient trace data that operationally define features of IPS and SRL as learners work on learning projects. We illustrate how trace data can be used to promote learners’ (a) understanding of the topic of a learning project and (b) development of IPS by generating learning analytics, guidance in the form of quantitative and qualitative accounts describing information learners work with and operations they apply to information. Three main challenges are addressed: learning how to plan a learning project, expanding knowledge of the topic of a learning project, and benefiting from and productively contributing to peer reviews of draft products. We conjecture about an emerging ecology for IPS in which big data and learning analytics can be major resources for education.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • 25 learning principles to guide pedagogy and the design of learning environments. (n.d.) Retrieved December 5, 2016, from https://legacy.wlu.ca/documents/60931/25-learning-principles-to-guide-pedagogy_(1).pdf

  • Alvermann, D. E. (1981). The compensatory effect of graphic organizers on descriptive text. Journal of Educational Research, 75(1), 44–48.

    Article  Google Scholar 

  • Anderman, E. M., & Wolters, C. A. (2006). Goals, values, and affect: Influences on student motivation. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology. Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Bandura, A. (1997). Self-efficacy: The exercise of control. New York, NY: Freeman.

    Google Scholar 

  • Bangert-Drowns, R. L., Kulik, C. L. C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61(2), 213–238.

    Article  Google Scholar 

  • Bascones, J., & Novak, J. D. (1985). Alternative instructional systems and the development of problem solving skills in physics. European Journal of Science Education, 7(3), 253–261.

    Article  Google Scholar 

  • Baumann, J. F., & Bergeron, B. S. (1993). Story map instruction using children’s literature: Effects on first graders’ comprehension of central narrative elements. Journal of Reading Behavior, 25(4), 407–437.

    Article  Google Scholar 

  • Beauvais, C., Olive, T., & Passerault, J.-M. (2011). Why are some texts good and others not? Relationship between text quality and management of the writing processes. Journal of Educational Psychology, 103(2), 415–428.

    Article  Google Scholar 

  • Bisra, K., Liu, Q., Salimi, F., Nesbit, J. C., & Winne, P. H. (2017). Inducing self-explanation: A meta-analysis. Manuscript submitted for publication.

    Google Scholar 

  • Boekaerts, P. P., Pintrich, P. R., & Zeidner, M. (2000). Handbook of self-regulation. San Diego, CA: Academic.

    Google Scholar 

  • Brand-Gruwel, S., Wopereis, I., & Walraven, A. (2009). A descriptive model of information problem solving while using internet. Computers & Education, 53(4), 1207–1217. https://doi.org/10.1016/j.compedu.2009.06.004

    Article  Google Scholar 

  • Bransford, J. D., & Schwartz, D. L. (1999). Rethinking transfer: A simple proposal with multiple implications. Review of Research in Education, 24(1), 61–100.

    Article  Google Scholar 

  • Buehler, R., Griffin, D. W., & Ross, M. (1994). Exploring the “planning fallacy”: Why people underestimate their task completion times. Journal of Personality and Social Psychology, 67, 366–381.

    Article  Google Scholar 

  • Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281.

    Article  Google Scholar 

  • Cerdán, R., & Vidal-Abarca, E. (2008). The effects of tasks on integrating information from multiple documents. Journal of Educational Psychology, 100(1), 209–222.

    Article  Google Scholar 

  • Chi, M. T. (2009). Active-constructive-interactive: A conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1(1), 73–105.

    Article  PubMed  Google Scholar 

  • Cho, Y. H., & Cho, K. (2011). Peer reviewers learn from giving comments. Instructional Science, 39, 629–643.

    Article  Google Scholar 

  • Cromley, J. G., Snyder-Hogan, L. E., & Luciw-Dubas, U. A. (2010). Reading comprehension of scientific text: A domain-specific test of the direct and inferential mediation model of reading comprehension. Journal of Educational Psychology, 102(3), 687–700.

    Article  Google Scholar 

  • Cronin, H., Sinatra, R. C., & Barkley, W. (1992). Combining writing with text organization in content instruction. National Association of Secondary School Principals (NASSP) Bulletin, 76, 34–45.

    Google Scholar 

  • Crossman, J. M., & Kite, S. L. (2012). Facilitating improved writing among students through directed peer review. Active Learning in Higher Education, 13(3), 219–229.

    Article  Google Scholar 

  • Dehmer, M., & Emmert-Streib, F. (Eds.). (2009). Analysis of complex networks: From biology to linguistics. Weinheim, Germany: Wiley-VCH.

    Google Scholar 

  • Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58.

    Article  PubMed  Google Scholar 

  • Eisenberg, M. B. (2008). Information literacy: Essential skills for the information age. DESIDOC Journal of Library & Information Technology, 28(2), 39.

    Article  Google Scholar 

  • Ferris, D. R. (2002). Treatment of error in second language writing classes. Ann Arbor, MI: University of Michigan Press.

    Google Scholar 

  • Foster, N. L., Was, C. A., Dunlosky, J., & Isaacson, R. M. (2016). Even after thirteen class exams, students are still overconfident: The role of memory for past exam performance in student predictions. Metacognition Learning, 12(1), 1–19. https://doi.org/10.1007/s11409-016-9158-6

    Article  Google Scholar 

  • Goldfinch, J., & Hughes, M. (2007). Skills, learning styles and success of first-year undergraduates. Active Learning in Higher Education, 8(3), 259–273.

    Article  Google Scholar 

  • Gurlitt, J., & Renkl, A. (2008). Are high-coherent concept maps better for prior knowledge activation? Differential effects of concept mapping tasks on high school vs. University students. Journal of Computer Assisted Learning, 24(5), 407–419. https://doi.org/10.1111/j.1365-2729.2008.00277.x

    Article  Google Scholar 

  • Hacker, D. J., Keener, M. C., & Kircher, J. C. (2009). Writing is applied metacognition. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 154–172). New York, NY: Routledge.

    Google Scholar 

  • Haswell, R. H. (2000). Documenting improvement in college writing: A longitudinal approach. Written Communication, 17, 307–352.

    Article  Google Scholar 

  • Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.

    Article  Google Scholar 

  • Hopkins, D. J., & King, G. (2010). A method of automated nonparametric content analysis for social science. American Journal of Political Science, 54(1), 229–247.

    Article  Google Scholar 

  • Ives, B., & Hoy, C. (2003). Graphic organizers applied to higher-level secondary mathematics. Learning Disabilities Research & Practice, 18(1), 36–51.

    Article  Google Scholar 

  • Jacomy, M., Venturini, T., Heymann, S., & Bastian, M. (2014). ForceAtlas2, a continuous graph layout algorithm for handy network visualization designed for the Gephi software. PLoS ONE, 9(6), e98679. https://doi.org/10.1371/journal.pone.0098679

    Article  PubMed  PubMed Central  Google Scholar 

  • Johnson, D., & Steele, V. (1996). So many words, so little time: Helping college ESL learners acquire vocabulary-building strategies. Journal of Adolescent & Adult Literacy, 39(5), 348–357.

    Google Scholar 

  • Kahneman, D., & Tversky, A. (1979). Intuitive prediction: Biases and corrective procedures. TIMS Studies in. Management Science, 12, 313–327.

    Google Scholar 

  • Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284.

    Article  Google Scholar 

  • Kozma, R. B. (1991). Learning with media. Review of Educational Research, 61(2), 179–211.

    Article  Google Scholar 

  • Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self assessments. Journal of Personality and Social Psychology, 77, 1121–1134.

    Article  PubMed  Google Scholar 

  • Lee, H. S., & Anderson, J. R. (2013). Student learning: What has instruction got to do with it? Annual Review of Psychology, 64, 445–469.

    Article  PubMed  Google Scholar 

  • Lipnevich, A. A., & Smith, J. K. (2009). Effects of differential feedback on students’ examination performance. Journal of Experimental Psychology: Applied, 15(4), 319.

    PubMed  Google Scholar 

  • Lipson, M. (1995). The effect of semantic mapping instruction on prose comprehension of below‐level college readers. Literacy Research and Instruction, 34(4), 367–378.

    Google Scholar 

  • Locke, E. A., & Latham, G. P. (1990). Work motivation and satisfaction: Light at the end of the tunnel. Psychological Science, 1(4), 240–246.

    Article  Google Scholar 

  • Manning, C. D., Raghavan, P., & Schütze, H. (2008a). Scoring, term weighting and the vector space model. Introduction to Information Retrieval, 100, 2–4.

    Google Scholar 

  • Manning, C. D., Raghavan, P., & Schütze, H. (2008b). Language models for information retrieval. Introduction to Information Retrieval, 218–233.

    Google Scholar 

  • Marzouk, Z., Rakovic, M., Liaqat, A., Vytasek, J., Samadi, D., Stewart-Alonso, J., … Nesbit, J. C. (2016). What if learning analytics were based on learning science? Australasian Journal of Educational Technology, 32, 1–18.

    Google Scholar 

  • Mayer, R. E. (2001). Multimedia learning. NY: Cambridge University Press.

    Book  Google Scholar 

  • Nesbit, J. C., & Adesope, O. O. (2006). Learning with concept and knowledge maps: A meta-analysis. Review of Educational Research, 76(3), 413–448. https://doi.org/10.3102/00346543076003413

    Article  Google Scholar 

  • Ng, Z. Y., Tay, W. Y., & Cho, Y. H. (2015). Usefulness of peer comments for English language writing through web-based peer assessment. In G. Chen, V. Kumar, H. R. Kinshuk, & S. Kong (Eds.), Emerging issues in smart learning. Lecture notes in educational technology. Berlin, Germany: Springer.

    Google Scholar 

  • Novak, J. D. (1990). Concept mapping: A useful tool for science education. Journal of Research in Science Teaching, 27(10), 937–949.

    Article  Google Scholar 

  • Novak, J. D. (1991). Clarify with concept maps: A tool for students and teachers alike. The Science Teacher, 58, 45–49.

    Google Scholar 

  • Novak, J. D. (1998). Learning, creating, and using knowledge. Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Novak, J. D., & Wandersee, J. (1991) (Eds.) Special issue on concept mapping. Journal of Research in Science Teaching, 28, 10.

    Google Scholar 

  • Ojima, M. (2006). Concept mapping as pre-task planning: A case study of three Japanese ESL writers. System, 34(4), 566–585.

    Article  Google Scholar 

  • Patterson, E. W. (2001). Structuring the composition process in scientific writing. International Journal of Scientific Education, 23, 1–16.

    Article  Google Scholar 

  • Patzak, A., & Winne, P. H. (2016). Using research on decision making to account for why and how students self-handicap. Unpublished manuscript.

    Google Scholar 

  • Pieronek, F. (1994). Using maps to teach note taking and outlining for report writing. The Social Studies, 85, 165–169.

    Article  Google Scholar 

  • Piolat, A., Roussey, J.-Y., Olive, T., & Amada, M. (2004). Processing time and cognitive effort in revision: Effects of error type and of working memory capacity. In L. Allai, L. Chanquoy, & P. Largy (Eds.), Revision cognitive and instructional processes (pp. 21–38). Boston, MA: Kluwer Academic Publishers.

    Chapter  Google Scholar 

  • Reynolds, S. B., & Hart, J. (1990). Cognitive mapping and word processing: Aids to story revision. Journal of Experimental Education, 58, 273–279.

    Article  Google Scholar 

  • Roediger, H. L., & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15, 20–27.

    Article  PubMed  Google Scholar 

  • Roll, I., & Winne, P. H. (2015). Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics, 2(1), 7–12.

    Article  Google Scholar 

  • Roth, W. M. (1994). Student views of collaborative concept mapping: An emancipatory research project. Science Education, 78(1), 1–34.

    Article  Google Scholar 

  • Saddler, B., Moran, S., Graham, S., & Harris, K. R. (2004). Preventing writing difficulties: The effects of planning strategy instruction on the writing performance of struggling writers. Exceptionality, 12(1), 3–17.

    Article  Google Scholar 

  • Schultz, M. (1991). Mapping and cognitive development in the teaching of foreign language writing. The French Review, 64, 978–988.

    Google Scholar 

  • Schunk, D. H. (1995). Self-efficacy and education and instruction. In J. E. Maddux (Ed.), Self-efficacy, adaptation, and adjustment: Theory, research, and application. New York, NY: Plenum Press.

    Google Scholar 

  • Schunk, D. H. (2001). Self-regulation through goal setting. In ERIC/CASS Digest. Washington, DC. Retrieved from www.eric.ed.gov. ED462671.

  • Schwarz, N. (2002). Emotion, cognition, and decision making. Cognition and Emotion, 4, 433–440.

    Google Scholar 

  • Schworm, S., & Renkl, A. (2006). Computer-supported example-based learning: When instructional explanations reduce self-explanations. Computers and Education, 46(4), 426–445.

    Article  Google Scholar 

  • Trumpower, D. L., & Sarwar, G. S. (2010). Effectiveness of structural feedback provided by Pathfinder networks. Journal of Educational Computing Research, 43(1), 7–24.

    Article  Google Scholar 

  • Washington, V. M. (1988). Report writing: A practical application of semantic mapping. Teacher Educator, 24, 24–30.

    Article  Google Scholar 

  • Whittaker, R., Llinares, A., & McCabe, A. (2011). Written discourse development in CLIL at secondary school. Language Teaching Research, 15(3), 343–362.

    Article  Google Scholar 

  • Winn, W. (1991). Learning from maps and diagrams. Educational Psychology Review, 3(3), 211–247.

    Article  Google Scholar 

  • Winne, P. H. (2001). Self-regulated learning viewed from models of information processing. In B. Zimmerman & D. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 153–189). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Winne, P. H. (2013). Teaching and researching open-minded inquiry in the 21st century. In J. View, D. Laitsch, & P. Earley (Eds.), Why public schools? Voices from the United States and Canada (pp. 166–170). Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Winne, P. H. (2017a). Cognition and metacognition in self-regulated learning. In D. Schunk & J. Greene (Eds.), Handbook of self-regulation of learning and performance (2nd ed.). New York, NY: Routledge.

    Google Scholar 

  • Winne, P. H. (2017b). Learning analytics for self-regulated learning. In G. Siemens & C. Lang (Eds.), Handbook of learning analytics. Beaumont, AB: Society for Learning Analytics Research.

    Google Scholar 

  • Winne, P. H. (2017c). Leveraging big data to help each learner upgrade learning and accelerate learning science. Teachers College Record, 119(3), 1–24.

    Google Scholar 

  • Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277–304). Mahwah, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Wyatt, D., Pressley, M., El-Dinary, P. B., Stein, S., Evans, P., & Brown, R. (1993). Comprehension strategies, worth and credibility monitoring, and evaluations: Cold and hot cognition when experts read professional articles that are important to them. Learning and Individual Differences, 5(1), 49–72.

    Article  Google Scholar 

  • Zimmerman, B. J., Bonner, S., & Kovach, R. (1996). Developing self-regulated learners: Beyond achievement to self-efficacy. Washington, DC: American Psychological Association.

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Philip H. Winne .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Winne, P.H. et al. (2017). Designs for Learning Analytics to Support Information Problem Solving. In: Buder, J., Hesse, F. (eds) Informational Environments . Springer, Cham. https://doi.org/10.1007/978-3-319-64274-1_11

Download citation

Publish with us

Policies and ethics