Students assessing their own collaborative knowledge building

  • Eddy Y. C. Lee
  • Carol K. K. Chan
  • Jan van Aalst
Article

Abstract

We describe the design of a knowledge-building environment and examine the role of knowledge-building portfolios in characterizing and scaffolding collaborative inquiry. Our goal is to examine collaborative knowledge building in the context of exploring the alignment of learning, collaboration, and assessment in computer forums. The key design principle involved turning over epistemic agency to students; guided by several knowledge-building principles, they were asked to identify clusters of computer notes that indicated knowledge-building episodes in the computer discourse. Three classes of 9th grade students in Hong Kong used Knowledge Forum in several conditions: Knowledge Forum only, Knowledge Forum with portfolios, and Knowledge Forum with portfolios and principles. Results showed: (1) Students working on portfolios guided knowledge-building principles showed deeper inquiry and more conceptual understanding than their counterpart (2) Students' knowledge-building discourse, reflected in portfolio scores, contributed to their domain understanding; and (3) Knowledge-building portfolios helped to assess and foster collective knowledge advances: A portfolio with multiple contributions from students is a group accomplishment that captures the distributed and progressive nature of knowledge building. Students extended their collective understanding by analyzing the discourse, and the portfolio scaffolded the complex interactions between individual and collective knowledge advancements.

Keywords

Knowledge building Assessment Portfolios Collaborative inquiry Asynchronous networked environment 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barron, B. J. S., Schwartz, D. L., Vye, N. J., Moore, A., Petrosino, A., Zech, L., Bransford, J. D., & The Cognition and Technology Group at Vanderbilt (1998). Doing with understanding: Lessons from research on problem and project-based learning. Journal of the Learning Sciences, 7, 271–311.Google Scholar
  2. Bereiter, C. (2002). Education and mind in the knowledge age. Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
  3. Bereiter, C. & Scardamalia, M. (1993). Surpassing ourselves: An inquiry into the nature and implications of expertise. Chicago: Open Court.Google Scholar
  4. Bereiter, C. & Scardamalia, M. (1989). International Learning as a goal of instruction. In L.B. Resnick (Ed.) Knowing, learning and instruction. Essays in honor of Robert Glaser (pp. 361–392). Hillsdale, NJ: Zilbaun.Google Scholar
  5. Black, P. & Dylan, D. (1998). Assessment and classroom learning. Assessment in Educational Principles, Policy and Practice, 5, 7–74.Google Scholar
  6. Bransford, J. D., Brown, A. L. & Cocking, R. R. (1999). How people learn: Brain, mind, experience and school. Washington, DC: National Research Council.Google Scholar
  7. Brown, A. L. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions. Journal of the Learning Sciences, 2, 141–178.CrossRefGoogle Scholar
  8. Brown, A. L. & Campione, J. C. (1994). Guided discovery in a community of learners. In K. McGilly (Ed.), Classroom lessons: Integrating cognitive theory and classroom practice (pp. 229–270). Cambridge, MA: Bradford Books, MIT Press.Google Scholar
  9. Brown, J. S., Collins, A. & Dugid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18, 32–42.CrossRefGoogle Scholar
  10. Burtis, J. (1998). Analytic Toolkit for Knowledge Forum. Centre for Applied Cognitive Science: The Ontario Institute for Studies in Education/University of Toronto.Google Scholar
  11. Chan, C. K. K. (2001). Peer collaboration and discourse patterns in processing incompatible information. Instructional Science, 29, 443–479.CrossRefGoogle Scholar
  12. Chan, C., Burtis, J. & Bereiter, C. (1997). Knowledge building as a mediator of conflict in conceptual change. Cognition and Instruction, 15, 1–40.CrossRefGoogle Scholar
  13. Chan, C. K. K. & van Aalst, J. (2003). Assessing and scaffolding knowledge building: Pedagogical knowledge building principles and electronic portfolios. In B. Wasson, S. Ludvigsen, & U. Hoppe (Eds.), Designing for change in networked learning environments. Proceedings of the International Conference on Computer Support for Collaborative Learning (pp. 21–30). Dordrecht, The Netherlands: Kluwer Academic Publishers.Google Scholar
  14. Chan, C. K. K. & van Aalst, J. (2004). Learning, assessment and collaboration in computer-supported environments. In J. W. Strijbos, P. A. Kirchner, & R. L. Martens (Eds.), What we know about CSCL and implementing it in higher education (pp. 87–112). Dordrecht, The Netherlands: Kluwer Academic Publishers.Google Scholar
  15. Chi, M. (1997). Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences, 6, 271–315.CrossRefGoogle Scholar
  16. Collins, A., Joseph, D. & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. Journal of the Learning Sciences, 13, 15–42.CrossRefGoogle Scholar
  17. Dillenbourg, P., Eurelings, A. & Hakkarainen, K. (Eds.) (2001). Proceedings of the First European Conference on Computer-Supported Collaborative Learning. Maastricht, The Netherlands: McLuhan Institute.Google Scholar
  18. Edelson, D. C., Pea, R. D. & Gomez, L. M. (1996). The collaboratory notebook: Support for collaboratory inquiry. Communications of the ACM, 39, 32–33.CrossRefGoogle Scholar
  19. Gipps, C. V. (2002). Sociocultural perspectives on assessment. In G. Wells & G. Claxton (Eds.), Learning for life in the 21st century (pp. 73–83). Oxford, UK: Blackwell.Google Scholar
  20. Guzdial, M. & Turns, J. (2000). Computer-supported collaborative learning in engineering: The challenge of scaling up assessment. In M. J. Jacobson & R. B. Kozma (Eds.), Innovations in science and mathematics education: Advances designs for technology in learning (pp. 227–257). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  21. Hakkarainen, K., Lipponen, L. & Järvelä, S. (2002). Epistemology of inquiry and computer-supported collaborative learning. In T. Koschmann, R. Hall, & N. Miyake (Eds.), CSCL2: Carrying forward the conversation (pp. 11–41). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  22. Hewitt, J. (2003). How habitual online practices affect the development of asynchronous discussion threads. Journal of Educational Computing Research, 28, 31–45.CrossRefGoogle Scholar
  23. Koschmann, T., Hall, R., & Miyake, N. (Eds.) (2002). CSCL 2: Carrying forward the conversation. Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  24. Kreijns, K., Kirschner, P. A. & Jochems, W. (2003). Identifying the pitfall for social interactions in computer-supported collaborative learning environments: A review of the research. Computers in Human Behavior, 19, 335–353.CrossRefGoogle Scholar
  25. Lave, J. & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Cambridge: Cambridge University Press.Google Scholar
  26. Lipponen, L., Rahikainen, M., Lallimo, J. & Hakkarainen, K. (2003). Patterns of participation and discourse in elementary students' computer-supported collaborative learning. Learning and Instruction, 13, 487–509.CrossRefGoogle Scholar
  27. Oshima, J., Scardamalia, M. & Bereiter, C. (1996). Collaborative learning processes associated with high and low conceptual progress. Instructional Science, 24, 125–155.CrossRefGoogle Scholar
  28. Paavola, S., Lipponen, L. & Hakkarainen, K. (2004). Models of innovative knowledge communities and the three metaphors of learning. Review of Educational Research, 74, 557–577.Google Scholar
  29. Palonen, T. & Hakkarainen, K. (2000). Patterns of interaction in computer-supported learning: A social network analysis. In B. Fishman & S. O'Connor-Divelbliss (Eds.), Proceedings of the Fourth International Conference of the Learning Sciences (pp. 334–339). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  30. Reeve, T. C. (2000). Alternative assessment approaches for online learning environments in higher education. Journal of Educational Computing Research, 23, 101–111.CrossRefGoogle Scholar
  31. Salomon, G. (Ed.) (1993). Distributed cognition: Psychological and educational considerations. Cambridge, UK: Cambridge University Press.Google Scholar
  32. Scardamalia, M. (2002). Collective cognitive responsibility for the advancement of knowledge. In B. Smith (Ed.), Liberal education in a knowledge society (pp. 67–98). Chicago: Open Court.Google Scholar
  33. Scardamalia, M. & Bereiter, C. (1994). Computer support for knowledge-building communities. The Journal of the Learning Sciences, 3, 265–283.CrossRefGoogle Scholar
  34. Scardamalia, M. & Bereiter, C. (2003). Knowledge Building. In Encyclopedia of education, Second edition. New York: Macmillan Reference. pp. 1370–1373.Google Scholar
  35. Scardamalia, M., Bereiter, C. & Lamon, M. (1994). The CSILE Project: Trying to bring the classroom into World 3. In K. McGilley (Ed.), Classroom lessons: Integrating cognitive theory and classroom practice (pp. 201–228). Cambridge: Cambridge University Press.Google Scholar
  36. Scardamalia, M., Bereiter, C., McLean, R. S., Swallow,J. & Woodruff, E. (1989). Computer-supported intentional learning environments. Journal of Educational Computing Research, 5, 51–68.Google Scholar
  37. Sfard, A. (1998). On two metaphors of learning and the dangers of choosing just one. Educational Researcher, 27, 4–13.CrossRefGoogle Scholar
  38. Shepard, L. (2000). The role of assessment in a learning culture. Educational Researcher, 29, 1–14.CrossRefGoogle Scholar
  39. Stahl, G. (Ed.) (2002). Computer support for collaborative learning: Foundations for a CSCL community. Proceedings of CSCL 2002. Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  40. Stahl, G. (2004). Building collaborative knowing. In P. W. Strijbos, P. A. Kirschner, & R. L. Martens (Eds.), What we know about CSCL and implementing it in higher education (pp. 53–85). Dordrecht, the Netherlands: Kluwer Academic Publishing.Google Scholar
  41. van Aalst, J. (2006). Rethinking the nature of online work in asynchronous learning networks. British Journal of Educational Technology.Google Scholar
  42. van Aalst, J. & Chan, C. K. K. (2001). Beyond “sitting next to each other”: A design experiment on knowledge building in teacher education. In P. Dillenbourg, A. Eurelings, & K. Hakkarainen (Eds.), European perspectives on computer-supported collaborative learning: Proceedings of the First European Conference on Computer-Supported Collaborative Learning (pp. 20–28), Maastricht, The Netherlands: University of Maastricht.Google Scholar
  43. van Aalst, J. & Chan, C. K. K. (in press). Student-directed assessment of knowledge building through electronic portfolio. The Journal of the Learning Sciences.Google Scholar
  44. Vye, N. J., Schwartz, D. L., Bransford, J. D., Barron, B. J., Zech, L. & The Cognition and Technology Group at Vanderbilt (1998). SMART environment that support monitoring, reflection and revision. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 305–346). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
  45. White, B. Y., Shimoda, T. A. & Fredericksen, J. R. (1999). Enabling students to construct theories of collaborative inquiry and reflective learning: Computer support for metacognitive development. International Journal of Artificial Intelligence in Education, 10, 151–182.Google Scholar
  46. Wolf, D., Bixby, J., Glenn, J. & Gardner, H. (1991). To use their minds well: Investigating new forms of student assessment. Review of Research in Education, 17, 31–74.CrossRefGoogle Scholar

Copyright information

© International Society of the Learning Sciences, Inc., Springer Science + Business Media, Inc. 2006

Authors and Affiliations

  • Eddy Y. C. Lee
    • 1
  • Carol K. K. Chan
    • 1
  • Jan van Aalst
    • 2
  1. 1.Faculty of EducationThe University of Hong KongPokfulamHong Kong
  2. 2.Faculty of EducationSimon Fraser UniversityBurnabyCanada

Personalised recommendations