Advertisement

Participatory Assessment of 21st Century Proficiencies

  • Daniel T. Hickey
  • Michelle A. Honeyford
  • Katie A. Clinton
  • Jenna McWilliams
Chapter

Abstract

The explosion of new social network technologies has highlighted the awkward relationship between new “Twenty-first century” media practices and existing educational systems. Traditional content standards, achievement tests, and accountability pressures threaten nascent efforts to foster equitable, transparent, and credible participation in these practices. The current push to design external tests and standards to assess these new practices may actually exacerbate this problem, due to the fundamentally social nature of these proficiencies. Large-scale standardization and testing of aggregated achievement of these proficiencies should be done cautiously and in isolation from classroom-based efforts to foster worthwhile participation. Likewise, within classrooms, more interpretive efforts are first needed to define social contexts that foster worthwhile social participation in these practices before individual proficiency is assessed. To foster both participation and proficiency while also meeting existing and future accountability goals, a design-based participatory assessment framework with multiple levels of increasingly formal outcomes is introduced.

Keywords

Formative assessment Social media Twenty-first century skills 

Notes

Acknowledgements

This work was supported by the MacArthur Foundation’s Digital Media and Learning Initiative. We thank Jim Gee, Henry Jenkins, Erin Reilly, Anna van Someren, and Hilary Kolos for their contributions to the ideas, research, and curricula described in this chapter.

References

  1. Alvermann, D. E. (2002). Adolescents and literacies in a digital world. New York: Peter Lang Publishing, Inc.Google Scholar
  2. Anderson, J. R., Reder, L. M., & Simon, H. A. (1996). Situated learning and education. Educational Researcher, 25(4), 5–11.Google Scholar
  3. Baker, E. L. (2003). Multiple measures: Toward tiered systems. Educational Measurement: Issues and Practice, 22(2), 13–17.CrossRefGoogle Scholar
  4. Barab, S., Sadler, T., Heiselt, C., Hickey, D., & Zuiker, S. (2007b). Relating narrative, inquiry, and inscriptions: A framework for socioscientific inquiry. Journal of Science Education and Technology, 16, 59–82.CrossRefGoogle Scholar
  5. Barab, S., Zuiker, S., Warren, S., Hickey, D., Ingram-Goble, A., Kwon, E., et al. (2007a). Situationally embodied curriculum: Relating formalisms and contexts. Science Education, 91, 750–782.CrossRefGoogle Scholar
  6. Barton, D. (1994). Literacy: An introduction to the ecology of written language. Oxford: Blackwell.Google Scholar
  7. Beach, R., Anson, C., Breuch, L., & Swiss, T. (2008). Teaching writing using blogs, wikis, and other digital tools. Norwood, MA: Christopher-Gordon Publishers, Inc.Google Scholar
  8. Black, R. W. (2008). Adolescents and online fan fiction. New York: Peter Lang.Google Scholar
  9. Bowker, G. C., & Star, S. L. (1999). Sorting things out: Classification and its consequences. Cambridge, MA: MIT Press.Google Scholar
  10. boyd, d. (2008). Why teens ♥ MySpace: The role of digital publics in youth culture. In D. Buckingham (Ed.), Youth, identity and digital media (pp. 119–142). Cambridge, MA: MIT Press.Google Scholar
  11. boyd, d, & Ellison, N. B. (2007). Social network sites: Definition, history, and scholarship. Journal of Computer-Mediated Communication, 13, 210–230.CrossRefGoogle Scholar
  12. Brandt, D. (2005). Writing for a living: Literacy and the knowledge economy. Written Communication, 22(2), 166–197.CrossRefGoogle Scholar
  13. Brandt, D. (2009). Literacy and learning: Reflections on writing, reading, and society. Hoboken, NJ: Jossey-Bass.Google Scholar
  14. Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–20.CrossRefGoogle Scholar
  15. Coiro, J., Knobel, M., Lankshear, C., & Leu, D. J. (2008). Handbook of research on new literacies. New York: Routledge.Google Scholar
  16. Delandshere, G. (2002). Assessment as inquiry. Teachers College Record, 104(7), 1461–1484.CrossRefGoogle Scholar
  17. Drotner, K. (2007). Leisure is hard work: Digital practices and future competencies. In D. Buckingham (Ed.), Digital youth: Learning and identity. Cambridge, MA: MIT Press.Google Scholar
  18. Dysthe, O., Engelsen, K. S., & Lima, I. (2007). Variations in portfolio assessment in higher education: Discussion of quality issues based on a Norwegian survey across institutions and disciplines. Assessing Writing, 12(2), 129–148.CrossRefGoogle Scholar
  19. Erickson, F. (1996). Going for the zone: The social and cognitive ecology of teacher-student interaction in classroom conversations.In D. Hicks (Ed.), Discourse, learning and schooling. Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
  20. Frederiksen, J. R., & Collins, A. (1989). A systems approach to educational testing. Educational Researcher, 18(9), 27–32.Google Scholar
  21. Gee, J. P. (1989). Literacy, discourse, and linguistics: What is literacy. Journal of Education, 171(1), 5–25.Google Scholar
  22. Gee, J. P. (1996). Social linguistics and literacies: Ideology in discourses (2nd ed.). London: Taylor & Francis.Google Scholar
  23. Gee, J. P. (1999). An introduction to discourse analysis: Theory and method. New York: Routledge.Google Scholar
  24. Gee, J. P. (2004). Situated language and learning: A critique of traditional schooling. New York: Routledge.Google Scholar
  25. Gee, J. P. (2007). A 21st Century assessment project for situated and sociocultural approaches to learning. Proposal to the John D. and Catherine T. MacArthur Foundation.Google Scholar
  26. Ghezzi, P. (2006, March 3). Report: Georgia student tests are too easy. State works to revise standards for achievement. Atlanta Journal Constitution (A1).Google Scholar
  27. Goldman, S., Booker, A., & McDermott, M. (2007). Mixing the digital, social and cultural: Learning, identity and agency in youth participation. In D. Buckingham (Ed.), Digital youth: Learning and identity. Cambridge, MA: MIT Press.Google Scholar
  28. Gray, B. (2004). Informal learning in an online community of practice. Journal of Distance Education, 19(1), 20–35.Google Scholar
  29. Greeno, J. G. (1997). On claims that answer the wrong questions. Educational Researcher, 26(1), 5.Google Scholar
  30. Greeno, J. G. (1998). The situativity of knowing, learning, and research. American Psychologist, 53(1), 5–26.CrossRefGoogle Scholar
  31. Greeno, J. G., & Gresalfi, M. S. (2008). Opportunities to learn in practice and identity. In P. A. Moss, D. C. Pullin, J. P. Gee, E. H. Haertel, & L. J. Young (Eds.), Assessment, equity, and opportunity to learn, pp. 170–199. Cambridge, MA: Cambridge University Press.CrossRefGoogle Scholar
  32. Gresalfi, M., Barab, S., Siyahhan, S., & Christensen, T. (2009). Virtual worlds, conceptual understanding, and me: Designing for consequential engagement. On the Horizon, 17(1), 21–34.Google Scholar
  33. Habib, L., & Wittek, L. (2007). The portfolio as artifact and actor. Mind, Culture, and Activity, 14(4), 266–282.CrossRefGoogle Scholar
  34. Heath, S. B. (1983). Ways with words: Language, life, and work in communities and classrooms. Cambridge, UK: Cambridge University Press.Google Scholar
  35. Herrington, A., Hodgson, K., & Moran, C. (Eds.). (2009). Teaching the New Writing: Technology, Change, and Assessment in the 21st-Century Classroom. New York: Teachers College Press.Google Scholar
  36. Hickey, D. T., Ingram-Goble, A., & Jameson, E. (2009). Designing assessments and assessing designs in virtual educational environments. Journal of Science Education Technology, 30, 837–861.Google Scholar
  37. Hickey, D. T., Kindfield, A. C. H., Horwitz, P., & Christie, M. A. (2003). Integrating curriculum, instruction, assessment, and evaluation in a technology-supported genetics environment. American Educational Research Journal, 40(2), 495–538.CrossRefGoogle Scholar
  38. Hickey, D. T., Wolfe, E. W., & Kindfield, A. C. H. (2000). Assessing learning in a technology-supported genetics environment: Evidential and systemic validity issues. Educational Assessment, 6(3), 155–196.CrossRefGoogle Scholar
  39. Hickey, D. T., & Zuiker, S. J. (2005). Engaged participation: A sociocultural model of motivation with implications for assessment. Educational Assessment, 10, 277–305.CrossRefGoogle Scholar
  40. Hickey, D. T., Zuiker, S. J., Taasobshirazi, G., Schafer, N. J., & Michael, M. A. (2006). Three is the magic number: A design-based framework for balancing formative and summative functions of assessment. Studies in Educational Evaluation, 32, 180–201.CrossRefGoogle Scholar
  41. Hobbs, R., & Frost, R. (2003). Measuring the acquisition of media-literacy skills. Reading Research Quarterly, 38, 330–355.CrossRefGoogle Scholar
  42. Hull, G., & Nelson, M. E. (2005). Locating the semiotic power of multimodality. Written Communication, 22, 224–260.CrossRefGoogle Scholar
  43. Hutton, P. A. (2006). Understanding student cheating and what educators can do about it. College Teaching, 54(1), 171–176.CrossRefGoogle Scholar
  44. International Society for Technology in Education. (2007). The ISTE National Educational Technology Standards (NETS-S) and performance indicators for students. Eugene, OR: Author.Google Scholar
  45. Ito, M. (2008). Hanging out, messing around and geeking out: Living and learning with new media. Cambridge, MA: MIT Press.Google Scholar
  46. Ito, M., Bittanti, M., boyd, d, Herr-Stephenson, B., Lange, P. G., & Robinson, L. (2008). Living and learning with new media: Summary of findings from the digital youth project. The John D. and Catherine T. MacArthur Foundation Reports on Digital Media and Learning.Google Scholar
  47. James, C. (2008). Young people, ethics, and the new digital media: A synthesis from the Good Play project. Boston, MA: Harvard University.Google Scholar
  48. Jenkins, H. (2006). Convergence culture: Where old and new media collide. New York: New York University Press.Google Scholar
  49. Jenkins, H., Purushotma, R., Clinton, K., Weigel, M., & Robison, A. J. (2006). Confronting the challenges of participatory culture: Media education for the 21st century. Chicago: The MacArthur Foundation.Google Scholar
  50. Kirst, M. W., & Mazzeo, C. (1996). The rise, fall, and rise of state assessment in California: 1993–96. Phi Delta Kappan, 78(4), 319–323.Google Scholar
  51. Lam, W. (2006). Culture and learning in the context of globalization; Research directions. Review of Research in Education, 30, 213–237.CrossRefGoogle Scholar
  52. Lancaster, T., & Clarke, R. (2008). How to succeed at cheating without really trying: Five top tips for successful cheating. In H. White (Ed.), 9th Annual Conference of the Subject Centre for Information and Computer Sciences, pp. 121–125. Liverpool: University of Ulster.Google Scholar
  53. Laucius, J. (2009, April 8). ‘Wikipedia kids’ ill prepared for universities, professors say. The Ottowa Citizen.Google Scholar
  54. Lemke, J. L. (2000). Across the scales of time: Artifacts, activities, and meanings in ecosocial systems. Mind, Culture, and Activity, 7(4), 273–290.CrossRefGoogle Scholar
  55. Leu, D. J., O’Bryne, I., Zawilinski, J., McVerry, J. G., & Everett-Cacopardo, H. (2009). Expanding the new literacies conversation. Educational Researcher, 38(4), 264–269.CrossRefGoogle Scholar
  56. Lievrouw, L., & Livingstone, S. (Eds.). (2006). Handbook of new media: Social shaping and social consequences. London: Sage.Google Scholar
  57. Lisbon Council. (2007). Skills for the future. Brussels: Lisbon Council.Google Scholar
  58. Messick, S. (1994). The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher, 23(2), 13–23.Google Scholar
  59. Metzger, E., & Flanagin, A. (Eds.). (2008). Digital media, youth, and credibility. Cambridge, MA: MIT Press.Google Scholar
  60. Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3–62.CrossRefGoogle Scholar
  61. Moss, P. A., Girard, B., & Haniford, L. (2006). Validity in educational assessment. Review of Research in Education, 30, 109–162.CrossRefGoogle Scholar
  62. Moss, P. A., Pullin, D., Gee, J. P., & Haertel, E. H. (2005). The idea of testing: Psychometric and sociocultural perspectives. Measurement: Interdisciplinary Research and Perspectives, 3(2), 63–83.CrossRefGoogle Scholar
  63. Moss, P., Pullin, D., Gee, J. P., Haertel, E., & Young, L. J. (2008). Assessment, equity, and opportunity to learn. Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
  64. Partners in Educational Transformation. (2008). Transforming education: Assessing and teaching 21st century skills. Retrieved from http://www.atc21s.org/GetAssets.axd?FilePath=/Assets/Files/699792fd-4d41-44f2-8208-cbb3fccb6572.pdf
  65. Partnership for 21st Century Skills. (2005). Assessment of 21 st century skills: The current landscape. Tucson, AZ: Partnership for 21st Century Skills.Google Scholar
  66. Partnership for 21st Century Skills. (2007a). 21st century skills professional development: A partnership for 21st century skills e-paper. Tucson, AZ: Partnership for 21st Century Skills.Google Scholar
  67. Partnership for 21st Century Skills. (2007b). 21st century skills assessment: A partnership for 21st century skills e-paper. Tucson, AZ: Author.Google Scholar
  68. Pellegrino, J. W., Chudowsky, N., & Glaser, R. (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press.Google Scholar
  69. Popham, W. J. (1997). What’s wrong-and what’s right-with rubrics. Educational leadership, 55, 72–75.Google Scholar
  70. Popham, W. J. (2006). Phony formative assessments: Buyer beware! Educational Leadership, 64(3), 86–87.Google Scholar
  71. Quellmalz, E. S., & Pellegrino, J. W. (2009). Technology and testing. Science, 323(5910), 75–79.CrossRefGoogle Scholar
  72. Rheingold, H. (2007). Using participatory media and public voice to encourage civic engagement. In L. Bennett (Ed.), Civic life online: Learning how digital media can engage youth (pp. 97–118). Cambridge, MA: MIT Press.Google Scholar
  73. Rogoff, B., & Gardner, W. P. (1984). Adult guidance of cognitive development. In B. Rogoff & J. Lave (Eds.), Everyday cognition: Its development in social contexts (pp. 95–116). Cambridge, MA: Harvard University Press.Google Scholar
  74. Ruiz-Primo, M. A., Shavelson, R. J., Hamilton, L., & Klein, S. (2002). On the evaluation of systemic science education reform: Searching for instructional sensitivity. Journal of Research in Science Teaching, 39(5), 369–393.CrossRefGoogle Scholar
  75. Scribner, S., & Cole, M. (1981). The psychology of literacy. Cambridge, MA: Harvard University Press.Google Scholar
  76. Shavelson, R., & Towne, L. (Eds.). (2002). Scientific research in education. Washington, DC: National Academies Press.Google Scholar
  77. Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14.Google Scholar
  78. Shepard, L. A. (2007). Formative assessment: Caveat emptor. In C. A. Dwyer (Ed.), The future of assessment: Shaping teaching and learning (pp. 279–303). Mahwah, NJ: Erlbaum.Google Scholar
  79. Shirky, C. (2008). Here comes everybody: The power of organizing without organizations. New York: The Penguin Press.Google Scholar
  80. Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). Mahwah, NJ: Routledge, Taylor and Francis.Google Scholar
  81. Silva, E. (2008). Measuring skills in the 21st century. Washington, DC: The Education Sector.Google Scholar
  82. Star, S. L., & Griesemer, J. R. (1989). Institutional ecology, ‘translations’ and boundary objects: Amateurs and professionals in Berkeley’s Museum of Vertebrate Zoology, 1907–39. Social Studies of Science, 19(3), 387–420.CrossRefGoogle Scholar
  83. Steinkuehler, C. A., Black, R. W., & Clinton, K. A. (2005). Researching literacy as tool, place, and way of being. Reading Research Quarterly, 40(1), 95–100.Google Scholar
  84. Street, B. (1984). Literacy in theory and practice. Cambridge, MA: Cambridge University Press.Google Scholar
  85. Taasobshirazi, G., Anderson, K. A., Zuiker, S. J., & Hickey, D. T. (2006). Enhancing inquiry, understanding, and achievement in an astronomy multimedia learning environment. Journal of Science Education and Technology, 15, 383–395.CrossRefGoogle Scholar
  86. The New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60–92.Google Scholar
  87. Towne, L., & Hilton, M. (Eds.). (2004). Implementing randomized field trials in education: Report of a workshop. Washington, DC: National Academies Press.Google Scholar
  88. White House. (2009). White House education agenda: January 2009. Washington, DC: U.S. Government Printing Office.Google Scholar
  89. Winerip, M. (2005, November 2). Are schools passing or failing? Now there’s a third choice… both. New York Times.Google Scholar
  90. Xenos, M., & Foot, K. (2008). Not your father’s internet: The generation gap in online politics. In L. Bennett (Ed.), Civic life online: Learning how digital media can engage youth (pp. 51–70). Cambridge, MA: MIT Press.Google Scholar
  91. Yancey, K. B. (2009). Writing in the 21st century: A report from the National Council of Teachers of English. Urbana, IL: NCTE.Google Scholar
  92. Ysseldyke, J., & Tardrew, S. (2007). Use of a progress monitoring system to enable teachers to differentiate mathematics instruction. Journal of Applied School Psychology, 24(1), 1–28.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Daniel T. Hickey
    • 1
  • Michelle A. Honeyford
    • 2
  • Katie A. Clinton
    • 3
  • Jenna McWilliams
    • 1
  1. 1.Learning Sciences ProgramIndiana UniversityBloomingtonUSA
  2. 2.Department of Literacy, Culture, & Language EducationIndiana UniversityBloomingtonUSA
  3. 3.New Media Literacies, Annenberg School for Communication & JournalismUniversity of Southern CaliforniaLos AngelesUSA

Personalised recommendations