Teaching with student response systems in elementary and secondary education settings: A survey study
- 872 Downloads
- 32 Citations
Abstract
This study examined how 498 elementary and secondary educators use student response systems in their instruction. The teachers all completed an online questionnaire designed to learn about their goals for using response systems, the instructional strategies they employ when using the system, and the perceived effects of response systems. Participants in the study tended to use similar instructional strategies when using the technology as have been reported in higher education. These include posing questions to check for student understanding and diagnose student difficulties, sharing a display of student responses for all to see, asking students to discuss or rethink answers, and using feedback from responses to adjust instruction. A latent class analysis of the data yielded four profiles of teacher use based on frequency of use and breadth of instructional strategies employed. Teachers who used the technology most frequently and who employed broadest array of strategies were more likely to have received professional development in instructional strategies and to perceive the technology as more effective with students.
Keywords
Student response systems Teaching practice Latent class analysisNotes
Acknowledgments
This material is based in part on work supported by the National Science Foundation under Grant Number REC-0337793. Any opinions, findings, conclusions, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. We thank Timothy Urdan of Santa Clara University and Louis Abrahamson of Better Education Foundation for their assistance with designing the survey, Willow Sussex for her management of survey data collection, Angela Haydel DeBarger for her help with an earlier technical report presenting preliminary analyses of these data, and Jeremy Roschelle for his guidance on the research project and helpful comments on the paper.
References
- Abrahamson, L., Owens, D. T., Demana, F., Meagher, M., & Herman, M. (2003, March). Developing pedagogy for wireless handheld computer networks. Paper presented at the Society for Information Technology and Teacher Education International Conference, Albuquerque, NM.Google Scholar
- Adelman, N., Donnelly, M. B., Dove, T., Tiffany-Morales, J., Wayne, A., & Zucker, A. A. (2002). The integrated studies of educational technology: Professional development and teachers’ use of technology. Menlo Park, CA: SRI International.Google Scholar
- Anderson, R. J., Anderson, R., VanDeGrift, T., Wolfman, S. A., & Yasuhara, K. (2003, June). Promoting interaction in large classes with a computer-mediated feedback system. Paper presented at the Computer Supported Cooperative Learning ‘03, Bergen, Norway.Google Scholar
- Becker, H. J. (1999). Internet use by teachers: Conditions of professional use and teacher-directed student use. Irvine, CA: Center for Research on Information Technology and Organizations.Google Scholar
- Becker, H. J., & Anderson, R. J. (1998a). Teaching learning, and computing, 1998: A national survey of schools and teachers describing their best practices, teaching philosophies, and uses of technology. Washington, DC: Office of Educational Research and Improvement, U.S. Department of Education.Google Scholar
- Becker, H. J., & Anderson, R. J. (1998b). Teaching, learning, and computing: 1998 national survey. Irvine, CA: Center for Research on Information Technology and Organizations, University of California.Google Scholar
- Berends, M., & Garet, M. S. (2002). In (re)search of evidence based school practices: Possibilities for integrating nationally representative surveys and randomized field trials to inform educational policy. Peabody Journal of Education, 77(4), 28–58.CrossRefGoogle Scholar
- Boyle, J. (1999, January). Using classroom communication systems with large classes. Paper presented at the Taking advantage of hand held technology and calculator network workshop, University of Strathclyde.Google Scholar
- Burnstein, L., McDonnell, L. M., Van Winkle, J., Ormseth, T. H., Mirocha, J., & Guiton, G. (1995). Validating national curriculum indicators. Santa Monica, CA: RAND.Google Scholar
- Burnstein, R., & Lederman, L. M. (2001). Using wireless keypads in lecture classes. Physics Teacher, 39(8).Google Scholar
- Crouch, C. H., & Mazur, E. (2001). Peer instruction: Ten years of experience and results. The Physics Teacher, 69(9), 970–977.Google Scholar
- Cuban, L. (2001). Oversold and underused: Computers in the classroom. Cambridge, MA: Harvard University Press.Google Scholar
- Desimone, L., & Le Floch, K. C. (2004). Are we asking the right questions? Using cognitive interviews to improve surveys in education research. Educational Evaluation and Policy Analysis, 26(1), 1–22.Google Scholar
- DiGiano, C., Yarnall, L., Patton, C., Roschelle, J., Tatar, D., & Manley, M. (2003). Conceptual tools for planning for the wireless classroom. Journal of Computer Assisted Learning, 19(3), 284–297.CrossRefGoogle Scholar
- diSessa, A. A., & Minstrell, J. (1998). Cultivating conceptual change with benchmark lessons. In J. G. Greeno, & S. V. Goldman (Eds.), Thinking practices in mathematics and science learning (pp. 155–187). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
- Draper, S. W., & Brown, M. (2004). Increasing interactivity in lectures using an electronic voting system. Journal of Computer Assisted Learning, 20(2), 81–94.CrossRefGoogle Scholar
- Dufresne, B., & Gerace, B. (1994). Using “extended scenario” to enhance learning during interactive lectures. Retrieved, 3/25/03, 2003.Google Scholar
- Dufresne, R. J., & Gerace, W. J. (2004). Assessing-to-learn: Formative assessment in physics instruction. The Physics Teacher, 42(7), 428–433.CrossRefGoogle Scholar
- Dufresne, R. J., Gerace, W. J., Leonard, W. J., Mestre, J., & Wenk, L. (1996). Using the Classtalk classroom communication system for promoting active learning in large lectures. Journal of Computing in Higher Education, 7(2), 3–47.Google Scholar
- Fagen, A. P., Crouch, C. H., & Mazur, E. (2002). Peer instruction: Results from a range of classrooms. The Physics Teacher, 40(4), 206–207.CrossRefGoogle Scholar
- Friedler, Y., Nachmias, R., & Linn, M. (1990). Learning scientific reasoning skills in microcomputer-based laboratories. Journal of Research in Science Teaching, 27(2), 173–191.CrossRefGoogle Scholar
- Ganger, A. C., & Jackson, M. (2003). Wireless handheld computers in the preclinical undergraduate curriculum. Medical Education Online, 8.Google Scholar
- Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38(4), 915–945.Google Scholar
- Hake, R. R. (1998). Interactive-engagement versus traditional methods. American Journal of Physics, 66, 64–74.CrossRefGoogle Scholar
- Hartline, F. (1997). Analysis of 1st semester of Classtalk use at McIntosh elementary school. Yorktown, VA: Better Education, Inc.Google Scholar
- Hegedus, S. (2003, September). Improving algebraic thinking through a connected SimCalc Mathworlds classroom. Paper presented at the the 27th Conference of the International Group for the Psychology of Mathematics Education held jointly with the 25th Conference of the PME-NA, Honolulu, HI.Google Scholar
- Hegedus, S., & Kaput, J. (2004, September). An introduction to the profound potential of connected algebra activities: Issues of representation, engagement and pedagogy. Paper presented at the 28th Conference of the International Group for the Psychology of Mathematics Education, Bergen, Norway.Google Scholar
- Herman, J. L., Klein, D. C. D., & Abedi, J. (2000). Assessing students’ opportunity to learn: Teacher and student perspectives. Educational Measurement: Issues and Practice, 19, 16–24.CrossRefGoogle Scholar
- Hudgins, B. (2001). Leveraging handheld technology in the classroom. T H E Journal, 29(5), 46.Google Scholar
- Jaillet, A. (2004). What is happening with portable computers in schools? Journal of Science Education and Technology, 13(1), 115–128.CrossRefGoogle Scholar
- Judson, E., & Sawada, D. (2002). Learning from past and present: Electronic response systems in college lecture halls. Journal of Computers in Mathematics and Science Teaching, 21(2), 167–181.Google Scholar
- Kanaya, T., Light, D., & Culp, K. M. (2005). Factors influencing outcomes from a technology-focused professional development program. Journal of Research on Technology in Education, 37(3), 313–329.Google Scholar
- Kaput, J., & Hegedus, S. (2002). Exploiting classroom connectivity by aggregating student constructions to create new learning opportunities. Paper presented at the 26th Conference of the International Group for the Psychology of Mathematics Education, Norwich, UK.Google Scholar
- Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15(10), 661–667.CrossRefGoogle Scholar
- Koziol, S. M., & Burns, P. (1986). Teachers’ accuracy in self-reporting about instructional practices using a focused self-report inventory. Journal of Educational Research, 79(4), 205–209.Google Scholar
- Lo, Y., Mendell, N. R., & Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778.CrossRefGoogle Scholar
- Lonsdale, P., Baber, C., & Sharples, M. (2004, September). Engaging learners with everyday technology: A participatory simulation using mobile phones. Paper presented at the Mobile Human Computer Interaction 2004: 6th International Symposium, Glascow, UK.Google Scholar
- Martin, M. O., Mullis, I. V. S., Gonzalez, E. J., O’Connor, K. M., Chrostowski, S. J., Gregory, K. D., Smith, T. A., Garden, R. A. (2001). Science benchmarking report: TIMSS 1999 – Eighth Grade. Chestnut Hill, MA: International Study Center, Lynch School of Education, Boston College.Google Scholar
- Mayer, D. (1999). Measuring instructional practice: Can policymakers trust survey data? Educational Evaluation and Policy Analysis, 21(1), 29–45.CrossRefGoogle Scholar
- Mazur, E. (1997). Peer instruction: A user’s manual. Upper Saddle River, NJ: Prentice Hall.Google Scholar
- Means, B., & Olson, K. (1995). Technology and education reform. Menlo Park: SRI International.Google Scholar
- Means, B., Penuel, W. R., & Padilla, C. (2001). The connected school: Technology and learning in high school. San Francisco, CA: Jossey-Bass.Google Scholar
- Means, B., Roschelle, J., Penuel, W. R., Sabelli, N., & Haertel, G. D. (2003). Technology’s contribution to teaching and policy: Efficiency, standardization, or transformation? Review of Educational Research, 27, 159–181.Google Scholar
- Mokros, J., & Tinker, R. (1987). The impact of microcomputer-based labs on children’s ability to interpret graphs. Journal of Research in Science Teaching, 24(4), 269–383.CrossRefGoogle Scholar
- Mullens, J. E. (1998, October). Validating teacher responses on instructional practice self-report surveys: Findings from a recent field test. Paper presented at the Association for Public Policy Analysis and Management Fall Research Conference, New York, NY.Google Scholar
- Muthén, L., & Muthén, B. (2004). Mplus User’s Guide, 3rd Edition. Los Angeles, CA: Muthén & Muthén.Google Scholar
- National Center for Education Statistics (2000). Teachers’ tools for the 21st century: A report on teachers’ use of technology. Washington, DC: U.S. Department of Education.Google Scholar
- National Research Council (2001). Classroom assessment and the National Science Education Standards. Washington, DC: National Academy Press.Google Scholar
- Nicol, D. J., & Boyle, J. (2003). Peer Instruction versus class-wide discussion in large classes: A comparison of two interaction Methods in the wired classroom. Studies in Higher Education, 28(4), 457–473.CrossRefGoogle Scholar
- O’Connor, M. C. (1994). Managing the intermental: Classroom group discussion and the social context of learning. In D. I. Slobin, J. Kyratzis, & J. Guo (Eds.), Social interaction, social context and languages: Essays in honor of Susan Ervin-Tripp. Hillsdale, NJ: Lawrence Erlbaum Assocication.Google Scholar
- O’Connor, M. C., & Michaels, S. (1996). Shifting participant frameworks: Orchestrating thinking practices in group discussions. In D. Hicks (Ed.), Discourse, learning, and schooling (pp. 63–103). New York: Cambridge University Press.Google Scholar
- Penuel, W. R., & Yarnall, L. (2005). Designing handheld software to support classroom assessment: An analysis of conditions for teacher adoption. Journal of Technology, Learning, and Assessment, 3(5). Available from http://www.jtla.org.Google Scholar
- Piazza, S. (2002). Peer instruction using an electronic response system in large lecture classes (Presentation document presented at the Pennsylvania State University Center for Education Technology Services “Teaching with Technology” series: Departments of Kinesiology, Mechanical Engineering, and Orthopaedics and Rehabilitation Center for Locomotion Studies.Google Scholar
- Poulis, C., Massen, C., Robens, E., & Gilbert, M. (1998). Physics learning with audience paced feedback. American Journal of Physics, 66, 439–441.CrossRefGoogle Scholar
- Ramasway, V., DeSarbo, W., Reibstein, D., & Robinson, W. (1993). Empirical pooling approach to marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124.CrossRefGoogle Scholar
- Robinson, S. (2002). Discourse: Decades of achievement results. Princeton, NJ: ETS Technologies, Incorporated.Google Scholar
- Roschelle, J., Penuel, W. R., & Abrahamson, A. L. (2004). The networked classroom. Educational Leadership, 61(5), 50–54.Google Scholar
- Ross, S. M., Troutman, A., Horgan, D., Maxwell, S., Laitinen, R., & Lowther, D. (1997). The success of schools in implementing eight restructuring desings: A synthesis of first-year evaluation outcomes. School Effectiveness and School Improvement, 8(1), 95–124.Google Scholar
- Rowan, B., Harrison, D. M., & Hayes, A. (2004). Using instructional logs to study mathematics curriculum and teaching in the early grades. Elementary School Journal, 105(1), 103–127.CrossRefGoogle Scholar
- Sandholtz, J., Ringstaff, C., & Dwyer, D. (1997). Teaching with technology: Creating student-centered classrooms. New York: Teachers College Press.Google Scholar
- Schwartz, D. L., & Bransford, J. D. (1998). A time for telling. Cognition and Instruction, 16(4), 475–522.CrossRefGoogle Scholar
- Schwartz, G. (1978). Estimating the dimensions of a model. Annals of Statistics, 6, 461–464.Google Scholar
- Smithson, J. L., & Porter, A. C. (1994). Measuring classroom practice: Lessons learned from the efforts to describe the enacted curriculum – The Reform Up-Close Study. Madison, WI: Consortium for Policy Research in Education.Google Scholar
- Stroup, W. M. (2002, September). Instantiating seeing mathematics structuring the social sphere (MS3): Updating generative teaching and learning for networked mathematics and science classrooms. Paper presented at the First International Conference on Wireless and Mobile Technologies in Education, Vaxjo, Sweden.Google Scholar
- Stuart, S. A. J., Brown, M. I., & Draper, S. W. (2004). Using an electronic voting system in logic lectures: One practitioner’s application. Journal of Computer Assisted Learning, 20(2), 95–102.CrossRefGoogle Scholar
- Sung, M., Gips, J., Eagle, N., DeVaul, R., & Pentland, S. (2004). MIT.EDU: System architecture for real-world distributed multi-user applications in classroom settings. In J. Roschelle, T. W. Chan, Kinshuk & S. Yang (Eds.), Proceedings of the 2nd IEEE international workshop on wireless and mobile technologies in education (pp. 43–50). Los Alomitos, CA: IEEE Computer Society.Google Scholar
- Truong, T. M., Griswold, W. G., Ratto, M., & Star, L. (2002). The ActiveClass project: experiments in encouraging classroom participation. San Diego, CA: University of California, San Diego.Google Scholar
- Wilensky, U., & Stroup, W. M. (2000, June). Networked gridlock: Students enacting complex dynamic phenomena with the HubNet architecture. Paper presented at the The Fourth Annual International Conference of the Learning Sciences, Ann Arbor, MI.Google Scholar
- Windschitl, M., & Sahl, K. (2002). Tracing teachers’ use of technology in a laptop computer school: The interplay of teacher beliefs, social dynamics, and institutional culture. American Educational Research Journal, 39(1), 165–205.Google Scholar
- Wit, E. (2003). Who wants to be...The use of a Personal Response System in statistics teaching. MSOR Connections, 3, 5–11.Google Scholar
- Zhang, N. L. (2004). Hierarchical latent class models for cluster analysis. Journal of Machine Learning Research, 5, 697–723.Google Scholar