Skip to main content

A Framework to Guide Educational Technology Studies in the Evolving Classroom Research Environment

  • Conference paper
  • First Online:
Technology-Enhanced Learning for a Free, Safe, and Sustainable World (EC-TEL 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12884))

Included in the following conference series:

Abstract

Despite the drastic change to school environments due to the COVID-19 pandemic, it is still important that educational technology researchers conduct school-based research to understand the impact of technology in an authentic learning context, even remotely. However, the transition to remote research has made it challenging for researchers to collect classroom data, observe teacher-student-technology interactions, and facilitate study sessions. To explore how researchers can effectively plan and conduct technology-based educational studies in the new, evolving classroom research environment, we interviewed seven US teachers, investigating their perceptions of participating in remote classroom studies. Based on the findings and the authors’ experience of running classroom studies, we propose a framework that educational technology researchers can refer to when planning and conducting research in the evolving classroom research environment. Specifically, the framework informs researchers of several types of questions they can explore with teachers, students, and researchers themselves to be better prepared to address potential confusion, unexpected issues, and practical benefits in remote classroom research. Our work contributes by providing a practical guide for running technology-based research remotely, which may remain as a means of classroom research in the future. Some of the findings and the framework would also be applied to in-person classroom research setting.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Koedinger, K.R., Aleven, V., Roll, I., Baker, R.: In vivo experiments on whether supporting metacognition in intelligent tutoring systems yields robust learning. In: Handbook of Metacognition in Education, pp. 897–964 (2009)

    Google Scholar 

  2. Nagashima, T., et al.: Using anticipatory diagrammatic self-explanation to support learning and performance in early algebra. In: de Vries, E., Ahn, J., Hod, Y. (eds.) 15th International Conference of the Learning Sciences, pp. 474–481. International Society of the Learning Sciences (2021)

    Google Scholar 

  3. Amiel, T., Reeves, T.C.: Design-based research and educational technology: rethinking technology and the research agenda. J. Educ. Technol. Soc. 11(4), 29–40 (2008)

    Google Scholar 

  4. Coburn, C.E., Penuel, W.R.: Research–practice partnerships in education: outcomes, dynamics, and open questions. Educ. Res. 45(1), 48–54 (2016)

    Article  Google Scholar 

  5. Lee, K.J., et al.: The show must go on. A conceptual model of conducting synchronous participatory design with children online. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), pp. 1–16. Yokohama, Japan (2021)

    Google Scholar 

  6. Ratcliffe, J., Soave, F., Bryan-Kinns, N., Tokarchuk, L., Farkhatdinov, I.: Extended reality (XR) remote research: a survey of drawbacks and opportunities. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), pp. 1–13. Yokohama, Japan (2021)

    Google Scholar 

  7. Rhodes, M., et al.: Advancing developmental science via unmoderated remote research with children. J. Cogn. Dev. 21(4), 477–493 (2020)

    Article  Google Scholar 

  8. Middleton, K.V.: The longer-term Impact of COVID-19 on K–12 student learning and assessment. Educ. Meas. Issues Pract. 39(3), 41–44 (2020)

    Article  Google Scholar 

  9. Nussenbaum, K., Scheuplein, M., Phaneuf, C.V., Evans, M.D., Hartley, C.A.: Moving developmental research online: comparing in-lab and web-based studies of model-based reinforcement learning. Collabra: Psychol. 6(1) (2020)

    Google Scholar 

  10. Castelli, F.R., Sarvary, M.A.: Why students do not turn on their video cameras during online classes and an equitable and inclusive plan to encourage them to do so. Ecol. Evol. 11, 3565–3576 (2021)

    Article  Google Scholar 

  11. Patrick, S.W., et al.: Well-being of parents and children during the COVID-19 pandemic: a national survey. Pediatrics 146(4) (2020)

    Google Scholar 

  12. Reich, J., Buttimer, C.J., Coleman, D., Colwell, R.D., Faruqi, F., Larke, LR.: What’s lost, what’s left, what's next: lessons learned from the lived experiences of teachers during the 2020 novel coronavirus pandemic. EdArXiv (2020)

    Google Scholar 

  13. Smith, C.J.: Getting the most out of remote research and testing. Interactions 24(2), 82–84 (2017)

    Article  Google Scholar 

  14. Doyle, W.: Ecological approaches to classroom management. In: Handbook of Classroom Management: Research, Practice, and Contemporary Issues, pp. 97–125 (2006)

    Google Scholar 

  15. Lucero, A.: Using affinity diagrams to evaluate interactive prototypes. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9297, pp. 231–248. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22668-2_19

    Chapter  Google Scholar 

  16. Laursen, S., Liston, C., Thiry, H., Graf, J.: What good is a scientist in the classroom? Participant outcomes and program design features for a short-duration science outreach intervention in K–12 classrooms. CBE—Life Sci. Educ. 6(1), 49–64 (2007)

    Article  Google Scholar 

  17. Stelitano, L., Doan, S., Woo, A., Diliberti, M.K., Kaufman, J.H., Henry, D.: The digital divide and COVID-19: teachers’ perceptions of inequalities in students’ internet access and participation in remote learning. RAND Research Report (2020)

    Google Scholar 

  18. Panaoura, R.: Parental involvement in children’s mathematics learning before and during the period of the COVID-19. Soc. Educ. Res. 2, 65–74 (2021)

    Google Scholar 

  19. Gills, A., Krull, L.: COVID-19 remote learning transition in spring 2020: class structures, student perceptions, and inequality in college courses. Teach. Sociol. 48(4), 283–299 (2020)

    Article  Google Scholar 

  20. Farell, C.C., et al.: A descriptive study of the IES Researcher-Practitioner Partnerships in Education Research Program: Final report. National Center for Research in Policy and Practice (2018)

    Google Scholar 

Download references

Acknowledgements

This research was supported by NSF Award #1760922. We thank all the participating teachers.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tomohiro Nagashima .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nagashima, T., Yadav, G., Aleven, V. (2021). A Framework to Guide Educational Technology Studies in the Evolving Classroom Research Environment. In: De Laet, T., Klemke, R., Alario-Hoyos, C., Hilliger, I., Ortega-Arranz, A. (eds) Technology-Enhanced Learning for a Free, Safe, and Sustainable World. EC-TEL 2021. Lecture Notes in Computer Science(), vol 12884. Springer, Cham. https://doi.org/10.1007/978-3-030-86436-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86436-1_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86435-4

  • Online ISBN: 978-3-030-86436-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics