Skip to main content
SpringerLink
Log in

Measuring Student Engagement with Observational Techniques

  • Chapter
  • First Online:
Handbook of Research on Student Engagement

Abstract

The purpose of this chapter is to describe the use of observational methods to assess student engagement. These observational measures range from standardized rating scales of behavior to qualitative studies of classroom context and student engagement. Benefits, limitations, and methodological considerations with observational methods are described. Next, nine observational instruments with indicators of student engagement are presented. These instruments are compared on a variety of dimensions including what is measured, uses, samples, and the extent of reliability and validity of information. Finally, ongoing challenges with the use of observational methods of student engagement are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44, 427–445. https://doi.org/10.1002/pits.20303

    Article  Google Scholar 

  • Appleton, J. J., Christenson, S. L., & Furlong, M. J. (2008). Student engagement with school: Critical conceptual and methodological issues of the construct. Psychology in the Schools, 45, 369–386. https://doi.org/10.1002/pits.20303

    Article  Google Scholar 

  • Azevedo, R. (2015). Defining and measuring engagement and learning in science: Conceptual, theoretical, methodological, and analytical issues. Educational Psychologist, 50, 84–94. https://doi.org/10.1080/00461520.2015.1004069

    Article  Google Scholar 

  • Baker, R. S. J., Gowda, S. M., Wixon, M., Kalka, J., Wagner, A. Z., Aleven, V., et al. (2012). Towards sensor-free affect detection in cognitive tutor algebra. In K. Yacef, O. Zaïane, H. Hershkovitz, M. Yudelson, & J. Stamper (Eds.), Proceedings of the 5th International Conference on Educational Data Mining (pp. 126–133). International Educational Data Mining Society.

    Google Scholar 

  • Baker, R. S., Ocumpaugh, J. L., & Andres, J. M. A. L. (2018). BROMP quantitative field observations: A review. In R. Feldman (Ed.), Learning science: Theory, research, and practice. McGraw-Hill.

    Google Scholar 

  • Bingham, G. E., & Okagaki, L. (2012). Ethnicity and student engagement. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 65–95). Springer Science + Business Media.

    Chapter  Google Scholar 

  • Briesch, A. M., Hemphill, E. M., Volpe, R. J., & Daniels, B. (2015). An evaluation of observational methods for measuring response to class-wide intervention. School Psychology Quarterly, 30, 37–49. https://doi.org/10.1037/spq0000065

    Article  PubMed  Google Scholar 

  • Christ, T. J., Riley-Tillman, T. C., & Chafouleas, S. M. (2009). Foundation for the development and use of Direct Behavior Rating (DBR) to assess and evaluate student behavior. Assessment for Effective Intervention, 34, 201–213. https://doi.org/10.1177/1534508409340390

    Article  Google Scholar 

  • Corno, L., & Mandinach, E. B. (2004). What have we learned about student engagement in the past twenty years. In D. M. McInerney & S. Van Etten (Eds.), Big theories revisited: Vol 4. Research on sociocultural influences on motivation and learning (pp. 299–328). Information Age Publishing.

    Google Scholar 

  • Diperna, J. C., Lei, P., Bellinger, J., & Cheng, W. (2016). Effects of a positive behavioral program on student learning. Psychology in the Schools, 53, 189–205. https://doi.org/10.1002/pits.21891

    Article  Google Scholar 

  • Engle, R. A., & Conant, F. R. (2002). Guiding principles for fostering productive disciplinary engagement: Explaining an emergent argument in a community of learners’ classroom. Cognition and Instruction, 20, 399–483. https://doi.org/10.1207/S1532690XCI2004_1

    Article  Google Scholar 

  • Ferguson, T. D., Briesch, A. M., Volpe, R. J., Donaldson, A. R., & Feinberg, A. B. (2018). Psychometric considerations for conducting observations using time-sampling procedures. Assessment for Effective Intervention, 44(1), 45–57. https://doi.org/10.1177/1534508417747389

    Article  Google Scholar 

  • Finn, J. D. (1989). Withdrawing from school. Review of Educational Research, 59, 117–142. https://doi.org/10.3102/00346543059002117

    Article  Google Scholar 

  • Finn, J. D., & Zimmer, K. (2012). Student engagement: What is it? Why does it matter? In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 97–131). Springer.

    Chapter  Google Scholar 

  • Fredricks, J. (2021). The measurement of student engagement: Methodological advances and comparisons of new self-report measures. In S. Christenson, A. L. Reschy, & C. Wylie (Eds, 2nd edition.), Handbook of research on student engagement (2nd ed). Springer.

    Google Scholar 

  • Fredricks, J. A., & McColskey, W. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. In S. Christenson, A. L. Reschy, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 763–783). Springer.

    Chapter  Google Scholar 

  • Fredricks, J. A., Blumenfeld, P. C., & Paris, A. (2004). School engagement: Potential of the concept: State of the evidence. Review of Educational Research, 74, 59–119. https://doi.org/10.3102/00346543074001059

    Article  Google Scholar 

  • Fredricks, J., & McColskey, W., with Meli, J., Mordica, J., Montrosse, B., & Mooney, K. (2011). Measuring student engagement in upper elementary through high school: a description of 21 instruments. (Issues & Answers Report, REL 2010–No. 098). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education. Available at http://ies.ed.gov/ncee/edlabs/projects/project.asp?projectID=268

  • Fredricks, J. A., Hofkens, T., & Wang, M. (2019a). Measuring student engagement: An overview of methods, challenges, and new directions. In A. Renninger & S. Hidi (Eds.), The Cambridge handbook of motivation and learning (pp. 689–712). Cambridge University Press. https://doi.org/10.1017/9781316823279

    Chapter  Google Scholar 

  • Fredricks, J., Reschly, A., & Christenson, S. (Eds.). (2019b). Handbook of student engagement interventions: Working with disengaged students. Academic.

    Google Scholar 

  • Greenwood, C. R., Carta, J., & Atwater, J. (1991). Ecobehavioral analysis in the classroom: Review and implications. Journal of Behavioral Education, 1, 59–77. https://doi.org/10.1007/BF00956754

    Article  Google Scholar 

  • Gresalfi, M. S. (2009). Taking up opportunities to learn: Constructing dispositions in mathematics classrooms. Journal of the Learning Sciences, 18, 327–369. https://doi.org/10.1080/10508400903013470

    Article  Google Scholar 

  • Hamre, B. K., Pianta, R. C., & Chomat-Mooney, L. (2009). Conducting classroom observations in school-based research. In L. M. Dinella (Ed.), Conducting science-based psychology research in schools (pp. 79–105). American Psychological Association. https://doi.org/10.1037/11881-004

    Chapter  Google Scholar 

  • Henrie, C. R., Halverson, L. R., & Graham, C. R. (2015). Measuring student engagement in technology-mediated learning: A review. Computers and Education, 90, 36–53. https://doi.org/10.1016/j.compedu.2015.09.005

    Article  Google Scholar 

  • Hintze, J. M., Volpe, R. J., & Shapiro, E. S. (2002). Best practices in the systematic direct observation of student behavior. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology IV (pp. 993–1006). National Association of School Psychologists.

    Google Scholar 

  • Hofkens, T. L., & Ruzek, E. (2019). Measuring student engagement to inform interventions in schools. In J. Fredricks, A. Reschly, & S. Christenon (Eds.), Handbook of student engagement interventions: Working with disengaged youth (pp. 309–324). Academic.

    Chapter  Google Scholar 

  • Kamphaus, R. W., & Dever, B. V. (2016). Behavioral observation and assessment. In J. C. Norcross, G. R. VadenBos, & D. K. Freedheim (Eds.), APA handbook of clinical psychology: Vol. 3 (pp. 17–29). Applications and Methods.

    Google Scholar 

  • Lawson, M. A., & Lawson, H. A. (2013). New conceptual frameworks for student engagement research, policy, and practice. Review of Educational Research, 83(3), 432–479. https://doi.org/10.3102/0034654313480891

    Article  Google Scholar 

  • Morris, L. V., Finnegan, C., & Wu, S.-S. (2005). Tracking student behavior, persistence, and achievement in online courses. The Internet and Higher Education, 8, 221–231. https://doi.org/10.1016/j.iheduc.2005.06.009

    Article  Google Scholar 

  • Mulqueeny, K., Kostyuk, V., Baker, R. S., & Ocumpaugh, J. (2015). Incorporating effective e-learning principles to improve student engagement in middle-school mathematics. International Journal of STEM Education, 2. https://doi.org/10.1186/s40594-015-0028-6

  • Ocumpaugh, J., Baker, R. S., & Rodrigo, M. M. T. (2015). Baker Rodriguo Occumpaugh monitoring protocol (BROMP) 2.0 technical and training manual. Teachers College, Columbia University and Ateneo Laboratory for the Learning Sciences.

    Google Scholar 

  • Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119. https://doi.org/10.3102/0013189X09332374

    Article  Google Scholar 

  • Pianta, R. C., Hamre, B. K., Haynes, N. J., Mintz, S. L., & La Paro, K. M. (2007). Classroom Assessment Scoring System manual, middle/secondary version. University of Virginia Press.

    Google Scholar 

  • Pianta, R. C., Hamre, B. K., & Mintz, S. L. (2012). Classroom assessment scoring system (CLASS): Secondary class manual. Teachstone.

    Google Scholar 

  • Reeve, J., & Tseng, C. M. (2011). Agency as a fourth aspect of students’ engagement during learning activities. Contemporary Educational Psychology, 36(4), 257–267. https://doi.org/10.1016/j.cedpsych.2011.05.002

    Article  Google Scholar 

  • Reeve, J., Jang, H., Carrell, D., Jeon, S., & Barch, J. (2004). Enhancing students’ engagement by increasing teachers’ autonomy support. Motivation and Emotion, 28, 147–169. https://doi.org/10.1023/B:MOEM.0000032312.95499.6f

    Article  Google Scholar 

  • Renninger, K. A., & Bachrach, J. E. (2015). Studying triggers for interest and engagement using observational methods. Educational Psychologist, 50, 58–69. https://doi.org/10.1080/00461520.2014.999920

    Article  Google Scholar 

  • Reynolds, C. Z., & Kampaus, R. W. (2015). Reynolds, intellectual assessment scales (2nd ed.). Psychological Assessment Resources.

    Google Scholar 

  • Rimm-Kaufman, S. E. (2005). Classroom observation protocol for Early Learning Study (Unpublished protocol). University of Virginia.

    Google Scholar 

  • Ryu, S., & Lombardi, D. (2015). Coding classroom interactions for collective and individual engagement. Educational Psychologist, 50, 70–83. https://doi.org/10.1080/00461520.2014.1001891

    Article  Google Scholar 

  • Shapiro, E. S. (2011). Behavioral observation of students in schools. In E. S. Shapiro (Ed.), Academic skills problems fourth edition workbook (pp. 35–56). The Guilford Press.

    Google Scholar 

  • Shapiro, E. S., & Heick, P. (2004). School psychologist assessment practices in the evaluation of students referred for social/behavioral/emotional problems. Psychology in the Schools, 41, 551–561. https://doi.org/10.1002/pits.10176

    Article  Google Scholar 

  • Stulman, M. W., Hamre, B. K., Downer, J. T., & Pianta, R. C. (2021). How to select the right observation tool. CASTL, University of Virginia.

    Google Scholar 

  • Voelkl, K. E. (1997). Identification with school. American Journal of Education, 105, 204–319. https://doi.org/10.1086/444158

    Article  Google Scholar 

  • Volpe, R. J., & DiPerna, J. C. (2010). Cooperative learning observation code for kids. Unpublished observation code.

    Google Scholar 

  • Volpe, R. J., & McConaughy, S. H. (2005). Systematic direct observational assessment of student behavior: Its use and interpretation in multiple settings: An introduction to the miniseries. School Psychology Review, 34(4), 451–453. https://doi.org/10.1080/02796015.2005.12088008

    Article  Google Scholar 

  • Volpe, R. J., DiPerna, J. C., Hintze, J. M., & Shapiro, E. S. (2005). Observing students in classroom settings: A review of seven coding schemes. School Psychology Review, 34(4), 454–474.

    Article  Google Scholar 

  • Volpe, R., Young, G., Piana, M., & Zaslofsky, A. (2012). Integrating classwide early literacy intervention and behavioral supports: A pilot investigation. Journal of Positive Behavior Interventions, 14, 56–64. https://doi.org/10.1177/1098300711402591

    Article  Google Scholar 

  • Wang, M. T., Fredricks, J. A., Ye, F., Hofkens, T., & Schall, J. (2019). Conceptualization and assessment of adolescents’ engagement and disengagement in school: A multidimensional school engagement scale. European Journal of Psychological Assessment, 35(4), 592–606. https://doi.org/10.1027/1015-5759/a000431

    Article  Google Scholar 

  • Waxman, H. S., & Padron, Y. N. (2004). The use of classroom observation to improve student instruction. In H. W. Waxman & R. J. Tharp (Eds.), Observational research in U.S. classrooms: New approaches for understanding cultural and linguistic diversity (pp. 72–96). Cambridge University Press.

    Chapter  Google Scholar 

  • Waxman, H. C., Tharp, R. G., & Hilberg, R. S. (2004). Future directions for classroom observation research. In H. C. Waxman, R. S. Hilberg, & R. G. Tharp (Eds.), Observational research in U.S. classrooms: New approaches for understanding cultural and linguistic diversity (pp. 266–277). Cambridge University Press.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Union College, Schenectady, NY, USA

    Jennifer A. Fredricks

Authors
  1. Jennifer A. Fredricks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jennifer A. Fredricks .

Editor information

Editors and Affiliations

  1. University of Georgia, Athens, GA, USA

    Amy L. Reschly

  2. University of Minnesota, Minneapolis, MN, USA

    Sandra L. Christenson

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

A. Fredricks, J. (2022). Measuring Student Engagement with Observational Techniques. In: Reschly, A.L., Christenson, S.L. (eds) Handbook of Research on Student Engagement. Springer, Cham. https://doi.org/10.1007/978-3-031-07853-8_30

Download citation

Publish with us

Policies and ethics

Search

Navigation