Abstract
We illustrate the use of formative and summative assessment in evaluating a therapeutic classroom program for children with serious emotional disturbances. Information was analyzed based on data gathered for clinical decision-making during treatment (formative assessment) and measurement of outcomes at discharge (summative assessment) from a school-based Intensive Mental Health Program. Results indicated that overall ratings of daily indicators of behavior across all environments (therapeutic classroom, neighborhood school, and home) were predictive of functioning at discharge. An ecological approach during the formative assessment period of evaluation is important as compared to only examining individual environments. Formative assessment techniques can predict scores on a summative assessment measure. Thus, we found supportive evidence for the formative and summative procedures used in the Intensive Mental Health Program for therapeutic interventions, clinical decision-making, and outcomes assessment.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Algozzine, R., Serna, L., & Patton, J. R. (2001). Childhood behavior disorder: Applied research and educational practices (2nd ed.). Austin: Pro-Ed Inc.
Anderson, C. M., & Kim, C. (2003). Evaluating treatment efficacy with single-case design. In M. C. Roberts & S. S. Ilardi (Eds.), Handbook of research methods in clinical psychology (pp. 73–91). Oxford, UK: Blackwell.
Beer, V., & Bloomer, A. C. (1986). Levels of evaluation. Educational Evaluation and Policy Analysis, 8, 335–345.
Brown, S., & Knight, P. (1994). Assessing learners in higher education. London: Kogan Page.
Buchanan, T. (1998). Using the world wide web for formative assessment. Journal of Educational Technology Systems, 27, 71–79.
Casat, C. D., Norton, H. J., & Boyle-Whitesel, M. (1999). Identification of elementary school children at risk for disruptive behavioral disturbance: Validation of a combined screening method. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1246–1253.
Cronbach, L. J. (1966). The logic of experiments on discovery. In L. M. Shulman & E. Keislar (Eds.), Learning by discovery (pp. 76–92). Chicago: Rand McNally.
Donaldson, S. I. (2003). Theory-driven program evaluation in the new millennium. In S. I. Donaldson & M. Scriven (Eds.), Evaluating social programs and problems: Visions for the new millennium (pp. 109–141). Mahwah, NJ: Lawrence Erlbaum Associates.
Hodges, K. (2000). Child and Adolescent Functional Assessment Scale (CAFAS). Ann Arbor, MI: Functional Assessment Systems.
Hodges, K., Doucette Gates, A., & Liao, Q. (1999). The relationship between the Child and Adolescent Functional Assessment Scale (CAFAS) and indicators of functioning. Journal of Child and Family Studies, 8, 109–122.
Hodges, K., & Wong, M. M. (1996). Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale (CAFAS). Journal of Child and Family Studies, 5, 445–467.
Individuals with Disabilities Education Act, 20, U.S.C., & Sect 1400 et seq. (I.D.E.A. 1997).
Jacobs, A. K., Randall, C. J., Vernberg, E. M., Roberts, M. C., & Nyre, J. E. (2004). Providing services within a school-based intensive mental health program. In R. G. Steele & M. C. Roberts (Eds.), Handbook of mental health services for children, adolescents, and families (pp. 47–61). New York: Springer.
Mackler, B. (1974). Two kinds of research on evaluation. Psychological Reports, 34, 289–290.
Prescott, L. E., Norcini, J. J., McKinlay, P., & Rennie, J. S. (2002). Facing the challenges of competency-based assessment of postgraduate dental training: Longitudinal evaluation of performance (LEP). Medical Education, 36, 92–97.
Roberts, M. C., Jacobs, A. K., Puddy, R. W., Nyre, J. E., & Vernberg, E. M. (2003). Treating children with serious emotional disturbances in schools and community: The intensive mental health program. Professional Psychology: Research and Practice, 34, 519–526.
Scriven, M. (1967). The methodology of evaluation. In R. W. Tyler, R. M. Gagne, & M. Scriven (Eds.), Perspectives of curriculum evaluation (pp. 39–83). Chicago: Rand McNally.
Stufflebeam, D. L. (2000). Foundational models for 21st century program evaluation. In D. L. Stufflebeam, G. F. Madaus, & T. Kellaghan (Eds.), Evaluation models (2nd ed., pp. 33–83). Boston: Kluwer Academic Publishers.
Sugai, G., & Horner, R. H. (2002). Introduction to the special series on positive behavior support in school. Journal of Emotional and Behavioral Disorders, 10, 130–135.
Tabachnick, B. G., & Fidell, L. S. (1989). Using multivariate statistics. New York: Harper Collins.
U.S. Department of Education. (1999). Assistance to States for the Education of Children With Disabilities and the Early Intervention Program for Infants and Toddlers With Disabilities, 34 CFR Parts 300 and 303, Federal Register, 64, 12406–12454. (ERIC Document Reproduction Service No. ED428493).
Vernberg, E. M., Roberts, M. C., & Nyre, J. E. (this issue). The Intensive Mental Health Program: Development and structure of the model of intervention for children with serious emotional disturbances. Journal of Child and Family Studies.
Vernberg, E. M., Roberts, M. C., & Nyre, J. (2002). School-based intensive mental health treatment. In D. Marsh & M. Fristad (Eds.), Handbook of serious emotional disturbance in children and adolescents (pp. 412–427). New York: Wiley.
Vernberg, E. M., Nyre, J. E., Puddy, R. W., Jacobs, A. K., & Roberts, M. C. (2003). CAFAS outcomes for a school-based intensive mental health program. In C. Newman, C. J. Liberton, K. Kutash, & R. M. Friedman (Eds.), The 15th Annual research conference proceedings: A system of care for children’s mental health: Expanding the research base (pp. 415–417). Tampa, FL: Louis de la Parte Institute.
Vernberg, E. M., Jacobs, A. K., Nyre, J. E., Puddy, R. W., & Roberts, M. C. (2004). Innovative treatment for children with serious emotional disturbance: Preliminary outcomes for a school-based intensive mental health program. Journal of Clinical Child and Adolescent Psychology, 33, 359–365.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Puddy, R.W., Boles, R.E., Dreyer, M.L. et al. Demonstrating Support for the Formative and Summative Assessment Paradigm in a School-Based Intensive Mental Health Program. J Child Fam Stud 17, 253–263 (2008). https://doi.org/10.1007/s10826-007-9164-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10826-007-9164-z