Skip to main content
Springer Nature Link
Log in

Methods for Assessing Single-Case School-Based Intervention Outcomes

  • Tools for Practice
  • Published:
Contemporary School Psychology Aims and scope Submit manuscript

Abstract

The purpose of this article is to present various single-case outcome assessment methods for evaluating school-based intervention effectiveness. We present several outcome methods, including goal attainment scaling, visual analysis, trend analysis, percentage of non-overlapping data, single-case mean difference effect size, reliable change index, and convergent evidence scaling. The strengths and limitations of each of these methods are discussed, along with the potential practice applications. We conclude the article with a suggested display format for single-case intervention outcomes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Finland)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Baer, D. M. (1977). Perhaps it would be better not to know everything. Journal of Applied Behavior Analysis, 10, 167–172.

    Article  PubMed Central  PubMed  Google Scholar 

  • Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006). The relationship between visual analysis and five statistical analyses in a simple AB single-case research design. Behavior Modification, 30, 531–563.

    Article  PubMed  Google Scholar 

  • Brossart, D. F., Parker, R. I., & Castillo, L. G. (2011). Robust regression for single-case data analysis: How can it help? Behavior Research Methods, 43, 710–719.

    Article  PubMed  Google Scholar 

  • Busk, P. L., & Marascuilo, L. A. (1992). Statistical analysis in single-case research: Issues, procedures, and recommendations, with applications to multiple behaviors. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 159–186). Hillsdale: Erlbaum.

    Google Scholar 

  • Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single-case research. In T. R. Kratochwill & J. R. Levin (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187–212). Hillsdale: Erlbaum.

    Google Scholar 

  • Busse, R. T. (2005). Methods for assessing response to intervention. Atlanta: Workshop presented at the annual convention of the National Association of School Psychologists.

    Google Scholar 

  • Busse, R. T., & Yi, M. (2013). Behavioral and academic rating scale applications within the problem-solving model. In R. Brown-Chidsey & A. Andren (Eds.), Assessment for intervention: a problem-solving approach (2nd ed., pp. 180–198). New York: Guilford.

    Google Scholar 

  • Busse, R. T., Kratochwill, T. R., & Elliott, S. N. (1995). Meta-analysis for single-case consultation outcomes: Applications to research and practice. Journal of School Psychology, 33, 269–285.

    Article  Google Scholar 

  • Busse, R. T., Elliott, S. N., & Kratochwill, T. R. (1999). Influences of verbal interactions during behavioral consultations on treatment outcomes. Journal of School Psychology, 37, 117–143.

    Article  Google Scholar 

  • Busse, R. T., Elliott, S. N., & Kratochwill, T. K. (2010). Convergent evidence scaling for multiple assessment indicators: Conceptual issues, application, and technical challenges. Journal of Applied School Psychology, 26, 149–161.

    Article  Google Scholar 

  • Christ, T. J., Zopluoglu, C., Long, J. D., & Monaghen, B. D. (2012). Curriculum-based measurement of oral-reading: Quality of progress monitoring outcomes. Exceptional Children, 78, 356–373.

    Article  Google Scholar 

  • Coffee, G., & Ray-Subramanian, C. (2009). Goal attainment scaling: a progress-monitoring tool for behavioral interventions. School Psychology Forum, 3, 1–12.

    Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New York: Psychology Press.

    Google Scholar 

  • DeProspero, A., & Cohen, S. (1979). Inconsistent visual analyses of intrasubject data. Journal of Applied Behavior Analysis, 12, 573–579.

    Article  PubMed Central  PubMed  Google Scholar 

  • Elliott, S. N., & Busse, R. T. (2004). Assessment and evaluation of students’ behavior and intervention outcomes: the utility of rating scale methods. In R. B. Rutherford, M. M. Quinn, & S. R. Mathur (Eds.), Handbook of research in emotional and behavioral disorders (pp. 123–142). New York: Guilford.

    Google Scholar 

  • Gingerich, W. J. (1984). Meta-analysis of applied time-series data. Journal of Applied Behavioral Science, 20, 71–79.

    Article  PubMed  Google Scholar 

  • Gorman-Smith, D., & Matson, J. L. (1985). A review of treatment research for self-injurious and stereotyped responding. Journal of Mental Deficiency Research, 29, 295–308.

    PubMed  Google Scholar 

  • Gresham, F. M. (1989). Assessment of intervention integrity in school consultation and prereferral interventions. School Psychology Review, 18, 37–50.

    Google Scholar 

  • Hageman, W. J., & Arrindell, W. A. (1999). Establishing clinically significant change: Increment of precision and the distinction between individual and group level of analysis. Behavior Research and Therapy, 37, 1169–1193.

    Article  Google Scholar 

  • Hasbrouk, J. E., & Tindal, G. A. (2006). Oral reading fluency norms: a valuable assessment tool for reading teachers. The Reading Teacher, 59, 636–644.

    Article  Google Scholar 

  • Hixson, M., Christ, T. J., & Bradley-Johnson, S. (2008). Best practices in the analysis of progress monitoring data and decision making. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology V (pp. 2133–2146). Bethesda: National Association of School Psychologists.

    Google Scholar 

  • Hsu, L. M. (1989). Reliable changes in psychotherapy: Taking into account regression toward the mean. Behavioral Assessment, 11, 459–467.

    Google Scholar 

  • Jacobson, N. S., & Truax, P. (1991). Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19.

    Article  PubMed  Google Scholar 

  • Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984). Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance. Behavior Therapy, 15, 336–352.

    Article  Google Scholar 

  • Kennedy, C. (2005). Single-case designs for educational research. Boston: Allyn & Bacon.

    Google Scholar 

  • Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling: a general method for evaluating community mental health programs. Community Mental Health Journal, 4, 443–453.

    Article  PubMed  Google Scholar 

  • Kiresuk, T. J., Smith, A., & Cardillo, J. E. (Eds.). (1994). Goal attainment scaling: Application, theory, and measurement. Hillsdale: Erlbaum.

    Google Scholar 

  • Knapp, T. J. (1983). Behavior analysts’ visual appraisal of behavior change in graphic display. Behavioral Assessment, 5, 155–164.

    Google Scholar 

  • Kratochwill, T. R., & Stoiber, K. C. (2002). Empirically supported interventions and school psychology: Conceptual and practice issues: Part II. School Psychology Quarterly, 15, 233–253.

  • Lunnen, K. M., & Ogles, B. M. (1998). A multiperspective, multivariable evaluation of reliable change. Journal of Consulting and Clinical Psychology, 66, 400–410.

    Article  PubMed  Google Scholar 

  • McGill, R. J., & Busse, R. T. (2014). An evaluation of multiple single-case outcome indicators using convergent evidence scaling. Contemporary School Psychology, 18, 13–23.

    Article  Google Scholar 

  • Michael, J. (1974). Statistical inference for individual organism research: Mixed blessing or curse? Journal of Applied Behavior Analysis, 7, 647–653.

    Article  PubMed Central  PubMed  Google Scholar 

  • Parker, R. I., & Vannest, K. J. (2008). An improved effect size for single-case research: nonoverlap of all pairs. Behavior Therapy, 40, 95–105.

    Google Scholar 

  • Parker, R. I., Hagan-Burke, S., & Vannest, K. J. (2007). Percentage of all non-overlapping data (PAND): an alternative to PND. The Journal of Special Education, 40, 194–204.

    Article  Google Scholar 

  • Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42, 284–99.

    Article  PubMed  Google Scholar 

  • Parsonson, B. S. (2003). Visual analysis of graphs: Seeing is believing. In K. S. Budd & T. Stokes (Eds.), A small matter of proof: the legacy of Donald M. Baer (pp. 35–52). Reno: Context Press.

    Google Scholar 

  • Parsonson, B. S., & Baer, D.M. (1986). The graphic analysis of data. In A. Poling & R.W. Fuqua (Eds.), Research methods in applied behavior analysis: Issues and advances (pp. 157–186). New York: Plenum.

  • Riley-Tillman, T. C., & Burns, M. K. (2009). Evaluating educational interventions: Single-case design for measuring response to intervention. New York: Guilford.

    Google Scholar 

  • Roach, A. T., & Elliott, S. N. (2005). Goal attainment scaling: an efficient and effective approach to monitoring student progress. Teaching Exceptional Children, 37(4), 8–17.

    Google Scholar 

  • Scruggs, T. E., Mastropieri, M. A., & Casto, G. (1987). The quantitative synthesis of single-subject research: Methodology and validation. Remedial and Special Education, 8, 24–33.

    Article  Google Scholar 

  • Shinn, M., Good, R., & Stein, S. (1989). Summarizing trend in student achievement: a comparison of methods. School Psychology Review, 18, 356–370.

    Google Scholar 

  • Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752–760.

    Article  PubMed  Google Scholar 

  • Tingey, R. C., Lambert, M. L., Burlingame, G. M., & Hansen, N. B. (1996). Assessing clinical significance: Proposed extensions to the method. Psychotherapy Research, 6, 109–103.

    Article  PubMed  Google Scholar 

  • White, O. R. (1987). Some comments concerning “The quantitative synthesis of single-subject research.”. Remedial and Special Education, 11, 203–214.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Chapman University, Orange, CA, USA

    R. T. Busse & Kelly S. Kennedy

  2. Texas Woman’s University, Denton, TX, USA

    Ryan J. McGill

Authors
  1. R. T. Busse
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ryan J. McGill
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kelly S. Kennedy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to R. T. Busse.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Busse, R.T., McGill, R.J. & Kennedy, K.S. Methods for Assessing Single-Case School-Based Intervention Outcomes. Contemp School Psychol 19, 136–144 (2015). https://doi.org/10.1007/s40688-014-0025-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40688-014-0025-7

Keywords

Search

Navigation