A Comparison of Rubrics for Identifying Empirically Supported Practices with Single-Case Research
- 579 Downloads
The use of single-case research methods for validating academic and behavioral interventions has gained considerable attention in recent years. As such, there has been a proliferation of methods for evaluating whether, and to what extent, primary research reports provide evidence of intervention effectiveness. Despite the recent interest in harnessing single-case research to identify empirically supported strategies, examination of these tools has revealed that there is a lack of consistency in the methodological criteria sampled and scoring procedures used to evaluate primary research reports. The present study examined the extent to which various evidence rubrics addressed specific methodological features of single-case research and classified studies into similar evidence categories. Results indicated that the methodological criteria included within rubrics tended to vary, particularly for criteria related to determining the generality of the intervention under study. Moreover, there was substantial discordance observed in the evidence classifications assigned to reviewed studies. These findings are discussed in the context of the still-developing nature of single-case evidence reviews. Recommendations for both research and practice are provided.
KeywordsEvidence-based practice Methodological quality Special education Single-case research Systematic review
- Barlow, D. H., Nock, M., & Hersen, M. (2009). Single case research designs: Strategies for studying behavior change (3rd ed.). New York: Pearson.Google Scholar
- Cook, B. G., Tankersley, M., & Landrum, T. J. (2009). Determining evidence-based practices in special education. Exceptional Children, 75, 365–383.Google Scholar
- Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson Prentice Hall.Google Scholar
- Donaldson, S. I., Christie, C. A., & Mark, M. M. (2008). What counts as credible evidence in applied research and evaluation practice?. Thousand Oaks, CA: Sage.Google Scholar
- Gable, R. A., Tonelson, S. W., Sheth, M., Wilson, C., & Park, K. L. (2012). Importance, usage, and preparedness to implement evidence-based practices for students with Emotional Disabilities: A comparison of knowledge and skills of special education and general education teachers. Education and Treatment of Children, 35, 499–520.CrossRefGoogle Scholar
- Gast, D. L. (2010). Replication. In D. L. Gast (Ed.), Single subject research methodology in behavioral sciences (pp. 110–128). New York: Routledge.Google Scholar
- Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37–50.Google Scholar
- Horner, R. H., & Kratochwill, T. R. (2012). Synthesizing single-case research to identify evidence-based practices: Some brief reflections. Journal of Behavioral Education, 21(3), 266–272.Google Scholar
- Johnston, J. M., & Pennypacker, H. S. (2009). Strategies and tactics of human behavior research (Vol. 3). New York: Routledge.Google Scholar
- Kazdin, A. E. (2011). Single-case research designs: Methods for clinical and applied settings. London: Oxford University Press.Google Scholar
- Kennedy, C. H. (2005). Single-case designs for educational research. New York: Pearson.Google Scholar
- Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., et al. (2010). Single-case designs technical documentation. Retrieved from What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc_scd.pdf.
- Maggin, D. M., & Chafouleas, S. M. (2010). PASS-RQ: Protocol for assessing single-subject research quality. Unpublished research instrument.Google Scholar
- Maggin, D. M., & Chafouleas, S. M. (2013). Introduction to the special series issues and advances of synthesizing single-case research. Remedial and Special Education, 34, 3–8.Google Scholar
- National Autism Center. (2008). National standards project. Retrieved June 4, 2011, from www.nationalautismcenter.org/about/national.php.
- National Professional Development Center on Autism Spectrum Disorders. (2009). Evidence-based practices for children and youth with ASD. Retrieved June 14, 2011 from http://autismpdc.fpg.unc.edu/sites/autismpdc.fpg.unc.edu/files/EBP_Update_Reviewer_Training_printversion.pdf.
- National Research Council. (2002). Scientific research in education. Committee on Scientific Principles for Education Research. In: R. J. Shavelson, & L. Towne (Eds.), Center for education. Division of behavioral and social sciences and education. Washington, DC: National Academy Press.Google Scholar
- Parsonson, B. S., & Baer, D. M. (1992). The analysis and presentation of graphic data. In T. Kratochwill (Ed.), Single subject research (pp. 101–166). New York: Academic Press.Google Scholar
- Perone, M. (1999). Statistical inference in behavior analysis: Experimental control is better. The Behavior Analyst, 22, 109.Google Scholar
- Sanetti, L. M. H., Gritter, K. L., & Dobey, L. M. (2011). Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review, 40, 72–84.Google Scholar
- Sanetti, L. M. H., & Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445–459.Google Scholar
- Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.Google Scholar
- Tate, R. L., McDonald, S., Perdices, M., Togher, L., Schultz, R., & Savage, S. (2008). Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale. Neuropsychological Rehabilitation, 18, 385–401.PubMedCrossRefGoogle Scholar
- Wilson, K. P. (2011). Synthesis of single-case design research in communication sciences and disorders: Challenges, strategies, and future directions. Evidence-Based Communication Assessment and Intervention, 5, 104–115.Google Scholar