Advertisement

Contemporary School Psychology

, Volume 21, Issue 3, pp 287–297 | Cite as

Broadening Our Understanding of Evidence-Based Practice: Effective and Discredited Interventions

  • Brian A. ZaboskiEmail author
  • Anna P. Schrack
  • Diana Joyce-Beaulieu
  • Jann W. MacInnes
Article

Abstract

The proliferation of unsubstantiated or discredited interventions underscores the importance of the evidence-based practice (EBP) movement in school psychology. Although researchers have conducted several surveys on discredited interventions in counseling and clinical psychology, no studies have investigated the use of these treatments in school psychology. This survey presented Florida Association of School Psychologist members with three categories of treatment: discredited treatments, treatments with mixed research results, and evidence-based treatments. Participants were asked to rate (1) the likelihood that they would recommend an intervention and (2) an intervention’s level of research support. Participants demonstrated unfamiliarity with discredited treatments, overestimated the research support for ineffective techniques, and expressed a desire to learn about discredited interventions through training and professional development opportunities. Training implications for school psychology programs are discussed.

Keywords

Evidence-based practice Discredited intervention School-based mental health School psychological services Children and adolescents 

Notes

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

References

  1. American Psychological Association (APA). (2010). Ethical principles of psychologists and code of conduct. Washington, DC: Author.Google Scholar
  2. American Psychological Association (APA). (2014). APA guidelines for practitioners. http://www.apa.org/practice/guidelines/
  3. American Psychological Association (APA). (2015). Standards of accreditation for health service psychology. Retrieved from http://www.apa.org/ed/accreditation/about/policies/standards-of-accreditation.pdf
  4. American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents. (2008). Disseminating evidence-based practice for children and adolescents: a systems approach to enhancing care. Washington, DC: Author.Google Scholar
  5. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285.CrossRefGoogle Scholar
  6. Bearman, S. K., Wadkins, M., Bailin, A., & Doctoroff, G. (2015). Pre-practicum training in professional psychology to close the research–practice gap: changing attitudes toward evidence-based practice. Training and Education in Professional Psychology, 9(1), 13–20.CrossRefPubMedPubMedCentralGoogle Scholar
  7. Bootzin, R. R., & Bailey, E. T. (2005). Understanding placebo, nocebo, and iatrogenic treatment effects. Journal of Clinical Psychology, 61(7), 871–880.CrossRefPubMedGoogle Scholar
  8. Castillo, J. M., Curtis, M. J., & Gelley, C. (2010). Professional practice school psychology 2010—part 2: school psychologists’ professional practices and implications for the field. Communiqué, 40(8), 4–6.Google Scholar
  9. Castillo, J. M., Curtis, M. J., & Tan, S. Y. (2014). Personnel needs in school psychology: a 10-year follow-up study on predicted personnel shortages. Psychology in the Schools, 51(8), 832–849.CrossRefGoogle Scholar
  10. Cook, J. M., Schnurr, P. P., Biyanova, T., & Coyne, J. C. (2015). Apples don’t fall far from the tree: influences on psychotherapists’ adoption and sustained use of new therapies. American Psychiatric Services, 60(5), 671–676.CrossRefGoogle Scholar
  11. Corcoran, J., & Pillai, V. (2009). A review of the research on solution-focused therapy. British Journal of Social Work, 39(2), 234–242.CrossRefGoogle Scholar
  12. Forman, S. G., Fagley, N. S., Steiner, D. D., & Schneider, K. (2009). Teaching evidence-based interventions: perceptions of influences on use in professional practice in school psychology. Training and Education in Professional Psychology, 3(4), 226–232.CrossRefGoogle Scholar
  13. Forman, S. G., Fagley, N. S., Chu, B. C., & Walkup, J. T. (2012). Factors influencing school psychologists’ “willingness to implement” evidence-based interventions. School Mental Health, 4(4), 207–218.CrossRefGoogle Scholar
  14. Hicks, T. B., Shahidullah, J. D., Carlson, J. S., & Palejwala, M. H. (2014). Nationally certified school psychologists’ use and reported barriers to using evidence-based interventions in schools: the influence of graduate program training and education. School Psychology Quarterly, 29(4), 469–487.CrossRefPubMedGoogle Scholar
  15. Hosp, J. L., & Reschly, D. J. (2002). Regional differences in school psychology practice. School Psychology Review, 31(1), 11–29.Google Scholar
  16. Josefson, D. (2001). Rebirthing therapy banned after girl died in 70 minute struggle. British Medical Journal, 322, 1014.CrossRefPubMedCentralGoogle Scholar
  17. Joyce-Beaulieu, D., & Sulkowski, M. L. (2015). Cognitive behavioral therapy in K-12 school settings: a practitioner’s toolkit. New York: Springer.Google Scholar
  18. Kendall, P. C., & Beidas, R. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: flexibility within fidelity. Professional Psychology: Research and Practice, 38(1), 13–20.CrossRefGoogle Scholar
  19. Kettlewell, P., Morford, M. E., & Hoover, H. (2005). Evidence-based treatment: what is it and how can it help children. Harrisburg: Office of Mental Health and Substance Abuse Services.Google Scholar
  20. Kim, J. S. (2007). Examining the effectiveness of solution-focused brief therapy: a meta-analysis. Research on Social Work Practice, 18(2), 107–116.CrossRefGoogle Scholar
  21. Kim, J. S., & Franklin, C. (2009). Solution-focused brief therapy in schools: a review of the outcome literature. Children and Youth Services Review, 31(4), 464–470.CrossRefGoogle Scholar
  22. Kim, J. S., Franklin, C., Zhang, Y., Liu, X., Qu, Y., & Chen, H. (2015). Solution-focused brief therapy in China: a meta-analysis. Journal of Ethnic & Cultural Diversity in Social Work, 24(3), 187–201.CrossRefGoogle Scholar
  23. Knapp, P., Kieling, C., & Beck, A. T. (2015). What do psychotherapists do? A systematic review and meta-regression of surveys. Psychotherapy and Psychosomatics, 84(6), 377–378.CrossRefPubMedGoogle Scholar
  24. Koocher, G. P., McMann, M. R., Stout, A. O., & Norcross, J. C. (2015). Discredited assessment and treatment methods used with children and adolescents: a Delphi poll. Journal of Clinical Child & Adolescent Psychology, 44(5), 722–729.CrossRefGoogle Scholar
  25. Kratochwill, T. R., & Shernoff, E. S. (2004). Evidence-based practice: promoting evidence-based interventions in school psychology. School Psychology Review, 33(1), 34–48.Google Scholar
  26. Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The sources of four commonly reported cutoff criteria—what did they really say? Organizational Research Methods, 9(2), 202–220.CrossRefGoogle Scholar
  27. Lilienfeld, S. O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science, 2(1), 53–70.CrossRefPubMedGoogle Scholar
  28. Lilienfeld, S. O., Ammirati, R., & David, M. (2012). Distinguishing science from pseudoscience in school psychology: science and scientific thinking as safeguards against human error. Journal of School Psychology, 50(1), 7–36.CrossRefPubMedGoogle Scholar
  29. Lilienfeld, S. O., Lynn, S. J., & Lohr, J. M. (Eds.). (2015). Science and pseudoscience in clinical psychology. New York: Guilford.Google Scholar
  30. Little, S., Little, A., Petersen, C., Ferguson, S., Blair, M., & Selzler, C. (2014). Innovation in training school psychology students in RTI: university-school partnerships. Journal of Psychology and Behavioral Science, 2(1), 51–62.Google Scholar
  31. Liu, S., & Oakland, T. (2016). The emergence and evolution of school psychology literature: a scientometric analysis from 1907 through 2014. School Psychology Quarterly, 31(1), 104–121.CrossRefPubMedGoogle Scholar
  32. Lohr, J. M., Gist, R., Deacon, B., Devilly, G. J., & Varker, T. (2015). Science- and non-science-based treatments for trauma-related stress disorders. In S. O. Lilienfeld, S. J. Lynn, & J. M. Lohr (Eds.), Science and pseudoscience in clinical psychology (pp. 277–321). New York: Guilford.Google Scholar
  33. Luebbe, A. M., Radcliffe, A. M., Callands, T. A., Green, D., & Thorn, B. E. (2007). Evidence-based practice in psychology: perceptions of graduate students in scientist–practitioner programs. Journal of Clinical Psychology, 63(7), 643–655.CrossRefPubMedGoogle Scholar
  34. McKevitt, B. C. (2012). School psychologists’ knowledge and use of evidence based, social-emotional learning interventions. Contemporary School Psychology, 16, 33–45.Google Scholar
  35. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46(4), 806–834.CrossRefGoogle Scholar
  36. Miller, V. A., Schreck, K. A., Mulick, J. A., & Butter, E. (2012). Factors related to parents’ choices of treatments for their children with autism spectrum disorders. Research in Autism Spectrum Disorders, 6(1), 87–95.CrossRefGoogle Scholar
  37. National Association of School Psychologists (NASP). (2010a). NASP practice model: improving outcomes for students and schools. Retrieved from http://www.nasponline.org/assets/Documents/Standards%20and%20Certification/Standards/2_PracticeModel.pdf Accessed 20.06.16.
  38. National Association of School Psychologists (NASP). (2010b). Principles for professional ethics. Washington, DC: Author.Google Scholar
  39. National Association of School Psychologists (NASP). (2010c). Standards for graduate preparation of school psychologists. Bethesda: Author.Google Scholar
  40. National Association of School Psychologists (NASP). (2015). School psychologists: qualified health professionals providing child and adolescent mental and behavioral health services [white paper]. Bethesda: Author.Google Scholar
  41. Nickerson, A. B., Pagliocca, P. M., & Palladino, S. (2012). Research and evaluation needs for crisis intervention. In S. E. Brock & S. R. Jimerson (Eds.), Best practices in school crisis prevention and intervention (pp. 701–730). Bethesda: National Association of School Psychologists.Google Scholar
  42. Norcross, J. C., Koocher, G. P., & Garofalo, A. (2006). Discredited psychological treatments and tests: a Delphi poll. Professional Psychology: Research and Practice, 37(5), 515–522.CrossRefGoogle Scholar
  43. Norcross, J. C., Koocher, G. P., Fala, N. C., & Wexler, H. K. (2010). What does not work? Expert consensus on discredited treatments in the addictions. Journal of Addiction Medicine, 4(3), 174–180.CrossRefPubMedGoogle Scholar
  44. Ortiz, S. O., & Voutsinas, M. (2012). Cultural considerations in crisis intervention. In S. E. Brock & S. R. Jimerson (Eds.), Best practices in school crisis prevention and intervention (pp. 337–358). Bethesda: National Association of School Psychologists.Google Scholar
  45. Pignotti, M., & Thyer, B. A. (2009). Use of novel unsupported and empirically supported therapies by licensed clinical social workers: an exploratory study. Social Work Research, 33(1), 5–17.CrossRefGoogle Scholar
  46. Prout, H. T., Alexander, S. P., Fletcher, C. E., Memis, J. P., & Miller, D. W. (1993). Counseling and psychotherapy services provided by school psychologists: An analysis of patterns in practice. Journal of School Psychology, 31(2), 309–316.Google Scholar
  47. Ray, D. C., Armstrong, S. A., Balkin, R. S., & Jayne, K. M. (2015). Child-centered play therapy in the schools: Review and meta-analysis. Psychology in the Schools, 52(2), 107–123.Google Scholar
  48. Rhule, D. M. (2005). Take care to do no harm: harmful interventions for youth problem behavior. Professional Psychology: Research and Practice, 36(6), 618–625.CrossRefGoogle Scholar
  49. Rousseau, D. M., & Gunia, B. C. (2016). Evidence-based practice: the psychology of EBP implementation. Annual Review of Psychology, 67, 667–692.CrossRefPubMedGoogle Scholar
  50. Shernoff, E. S., Kratochwill, T. R., & Stoiber, K. C. (2003). Training in evidence-based interventions (EBIs): what are school psychology programs teaching? Journal of School Psychology, 41, 467–483.CrossRefGoogle Scholar
  51. Sklare, G. B. (2014). Brief counseling that works: a solution-focused therapy approach for school counselors and other mental health professionals. Newbury Park: Corwin Press.Google Scholar
  52. Society for Clinical, Child, and Adolescent Psychiatry. (2015). Effective child therapy: evidence-based mental health treatment for children and adolescents. http://effectivechildtherapy.org/ Accessed 20.06.16.
  53. Thomas, A., & Grimes, J. (Eds.). (2008). Best practices in school psychology. Bethesda: National Association of School Psychologists.Google Scholar
  54. Wei, Y., Szumilas, M., & Kutcher, S. (2010). Effectiveness on mental health of psychological debriefing for crisis intervention in schools. Educational Psychology Review, 22(3), 339–347.CrossRefGoogle Scholar
  55. Zucker, S. (2004). Scientifically based research: NCLB and assessment. Harcourt Policy Report. Pearson Education. Harcourt Assessment, Inc. Retrieved from http://images.pearsonclinical.com/images/PDF/assessmentReports/ScientificallyBasedResearch.pdf. Accessed 9 Jan 2016.

Copyright information

© California Association of School Psychologists 2017

Authors and Affiliations

  • Brian A. Zaboski
    • 1
    Email author
  • Anna P. Schrack
    • 1
  • Diana Joyce-Beaulieu
    • 1
  • Jann W. MacInnes
    • 2
  1. 1.School of Special Education, School Psychology, & Early Childhood StudiesUniversity of FloridaGainesvilleUSA
  2. 2.School of Human Development and Organization StudiesUniversity of FloridaGainesvilleUSA

Personalised recommendations