Factors Influencing Consumer Outcome Monitoring in Implementation of Evidence-Based Practices: Results from the National EBP Implementation Project

  • Doug Marty
  • Charlie Rapp
  • Greg McHugo
  • Rob Whitley
Original Paper


Objective This study reports participating agencies use of a single fidelity dimension, Outcome Monitoring, during the 2-year National EBP Implementation Project. Method The study involved an emerging theme qualitative approach for analyzing the implementation of fidelity achieved for five EBPs in 49 sites across eight states. Results Twenty-seven percent of the sites reached a high level of implementation fidelity. Conclusion Results suggest that four interrelated factors contributed to whether agencies successfully implemented Outcome Monitoring-agency data collection methods, agency culture, practitioner skill, and how well “consumer outcomes” are defined.


Mental illness Evidence Based Practice (EBPs) Community Mental Health Center Outcome monitoring Case management 


  1. Alvero, A. M., Bucklin, B. R., & Austin, J. (2001). An objective review of the effectiveness and essential characteristics of performance feedback in organizational settings (1985–1998). Journal of Organizational Behavior Management, 21(1), 3–29.CrossRefGoogle Scholar
  2. Blank, M. B., Koch, J. R., Burkett, B. J., & Goldman, H. H., (2004). Less is more: Virginia’s performance outcomes measurement system. Psychiatric Services, 55(6), 643–645.PubMedCrossRefGoogle Scholar
  3. Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H.-W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.PubMedCrossRefGoogle Scholar
  4. Carlson, L. S., & Rapp, C. A. (2007). Basic supervisor’s training manual. Lawrence: The University of Kansas School of Social Welfare.Google Scholar
  5. Consumer Outcome Monitoring Package (COMP) (2003). [On-line] Available: Accessed May 2007.
  6. Gowdy, E., & Rapp, C. A. (1989). Managerial behavior: The common denominators of effective community-based programs. Psychosocial Rehabilitation Journal, 13(2), 31–51.Google Scholar
  7. Harkness, D. (1997). Testing interactional social work theory: A panel analysis of supervised practice and outcomes. Clinical Supervisor, 15(1), 33–50.Google Scholar
  8. Malterud, K. (2001) Qualitative research: Standards, challenges, and guidelines. Lancet, 358, 483–488.PubMedCrossRefGoogle Scholar
  9. McHugo G. J., Drake R. E., Whitley, R. et al. (2007) Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services.Google Scholar
  10. Miles, M. B., & Huberman, A. M. (Eds.) (2002). The qualitative researcher’s companion. Thousand Oaks, CA: Sage Publications.Google Scholar
  11. Mueser, K. T., & Drake, R. E. (2005). How does a practice become evidence-based? In R. E. Drake, M. R. Merrens & D. W. Lynde (Eds.), Evidence-based mental health practice: A textbook (pp. 217–241). New York: W.W. Norton.Google Scholar
  12. Nadler, D. A. (1977). Feedback and organization development. Using data based methods. Reading: Addison-Wesley.Google Scholar
  13. Office of Management and Budget (2007). [On-line]. Available: Accessed May 2007.
  14. Patti, R. J., (1985). In search of purpose for social welfare administration. Administration in Social Work, 9(3), 1–14.CrossRefGoogle Scholar
  15. Poertner, J., & Rapp, C. A. (2007). Textbook of social administration: The consumer-centered approach, 2nd edn. New York: Haworth Press.Google Scholar
  16. Rapp, C. A., & Poertner, J. (1992). Social administration: A client-centered approach. White Plains: Longman Publishing Group.Google Scholar
  17. SAMHSA (2007). Using general organizational index for evidence-based practices. [On-line]. Available: Accessed May 2007.
  18. Taylor, M. S. (1987). The effects of feedback on the behavior of organizational personnel. Administration in Social Work, 11(3/4), 191–203.Google Scholar
  19. Taylor, M. S., Fisher, C. D., & Ilgen, D. R. (1984). Individuals’ reaction to performance feedback in organizations: Control theory perspective. In K. M. Rowland & G. R. Ferris (Eds.), Research in personnel and human resource management (Vol. 2, pp. 81–124). Greenwich: JAI.Google Scholar
  20. Torrey, W. C., Finnerty, M., Evans, A., & Wyzik, P. E. (2003). Strategies for leading the implementation of evidence-based practices. Psychiatric Clinics of North America, 26, 883–897.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Doug Marty
    • 1
  • Charlie Rapp
    • 1
  • Greg McHugo
    • 2
  • Rob Whitley
    • 2
  1. 1.School of Social Welfare, Office of Adult Mental HealthThe University of KansasLawrenceUSA
  2. 2.Department of Psychiatry at the Dartmouth Psychiatric Research CenterLebanonUSA

Personalised recommendations