Skip to main content

Advertisement

SpringerLink
Log in

The Peabody Treatment Progress Battery: History and Methods for Developing a Comprehensive Measurement Battery for Youth Mental Health

  • Original Paper
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

There is increased need for comprehensive, flexible, and evidence-based approaches to measuring the process and outcomes of youth mental health treatment. This paper introduces a special issue dedicated to the Peabody Treatment Progress Battery (PTPB), a battery of measures created to meet this need. The PTPB is an integrated set of brief, reliable, and valid instruments that can be administered efficiently at low cost and can provide systematic feedback for use in treatment planning. It includes eleven measures completed by youth, caregivers, and/or clinicians that assess clinically-relevant constructs such as symptom severity, therapeutic alliance, life satisfaction, motivation for treatment, hope, treatment expectations, caregiver strain, and service satisfaction. This introductory article describes the rationale for the PTPB and its development and evaluation, detailing the specific analytic approaches utilized by the different papers in the special issue and a description of the study and samples from which the participants were taken.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • Athay, M.M., (2012). The Satisfaction with Life Scale (SWLS) in caregivers of clinically-referred youth: Psychometric properties and mediation analysis. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0390-8.

  • Athay, M. M., & Bickman, L. (2012). Development and psychometric evaluation of the youth and caregiver Service Satisfaction Scale. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0407-y.

  • Athay, M.M., Kelley, S.D., & Dew-Reeves, S.E. (2012). Brief multidimensional students’ life satisfaction scale–PTPB Version (BMSLSS-PTPB): Psychometric properties and relationship with mental health symptoms over time. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0385-5.

  • Athay, M.M., Riemer, M., & Bickman, L. (2012). The symptoms and functioning severity scale (SFSS): Psychometric evaluation and discrepancies among youth, caregiver, and clinician ratings over time. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0403-2.

  • Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107(2), 238–246.

    Article  PubMed  CAS  Google Scholar 

  • Bickman, L., Karver, M., & Schut, L. J. A. (1997). Clinician reliability and accuracy in judging appropriate level of care. Journal of Consulting and Clinical Psychology, 65(3), 515–520.

    Article  PubMed  CAS  Google Scholar 

  • Bickman, L., Nurcombe, B., Townsend, C., Belle, M., Schut, J., & Karver, M. (1998). Consumer measurement systems for child and adolescent mental health. Canberra, ACT: Department of Health and Family Services. http://www.health.gov.au/hsdd/mentalhe.

  • Bickman, L., de Vides Andrade, A. R., Lambert, E. W., Doucette, A., Sapyta, J., Boyd, A. S., et al. (2004). Youth therapeutic alliance in intensive treatment settings. Journal of Behavioral Health Services and Research, 31(2), 134–148.

    PubMed  Google Scholar 

  • Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6(86–87), 93–94.

    Google Scholar 

  • Bickman, L., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Dew, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds.). (2007). Manual of the peabody treatment progress battery [Electronic version]. Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\.

  • Bickman, L., Athay, M.M., Riemer, M., Lambert, E.W., Kelley, S.D., Breda, C., Tempesti, T., Dew-Reeves, S.E., Brannan, A.M., Vides de Andrade, A.R. (eds). (2010). Manual of the peabody treatment progress battery, 2nd ed. [Electronic version]. Nashville: Vanderbilt University. http://peabody.vanderbilt.edu/ptpb\.

  • Bickman, L., Kelley, S., Breda, C., De Andrade, A., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62(12), 1423–1429.

    Article  PubMed  Google Scholar 

  • Bickman, L., Vides de Andrade, A. R., Athay, M. M., Chen, J. I., De Nadai, A. S., Jordan-Arthur, B., & Karver, M. S. (2012). The relationship between change in therapeutic alliance ratings and improvement in youth symptom severity: Whose ratings matter the most? Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-011-0398-0.

  • Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah: L. Erlbaum.

    Google Scholar 

  • Brannan, A. M., Heflinger, C. A., & Bickman, L. (1997). The caregiver strain questionnaire: Measuring the impact on the family of living with a child with serious emotional disturbance. Journal of Emotional and Behavioral Disorders, 5(4), 212–222.

    Article  Google Scholar 

  • Brannan, A. M., Athay, M. M., & Vides de Andrade, A. R. (2012). Measurement quality of the Caregiver Strain Questionnaire–Short Form 7 (CGSQ-SF7). Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0412-1.

  • Breda, C. S., & Riemer, M. (2012). Motivation for youth’s treatment scale (MYTS): A new tool for measuring motivation among youths and their caregivers. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0408-x.

  • Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.

    Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of accessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park: Sage.

    Google Scholar 

  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.

    Article  PubMed  CAS  Google Scholar 

  • Cronbach, L. J., & Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64(3), 391–418.

    Article  Google Scholar 

  • Dew-Reeves, S. E., & Athay, M. M. (2012). Validation and use of the youth and caregiver Treatment Outcome Expectations Scale (TOES) to assess the relationships between expectations, pretreatment characteristics, and outcomes. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0406-z.

  • Dew-Reeves, S. E., Athay, M. M., & Kelley, S. D. (2012). Validation and use of the Children’s Hope Scale-Revised PTPB Edition (CHS-PTPB): High initial youth hope and elevated baseline symptomatology predict poor treatment outcomes. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0411-2.

  • Goodman, R. (1999). The extended version of the strengths and difficulties questionnaire as a guide to child psychiatric caseness and consequent burden. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 40(5), 791–799.

    Article  CAS  Google Scholar 

  • Harlow, L. L. (2005). The essence of multivariate thinking. Mahwah: Lawrence Erlbaum Associates, Inc.

    Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.

    Article  Google Scholar 

  • Joreskog, K. G. (1988). Analysis of covariance structures. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 207–230). New York: Plenum Press.

    Chapter  Google Scholar 

  • Karver, M. S., & Bickman, L. (2002). Positive functioning: Does it add validity to maladaptive functioning items? Evaluation and Program Planning, 25(1), 85–93.

    Article  Google Scholar 

  • Karver, M. S., Handelsman, J. B., Fields, S., & Bickman, L. (2005). A theoretical model of common process factors in youth and family therapy. Mental Health Services Research, 7(1), 35–51.

    Article  PubMed  Google Scholar 

  • Kearns, M. A., Athay, M. M., & Riemer, M. (2012). Measuring youths’ perceptions of counseling impact: Description, psychometric evaluation, and longitudinal examination of the Youth Counseling Impact Scale v.2. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0414-z.

  • Kelley, S. D., de Vides Andrade, A. R., Sheffer, E., & Bickman, L. (2010). Exploring the black box: Measuring youth treatment process and progress in usual care. Administration and Policy in Mental Health and Mental Health Services Research, 37(3), 287–300. doi:10.1007/s10488-010-0298-8.

    Article  PubMed  Google Scholar 

  • Kelley, S. D., Vides de Andrade, A. R., Bickman, L., & Robin, A. (2012). The Session Report Form (SRF): Are clinicians addressing issues of concern to youth and caregivers? Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0415-y.

  • Knitzer, J. (1984). Mental health services to children and adolescents: A national view of public policies. American Psychologist, 39, 905–911.

    Article  PubMed  CAS  Google Scholar 

  • Lambert, M. J. (2005). Special section on the placebo concept in psychotherapy. Early response in psychotherapy: Further evidence for the importance of common factors rather than “placebo effects”. Journal of Clinical Psychology, 61(7), 855–869.

    Article  PubMed  Google Scholar 

  • Linacre, J. M. (2007). WINSTEPS® 3.63.0.[Computer software]. Retrieved Jan 8, 2007, from http://www.winsteps.com/index.htm.

  • Linacre, J. M., & Wright, B. D. (2006). WINSTEPS Rasch-model computer program (Version 3.47) [computer software]. Chicago: MESA Press.

    Google Scholar 

  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Pavot, W., & Diener, E. (1993). Review of the satisfaction with life scale. Psychological Assessment, 5(2), 164–172.

    Article  Google Scholar 

  • Riemer, M., & Kearns, M. A. (2010). Description and psychometric evaluation of the youth counseling impact scale. Psychological Assessment, 22(10), 259–268.

    Article  PubMed  Google Scholar 

  • Schmitt, J. S., & Di Fabio, R. P. (2004). Reliable change and minimum important difference (MID) proportions facilitated group responsiveness comparisons using individual threshold criteria. Journal of Clinical Epidemiology, 57, 1008–1018.

    Article  PubMed  Google Scholar 

  • Seligson, J., Huebner, E. S., & Valois, R. F. (2003). Preliminary validation of the brief multidimensional students’ life satisfaction scale (BMSLSS). Social Indicators Research, 61, 121–145.

    Article  Google Scholar 

  • Smith, C. M., Breda, C. B., Simmons, T. M., Lambert, E. W., & Bickman, L. (2009). Data preparation and data standards: The devil is in the details. In A. R. Stiffman (Ed.), The field research survival guide (pp. 82–103). New York: Oxford University.

    Chapter  Google Scholar 

  • Snyder, C. R., Hoza, B., Pelham, W. E., Rapoff, M., Ware, L., Danovsky, M., et al. (1997). The development and validation of the Children’s Hope Scale. Journal of Pediatric Psychology, 22(3), 399–421.

    Article  PubMed  CAS  Google Scholar 

  • Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3, 171–195.

    Google Scholar 

  • Steiger, J. H. (2000). Point estimation, hypothesis testing, and interval estimation using the RMSEA: Some comments and a reply to Hayduck and Glaser. Structural Equation Modeling A Multidisciplinary Journal, 72(2), 149–162.

    Article  Google Scholar 

  • Wells, M. G., Burlingame, G. M., & Lambert, M. J. (1999). Youth outcome questionnaire. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcome assessment (2nd ed.). Mahwah: Lawrence Erlbaum.

    Google Scholar 

  • Wright, B.D., & Linacre, J.M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8, 370. Retrieved March 10, 2011 from www.rasch.org/rmt/rmt83b.htm.

  • Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation, University of California, Los Angeles, 2002). (UMI ProQuest ATT 3066425).

Download references

Acknowledgment

This research was supported by NIMH grants R01-MH068589 and 4264600201 awarded to Leonard Bickman. We would like to thank the clinicians, youth and caregivers for providing us with these data and the Providence Service Corporation for their enthusiastic participation over several years to gather this information. Finally, thanks to Sarah (Sally) Horwitz for serving as action editor for this volume.

Author information

Authors and Affiliations

  1. Department of Psychology, Wilfrid Laurier University, Waterloo, Canada

    Manuel Riemer

  2. Center for Evaluation and Program Improvement, Vanderbilt University, Peabody #151, 230 Appleton Place, Nashville, TN, 37203, USA

    M. Michele Athay, Leonard Bickman, Carolyn Breda, Susan Douglas Kelley & Ana R. Vides de Andrade

Authors
  1. Manuel Riemer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. Michele Athay
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leonard Bickman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carolyn Breda
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Susan Douglas Kelley
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ana R. Vides de Andrade
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to M. Michele Athay.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Riemer, M., Athay, M.M., Bickman, L. et al. The Peabody Treatment Progress Battery: History and Methods for Developing a Comprehensive Measurement Battery for Youth Mental Health. Adm Policy Ment Health 39, 3–12 (2012). https://doi.org/10.1007/s10488-012-0404-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-012-0404-1

Keywords

Search

Navigation