Advertisement

The children’s services interview: validity and reliability

  • Tamsin Ford
  • Helena Hamilton
  • Sabina Dosani
  • Lisa Burke
  • Robert Goodman
ORIGINAL PAPER

Abstract

Background

The Children Service Interview was designed as a brief measure of service use related to mental health problems in Great Britain.

Method

We validated the Children’s Services Interview against medical records from a sample of 87 children, and assessed test–retest reliability from 25 parents completing two interviews. We examined criterion validity by looking at the service use patterns of children attending clinics for different types of disorders.

Results

The Children’s Services Interview showed high levels of face validity and moderate or better concordance with medical records as far as contacts were recorded in the case notes. Test–retest reliability was moderate or better apart from contacts with the voluntary sector, teachers, and the number and duration of appointments with some professionals.

Conclusion

The study suggests the Children’s Services Interview can extract moderately valid and reliable data on service use.

Declaration of interest

Tamsin Ford was supported by a Wellcome Clinical Training Fellowship in Health Services Research while completing this work.

Key words

child mental health service use validity reliability 

Abbreviations

CASA:

Child and Adolescent Assessment

SACA:

Service Assessment for Children and Adolescents

SCA-PI:

Services for Children and Adolescents – Parent Interview

C-CSRI:

Children’s version of the Client Services Receipt Inventory

MTA

Trial Multi-site Treatment for Attention Deficit Hyperactivity Disorder Trial

ICC:

Intraclass correlation coefficient

References

  1. 1.
    Arnold LE, Abikoff HB, Cantwell DP, et al. (1997) National Institute of Mental Health Collaborative Multimodal Treatment Study of children with ADHD (the MTA): design, challenges and choices. Arch Gen Psychiatry 54:865–870PubMedGoogle Scholar
  2. 2.
    Ascher BH, Farmer EMZ, Burns BJ, Angold A (1996) The Child and Adolescent Service and Assessment (CASA): description and psychometrics. J Emot Behav Disord 4:12–20Google Scholar
  3. 3.
    Bean DL, Leibowitx A, Rotherham-Borus MJ, et al (2000) False negative reporting and mental health services utilisation: parents’ reports about child and adolescent services. Ment Health Serv Res 2:239–249CrossRefGoogle Scholar
  4. 4.
    Beecham J, Knapp M (2001) Costing psychiatric interventions. In: Thornicroft G, Brewin C, Wing J (eds) Measuring mental health needs. Gaskell, LondonGoogle Scholar
  5. 5.
    Breda C (1996) Parent and institutional agreement on children’s use of mental health services. Eval Program Plann 19:165–173CrossRefGoogle Scholar
  6. 6.
    Costello EJ, Angold A, Burns BJ, et al. (1996) The Great Smoky Mountain Study of Youth; functional impairment and serious emotional disturbance. Arch Gen Psychiatry 53:1137–1143PubMedGoogle Scholar
  7. 7.
    Farmer EMZ, Angold A, Burns BJ, Costello EJ (1994) Reliability of self-reported service use: test-retest consistency of children’s responses to the Child and Adolescent Services Assessment (CASA). J Child Fam Stud 3:307–325CrossRefGoogle Scholar
  8. 8.
    Fendrich M, Johnson T, Wislar JS, Nageotte C (1999) Accuracy of parental mental health service reporting; results from a reverse record-check study. J Am Acad Child Adolesc Psychiatry 38:147–155PubMedCrossRefGoogle Scholar
  9. 9.
    Ford T, Goodman R, Meltzer H (2003) Service over 18 months among a nationally representative sample of British children with psychiatric disorder. Clin Child Psychol Psychiatry 8:37–51CrossRefGoogle Scholar
  10. 10.
    Green H, McGinnity A, Meltzer H, Ford T, Goodman R (2005) Mental health of children and young people in Great Britain, 2004. TSO, LondonGoogle Scholar
  11. 11.
    Health Advisory Service (1995) Together we stand: the commissioning, role and management of child and adolescent mental health services. HMSO, LondonGoogle Scholar
  12. 12.
    Hoagwood K, Horwittz S, Stiffman A, et al. (2000) Concordance between parent reports of children’s mental health services and service records: the services assessment for children and adolescents (SACA). J Child Fam Stud 9:315–331CrossRefGoogle Scholar
  13. 13.
    Hoagwood KE, Jensen PS, Arnold E, et al. (2004) Reliability of the Services for Children and Adolescents – Parent Interview. J Am Acad Child Adolesc Psychiatry 43:1345–1354CrossRefGoogle Scholar
  14. 14.
    Jensen AL, Weisz JR (2002) Assessing match and mismatch between practitioner generated and standardized interview-generated diagnoses for clinic referred children and adolescents. J Consult Clin Psychol 70:158–168PubMedCrossRefGoogle Scholar
  15. 15.
    Jensen PS, Hoagwood KE, Roper MS, et al. (2004) The services for Child and Adolescents – Parent Interview: development and performance characteristics. J Am Acad Child Adolesc Psychiatry 43:1334–1344PubMedCrossRefGoogle Scholar
  16. 16.
    Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRefGoogle Scholar
  17. 17.
    Leaf PJ, Alegria M, Cohen P, et al. (1996) Mental health service use in the community and school: results from the four-community MECA study. J Am Acad Child Adolesc Psychiatry 35:889–897PubMedCrossRefGoogle Scholar
  18. 18.
    McCue-Horwitz S, Hoagwood K, Stiffman A, et al. (2001) Reliability of the services assessment for children and adolescents. Psychiatr Serv 52:1088–1094CrossRefGoogle Scholar
  19. 19.
    Meltzer H, Gatward R, Goodman R, Ford T (2000) Mental health of children and adolescents in Great Britain. The Stationery Office, LondonGoogle Scholar
  20. 20.
    Meltzer H, Gatward R, Bumpstead R, Goodman R, Ford T (2001) The mental health of children and adolescents in Great Britain in 2000. Report to the Department of HealthGoogle Scholar
  21. 21.
    Meltzer H, Gatward R, Corbin T, Goodman R, Ford T (2003) Persistence, onset, risk factors and outcome of childhood mental disorders. The Stationery Office, LondonGoogle Scholar
  22. 22.
    Mirandola M, Bisoffi G, Bonizzato P, Amaddeo F (1999) Collecting psychiatric resources utilisation data to calculate costs of care: a comparison between a service receipt interview and a case register. Soc Psychiatry Psychiatr Epidemiol 34:541–547PubMedCrossRefGoogle Scholar
  23. 23.
    Spitznagel EL, Helzer JE (1995) Proposed solution to the base rate problem in the Kappa statistic. Arch Gen Psychiatry 42:725–728Google Scholar
  24. 24.
    Stiffman AR, Horwitz SM, Hoagwood K, et al. (2000) The service assessment for children and adolescents (SACA). Adult and child reports. J Am Acad Child Adolesc Psychiatry 39:1032–1039PubMedCrossRefGoogle Scholar

Copyright information

© Steinkopff Verlag Darmstadt 2006

Authors and Affiliations

  • Tamsin Ford
    • 1
    • 3
  • Helena Hamilton
    • 1
  • Sabina Dosani
    • 2
  • Lisa Burke
    • 2
  • Robert Goodman
    • 1
  1. 1.Kings College London, Institute of PsychiatryLondonUK
  2. 2.South London and Maudsley NHS TrustLondonUK
  3. 3.Box 085: Dept. of Child and Adolescent PsychiatryInstitute of PsychiatryLondonUK

Personalised recommendations