The children’s services interview: validity and reliability

Abstract

Background

The Children Service Interview was designed as a brief measure of service use related to mental health problems in Great Britain.

Method

We validated the Children’s Services Interview against medical records from a sample of 87 children, and assessed test–retest reliability from 25 parents completing two interviews. We examined criterion validity by looking at the service use patterns of children attending clinics for different types of disorders.

Results

The Children’s Services Interview showed high levels of face validity and moderate or better concordance with medical records as far as contacts were recorded in the case notes. Test–retest reliability was moderate or better apart from contacts with the voluntary sector, teachers, and the number and duration of appointments with some professionals.

Conclusion

The study suggests the Children’s Services Interview can extract moderately valid and reliable data on service use.

Declaration of interest

Tamsin Ford was supported by a Wellcome Clinical Training Fellowship in Health Services Research while completing this work.

This is a preview of subscription content, log in to check access.

Abbreviations

CASA::

Child and Adolescent Assessment

SACA::

Service Assessment for Children and Adolescents

SCA-PI::

Services for Children and Adolescents – Parent Interview

C-CSRI::

Children’s version of the Client Services Receipt Inventory

MTA:

Trial Multi-site Treatment for Attention Deficit Hyperactivity Disorder Trial

ICC::

Intraclass correlation coefficient

References

  1. 1.

    Arnold LE, Abikoff HB, Cantwell DP, et al. (1997) National Institute of Mental Health Collaborative Multimodal Treatment Study of children with ADHD (the MTA): design, challenges and choices. Arch Gen Psychiatry 54:865–870

    PubMed  CAS  Google Scholar 

  2. 2.

    Ascher BH, Farmer EMZ, Burns BJ, Angold A (1996) The Child and Adolescent Service and Assessment (CASA): description and psychometrics. J Emot Behav Disord 4:12–20

    Google Scholar 

  3. 3.

    Bean DL, Leibowitx A, Rotherham-Borus MJ, et al (2000) False negative reporting and mental health services utilisation: parents’ reports about child and adolescent services. Ment Health Serv Res 2:239–249

    Article  Google Scholar 

  4. 4.

    Beecham J, Knapp M (2001) Costing psychiatric interventions. In: Thornicroft G, Brewin C, Wing J (eds) Measuring mental health needs. Gaskell, London

    Google Scholar 

  5. 5.

    Breda C (1996) Parent and institutional agreement on children’s use of mental health services. Eval Program Plann 19:165–173

    Article  Google Scholar 

  6. 6.

    Costello EJ, Angold A, Burns BJ, et al. (1996) The Great Smoky Mountain Study of Youth; functional impairment and serious emotional disturbance. Arch Gen Psychiatry 53:1137–1143

    PubMed  CAS  Google Scholar 

  7. 7.

    Farmer EMZ, Angold A, Burns BJ, Costello EJ (1994) Reliability of self-reported service use: test-retest consistency of children’s responses to the Child and Adolescent Services Assessment (CASA). J Child Fam Stud 3:307–325

    Article  Google Scholar 

  8. 8.

    Fendrich M, Johnson T, Wislar JS, Nageotte C (1999) Accuracy of parental mental health service reporting; results from a reverse record-check study. J Am Acad Child Adolesc Psychiatry 38:147–155

    PubMed  Article  CAS  Google Scholar 

  9. 9.

    Ford T, Goodman R, Meltzer H (2003) Service over 18 months among a nationally representative sample of British children with psychiatric disorder. Clin Child Psychol Psychiatry 8:37–51

    Article  Google Scholar 

  10. 10.

    Green H, McGinnity A, Meltzer H, Ford T, Goodman R (2005) Mental health of children and young people in Great Britain, 2004. TSO, London

    Google Scholar 

  11. 11.

    Health Advisory Service (1995) Together we stand: the commissioning, role and management of child and adolescent mental health services. HMSO, London

    Google Scholar 

  12. 12.

    Hoagwood K, Horwittz S, Stiffman A, et al. (2000) Concordance between parent reports of children’s mental health services and service records: the services assessment for children and adolescents (SACA). J Child Fam Stud 9:315–331

    Article  Google Scholar 

  13. 13.

    Hoagwood KE, Jensen PS, Arnold E, et al. (2004) Reliability of the Services for Children and Adolescents – Parent Interview. J Am Acad Child Adolesc Psychiatry 43:1345–1354

    Article  Google Scholar 

  14. 14.

    Jensen AL, Weisz JR (2002) Assessing match and mismatch between practitioner generated and standardized interview-generated diagnoses for clinic referred children and adolescents. J Consult Clin Psychol 70:158–168

    PubMed  Article  Google Scholar 

  15. 15.

    Jensen PS, Hoagwood KE, Roper MS, et al. (2004) The services for Child and Adolescents – Parent Interview: development and performance characteristics. J Am Acad Child Adolesc Psychiatry 43:1334–1344

    PubMed  Article  Google Scholar 

  16. 16.

    Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174

    PubMed  Article  CAS  Google Scholar 

  17. 17.

    Leaf PJ, Alegria M, Cohen P, et al. (1996) Mental health service use in the community and school: results from the four-community MECA study. J Am Acad Child Adolesc Psychiatry 35:889–897

    PubMed  Article  CAS  Google Scholar 

  18. 18.

    McCue-Horwitz S, Hoagwood K, Stiffman A, et al. (2001) Reliability of the services assessment for children and adolescents. Psychiatr Serv 52:1088–1094

    Article  Google Scholar 

  19. 19.

    Meltzer H, Gatward R, Goodman R, Ford T (2000) Mental health of children and adolescents in Great Britain. The Stationery Office, London

    Google Scholar 

  20. 20.

    Meltzer H, Gatward R, Bumpstead R, Goodman R, Ford T (2001) The mental health of children and adolescents in Great Britain in 2000. Report to the Department of Health

  21. 21.

    Meltzer H, Gatward R, Corbin T, Goodman R, Ford T (2003) Persistence, onset, risk factors and outcome of childhood mental disorders. The Stationery Office, London

    Google Scholar 

  22. 22.

    Mirandola M, Bisoffi G, Bonizzato P, Amaddeo F (1999) Collecting psychiatric resources utilisation data to calculate costs of care: a comparison between a service receipt interview and a case register. Soc Psychiatry Psychiatr Epidemiol 34:541–547

    PubMed  Article  CAS  Google Scholar 

  23. 23.

    Spitznagel EL, Helzer JE (1995) Proposed solution to the base rate problem in the Kappa statistic. Arch Gen Psychiatry 42:725–728

    Google Scholar 

  24. 24.

    Stiffman AR, Horwitz SM, Hoagwood K, et al. (2000) The service assessment for children and adolescents (SACA). Adult and child reports. J Am Acad Child Adolesc Psychiatry 39:1032–1039

    PubMed  Article  CAS  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Tamsin Ford.

Appendix

Appendix

figure1figure1figure1figure1figure1

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Ford, T., Hamilton, H., Dosani, S. et al. The children’s services interview: validity and reliability. Soc Psychiat Epidemiol 42, 36–49 (2007). https://doi.org/10.1007/s00127-006-0092-9

Download citation

Key words

  • child mental health
  • service use
  • validity
  • reliability