Social Psychiatry and Psychiatric Epidemiology

, Volume 46, Issue 3, pp 219–229

Developing and comparing methods for measuring the content of care in mental health services

  • B. Lloyd-Evans
  • M. Slade
  • D. P. Osborn
  • R. Skinner
  • S. Johnson
Original Paper

DOI: 10.1007/s00127-010-0192-4

Cite this article as:
Lloyd-Evans, B., Slade, M., Osborn, D.P. et al. Soc Psychiatry Psychiatr Epidemiol (2011) 46: 219. doi:10.1007/s00127-010-0192-4

Abstract

Background

Measurement of what happens in mental health services is needed to describe services, identify variation in care provision and understand service outcomes. However, there is no consensus about appropriate methods or measures for content of care. Previous research has primarily used a single information source and prioritised staff over patient perspectives on content of care. This study aims to enhance understanding of how to measure content of care by developing and evaluating four instruments, each using a different measurement method.

Methods

Development is described by four instruments—CaSPAR, CaRICE, CCCQ-S and CCCQ-P—which use researcher observation, staff-report and patient-report to measure the intensity and nature of care at services. Inter-rater reliability of CaRICE and CCCQ-S was investigated. Concordance between staff and patient perspectives was explored through assessing inter-rater agreement of CCCQ-S and CCCQ-P questionnaires. The convergence of data from the measures collected in an inpatient multi-site study was investigated.

Results

CaRICE demonstrated good inter-rater reliability (κ = 0.71). CCCQ-S inter-rater reliability was poor. Concordance between staff and patient reports was low: there was a trend for patients to report less care received than staff reported had been provided. Results from CaSPAR, CaRICE and CCCQ-P exhibited divergence, indicating possible differences in patient, staff and researcher perspectives.

Discussion

Information about content of care should be sought as close as possible to the point of delivery. There may be differing, valid perspectives about care provided by services. Further development of methods to measure content of care is required. Meanwhile, a multi-methods approach should be adopted, which allows inclusion of different perspectives (specifically including the patient’s perspective) and triangulation of results from different measurement methods. CaSPAR, CaRICE and CCCQ-P can provide multi-perspective content of care measurement in inpatient services.

Keywords

Process measurementContent of careInpatientMental health services

Supplementary material

127_2010_192_MOESM1_ESM.doc (36 kb)
Supplementary material 1 (DOC 36 kb)

Copyright information

© Springer-Verlag 2010

Authors and Affiliations

  • B. Lloyd-Evans
    • 1
    • 2
  • M. Slade
    • 3
  • D. P. Osborn
    • 4
  • R. Skinner
    • 3
  • S. Johnson
    • 1
    • 2
  1. 1.Department of Mental Health SciencesUniversity College London (Bloomsbury Campus)LondonUK
  2. 2.Camden and Islington NHS Foundation TrustEarly Intervention ServiceLondonUK
  3. 3.Health Service and Population Research Department, Institute of PsychiatryKings College LondonLondonUK
  4. 4.Department of Mental Health Sciences, Royal Free HospitalUniversity College London (Hampstead Campus)LondonUK