Skip to main content

Advertisement

Log in

The development of the child and adolescent versions of the Verona Service Satisfaction Scale (CAMHSSS)

  • ORIGINAL PAPER
  • Published:
Social Psychiatry and Psychiatric Epidemiology Aims and scope Submit manuscript

Abstract

Background

There is a shortage of comprehensive and validated instruments to measure satisfaction with Child and Adolescent Mental Health Services (CAMHS). This study chose the Verona Service Satisfaction Scale (VSSS as a template for the development of a new CAMHS Satisfaction Scale (CAMHSSS).

Method

The new questionnaires were developed by involving service users and members of the multidisciplinary team in several stages. The psychometric qualities of the 39-item draft were tested on a random sample.

Results

A total of 56 adolescents and 104 parents participated in the study. The acceptability of the questionnaires was excellent, and internal consistency was high. Test-retest reliability was between substantial to moderate for individual items, and high for the seven dimension and the final versions of the scale. The questionnaires differentiated well between satisfied and dissatisfied service users.

Conclusions

Two versions were generated to measure service satisfaction among outpatients (CAMHSSS-39 and 20) and one for inpatients and day-patients (CAMHSSS-Unit). All have good psychometric properties and can be recommended for future studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Attkinson CC, Greenfield TK (1996) The Client Satisfaction Questionnaire (CSQ) scales and the Service Satisfaction Scale-30 (SSS-30). In: Sederer LI, Dickey B (eds) Outcomes assessment in clinical practice. Williams and Wilkins, Baltimore

  2. Attride-Stirling J (2004) Development and methods to capture users’ view of child and adolescent mental health services in clinical governance reviews. A Project evaluation report. http://www.chi nhs uk/eng/cgr/mental_health/index.shtml

  3. Bradley EJ, Clark BS (1993) Patients’ characteristics and consumer satisfaction on an inpatient child psychiatric unit. Can J Psychiatry 38:175–180

    PubMed  CAS  Google Scholar 

  4. Brannan A, Sonnichesen E, Heflinger C (1996) Measuring satisfaction with children’s mental health services: validity and reliability of the satisfaction scales. Eval Program Plann 19:131–141

    Article  Google Scholar 

  5. Copeland VC, Koeske G, Greeno CG (2004) Child and mother client satisfaction questionnaire scores regarding mental health services: race, age, and gender correlates. Res Soc Work Pract 14:434–442

    Article  Google Scholar 

  6. Corbiere M, Lesage A, Lauzon S, Ricard N, Reinharz D (2003) French validation of the Verona Service Satisfaction Scale-VSSS-54F. Encephale 29 110–118

    PubMed  CAS  Google Scholar 

  7. Cronbach LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16:297–334

    Article  Google Scholar 

  8. Department of Health (2000) The NHS plan—a plan for investment. A plan for reform

  9. Dogra N (2000) Adolescent perspectives on the provision of services for their mental health needs. Eur Child Adolesc Psychiatry 9:70–73

    Article  PubMed  CAS  Google Scholar 

  10. Elbeck M, Fecteau G (1990) Improving the validity of measures of patient satisfaction with psychiatric care and treatment. Hosp Commun Psychiatry 41:998–1001

    CAS  Google Scholar 

  11. Garland AF, Aarons GA, Hawley KM, Hough RL (2003) Relationship of youth satisfaction with mental health services and changes in symptoms and functioning. Psychiatr Serv 54:1544–1546

    Article  PubMed  Google Scholar 

  12. Garland AF, Aarons GA, Saltzman MD, Kruse MI (2000) Correlates of adolescents’ satisfaction with mental health services. Ment Health Serv Res 2:127–139

    Article  PubMed  CAS  Google Scholar 

  13. Gowers SG, Harrington RC, Whitton A, Lelliott P, Beevor A, Wing J, Jezzard R (1999) Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA). Br J Psychiatry 174:413–416

    PubMed  CAS  Google Scholar 

  14. Henderson C, Hales H, Ruggeri M (2003) Cross-cultural differences in the conceptualisation of patients’ satisfaction with psychiatric services–content validity of the English version of the Verona Service Satisfaction Scale. Soc Psychiatry Psychiatr Epidemiol 38:142–148

    Article  PubMed  Google Scholar 

  15. Henderson C, Phelan M, Loftus L, Dall’Agnola R, Ruggeri M (1999) Comparison of patient satisfaction with community-based vs. hospital psychiatric services. Acta Psychiatr Scand 99:188–195

    Article  PubMed  CAS  Google Scholar 

  16. Keller F, Konopka L, Fegert JM, Naumann A (2003) Patient satisfaction of adolescents during in-patient psychiatric treatment: a process-oriented approach. Nervenheilkunde 22

  17. Lazaratou H, Anagnostopoulos DC, Vlassopoulos M, Tzavara C, Zelios G (2006) Treatment compliance and early termination of therapy: a comparative study. Psychother Psychosom 75:113–121

    Article  PubMed  Google Scholar 

  18. Mory C, Matschinger H, Roick C, Kilian R, Bernert S, Angermeyer MC (2001) The German adaptation of the Verona Service Satisfaction Scale: an instrument for patients’ satisfaction with mental health care. Psychiatrische Praxis 28(Suppl 2):S91–S96

    Article  PubMed  Google Scholar 

  19. Parkman S, Davies S, Leese M, Phelan M, Thornicroft G (1997) Ethnic differences in satisfaction with mental health services among representative people with psychosis in south London: PRiSM study 4.[see comment]. Br J Psychiatry 171:260–264

    Article  PubMed  CAS  Google Scholar 

  20. Rey JM, Singh M, Hung SF, Dossetor DR, Newman L, Plapp JM, Bird KD (1997) A global scale to measure the quality of the family environment. Arch Gen Psychiatry 54:817–822

    PubMed  CAS  Google Scholar 

  21. Ruggeri M (1994) Patients’ and relatives’ satisfaction with psychiatric services: the state of the art of its measurement. Soc Psychiatry Psychiatr Epidemiol 29:212–227

    Article  PubMed  CAS  Google Scholar 

  22. Ruggeri M, Dall’Agnola R (1993) The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med 23:511–523

    Article  PubMed  CAS  Google Scholar 

  23. Ruggeri M, Dall’Agnola R, Agostini C, Bisoffi G (1994) Acceptability, sensitivity and content validity of the VECS and VSSS in measuring expectations and satisfaction in psychiatric patients and their relatives. Soc Psychiatry Psychiatr Epidemiol 29:265–276

    Article  PubMed  CAS  Google Scholar 

  24. Ruggeri M, Dall’Agnola R, Bisoffi G (1996) Factor analysis of the Verona Service Satisfaction Scale-82 and the development of reduced versions. Int J Methods Psychiatr Res 6:23–28

    Article  Google Scholar 

  25. Ruggeri M, Lasalvia A, Bisoffi G, Thornicroft G, Vazquez-Barquero JL, Becker T, Knapp M, Knudsen HC, Schene A, Tansella M (2003) Satisfaction with mental health services among people with schizophrenia in five European sites: results from the EPSILON Study. Schizophr Bull 29:229–245

    PubMed  Google Scholar 

  26. Ruggeri M, Lasalvia A, Dall’Agnola R, Van WB, Knudsen HC, Leese M, Gaite L, Tansella M (2000) Development, internal consistency and reliability of the Verona Service Satisfaction Scale–European Version. EPSILON Study 7. European Psychiatric Services: inputs linked to outcome domains and needs. Br J Psychiatry Suppls41–s48

  27. Ruggeri M, Salvi G, Perwanger V, Phelan M, Pellegrini N, Parabiaghi A (2006) Satisfaction with community and hospital-based emergency services amongst severely mentally ill service users: a comparison study in South-Verona and South-London. Soc Psychiatry Psychiatr Epidemiol 41:302–309

    Article  PubMed  Google Scholar 

  28. Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S (1983) A children’s global assessment scale (CGAS). Arch Gen Psychiatry 40:1228–1231

    PubMed  CAS  Google Scholar 

  29. Shapiro JP, Welker CJ, Jacobson BJ (1997) The youth client satisfaction questionnaire: development, construct validation, and factor structure. J Clin Child Psychol 26:87–98

    Article  PubMed  CAS  Google Scholar 

  30. Shipley K, Hilborn B, Hansell A, Tyrer J, Tyrer P (2000) Patient satisfaction: a valid index of quality of care in a psychiatric service. Acta Psychiatr Scand 101:330–333

    Article  PubMed  CAS  Google Scholar 

  31. Slater V, Linn MW, Harris R (1982) A satisfaction with mental health care scale. Compr Psychiatry 23

  32. SPSS Inc (1999) Statistical package for social sciences for windows

  33. Stallard P (1995) Parental satisfaction with intervention: differences between respondents and non-respondents to a postal questionnaire. Br J Clin Psychol 34:397–405

    PubMed  Google Scholar 

  34. Stallard P (1996) Validity and reliability of the parent satisfaction questionnaire. Br J Clin Psychol 35:311–318

    PubMed  Google Scholar 

  35. Stallard P (2001) Reducing parental dissatisfaction with a child and adolescent psychology service: a process of quality improvement. J Ment Health 10:63–73

    Article  Google Scholar 

  36. Tischler V, Vostanis P, Bellerby T, Cumella S (2002) Evaluation of a mental health outreach service for homeless families. Arch Dis Child 86:158–163

    Article  PubMed  CAS  Google Scholar 

  37. Tyson P, Ayton A, Agib AOA, Bowie P, Worrall-Davies A, Mortimer A (2001) A comparison of the service satisfaction and intervention needs of patients with schizophrenia and their relatives. Int J Psychiatry Clin Pract 5:263–271

    Article  Google Scholar 

  38. Ware JE, Davies-Avery A, Stewart AL (1978) The measurement and meaning of patient satisfaction. Health Med Care Serv Rev 1:1–15

    PubMed  Google Scholar 

  39. Ware JE, Snyder MK, Wright WR, Davies AR (1983) Defining and measuring patient satisfaction with medical care. Eval Program Plann 6:247–263

    Article  PubMed  Google Scholar 

  40. Watt BD, Dadds MR (2007) Facilitating treatment attendance in child and adolescent mental health services: a community study. Clin Child Psychol Psychiatry 12:105–116

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

All participants; members of the multidisciplinary team at West End and at the Interagency Link Team; the participating child and adolescent psychiatrists; Dr Eric Gardiner, statistician; Dr Mirella Ruggeri. This study was funded by the Department of Health (Project Nu: RRCC273SG).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Agnes K. Ayton MD, MRCPsych, M.Med.Sc.

Appendix

Appendix

Appendix 1. VSSS-dimensions retained in the CAMHSSS versions
Appendix 2. Test-retest reliability using Cohen’s weighted kappa (n = 50) (0.81–1 perfect, 0.61–80 substantial, 0.41–60 moderate, <0.4 poor)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ayton, A.K., Mooney, M.P., Sillifant, K. et al. The development of the child and adolescent versions of the Verona Service Satisfaction Scale (CAMHSSS). Soc Psychiat Epidemiol 42, 892–901 (2007). https://doi.org/10.1007/s00127-007-0241-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00127-007-0241-9

Keywords

Navigation