Abstract
Background
Child and adolescent mental health service units (CAMHS) play an important role in the supply of services to children and adolescents with mental illness. The purpose of this study was to examine the service unit effect on parent satisfaction with outpatient treatment.
Method
The study was undertaken in 49 of 72 Norwegian outpatient CAMHS in 2004. A total of 2253 of the parents who were asked to participate (87%) responded. Parent satisfaction was measured using two summated scales: clinician interaction/information and treatment outcome. Multilevel analyses were used to assess the contribution of the service units to satisfaction and to investigate patient level predictors of parent satisfaction.
Results
About 96−98% of the parent satisfaction variance could be attributed to factors within CAMHS, leaving only 2–4% of the variance attributable to the CAMHS level. Parents of patients aged 0–6 years were more satisfied than older patients’ parents. Longer treatment episodes were positively associated with satisfaction. Parents whose children had been referred with externalizing symptoms were less satisfied with treatment outcome than those referred for internalizing symptoms. Waiting time was negatively associated with treatment outcome satisfaction. Adjustments for patient characteristics did not substantially change the relative effect of CAMHS on satisfaction ratings.
Conclusion
The results indicate that information from user satisfaction surveys has clear limitations as an indicator of CAMHS quality. From a quality improvement perspective, the factors affecting the variance within CAMHS are of dominating importance compared to factors affecting between CAMHS variance.
Similar content being viewed by others
References
Andersson HW, Ose SO (2005) Mental health services for children and adolescents— therapists’ and users’ evaluations of services (in Norwegian). SINTEF Health, Trondheim
Ayton A, Mooney M, Sillifant K, Powls J, Rasool H (2007) The development of the child and adolescent versions of the verona service satisfaction scale (CAMHSSS). Soc Psych Psych Epid 42:892–901
Bjørngaard JH, Ruud T, Garratt A, Hatling T (2007) Patients’ experiences and clinicians’ ratings of the quality of outpatient teams in psychiatric care units in Norway. Psychiatr Serv 58:1102–1107
Bjørngaard JH, Ruud T, Friis S (2007) The impact of mental illness on patient satisfaction with the therapeutic relationship. Soc Psych Psych Epid 42:803–809
Brannan AM, Sonnichsen SE, Heflinger CA (1996) Measuring satisfaction with children’s mental health services: validity and reliability of the satisfaction scales. Eval Program Plann 19:131–141
Crow R, Gage H, Hampson S, Hart J, Kimber A, Storey L, Thomas H (2002) The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. HTA 6:1–244
Frank AF, Gunderson JG (1990) The role of the therapeutic alliance in the treatment of schizophrenia. Relationship to course and outcome. Arch Gen Psychiatry 47:228–236
Freeman T (2002) Using performance indicators to improve health care quality in the public sector: a review of the literature. Health Serv Manage 15:126–137
Friis S, Sundet K, Rund BR, Vaglum P, McGlashan TH (2002) Neurocognitive dimensions characterising patients with first-episode psychosis. Br J Psychiatry Suppl 43:s85–s90
Garland AF, Aarons GA, Saltzman MD, Kruse MI (2000) Correlates of adolescents’ satisfaction with mental health services. Ment Hlth Serv Res 2:127–139
Garland AF, Haine RA, Lewczyk Boxmeyer C (2007) Determinates of youth and parent satisfaction in usual care psychotherapy. Eval Program Plann 30:45–54
Garland AF, Saltzman MD, Aarons GA (2000) Adolescent satisfaction with mental health services: development of a multidimensional scale. Eval Program Plann 23:165–175
Garman AN, Corrigan PW, Morris S (2002) Staff burnout and patient satisfaction: evidence of relationships at the care unit level. J Occup Health Psychol 7:235–241
Gerkensmeyer JE, Austin JK (2005) Development and testing of a scale measuring parent satisfaction with staff interactions. J Behav Health Serv Res 32:61–73
Glisson C (2002) The organizational context of children’s mental health services. Clin Child Fam Psych 5:233–253
Green J (2006) Annotation: the therapeutic alliance—a significant but neglected variable in child mental health treatment studies. J Child Psychol Psych 47:425–435
Halsteinli V, Kittelsen SA, Magnussen J (2001) Scale, efficiency and organization in Norwegian psychiatric outpatient clinics for children. J Ment Health Policy 4:79–90
Hart A, Saunders A, Thomas H (2005) Attuned practice: a service user study of specialist child and adolescent mental health, UK. Epidemiol Psichiatr Soc 14:22–31
Hatling T, Bjørngaard J, Johansen K (2003) Evaluation of the psychiatric outpatient clinic management manual—interim report 2 (in Norwegian). SINTEF Health Research, Trondheim
Hatling T, Røhme K, Bjørngaard J (2005) Evaluation of the psychiatric outpatient clinic management manual—final report (in Norwegian). SINTEF Health Research, Trondheim
Hox J (2002) Multilevel analysis. Techniques and applications. Lawrence Erlbaum, New Jersey
Kim JO (1978) Introduction to factor analysis: what it is and how to do it. Sage, Beverly Hills
McCabe R, Priebe S (2004) The therapeutic relationship in the treatment of severe mental illness: a review of methods and findings. Int J Soc Psychiatry 50:115–128
McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J (2001) Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. HTA 5:1–256
Ministry of health and care services (1998) St.prp. nr. 63 (1997–98): About the mental health program 1999–2006 (in Norwegian). Oslo
Mintzberg H (1979) The structuring of organizations: a synthesis of the research. Prentice-Hall, Englewood Cliffs
Morgan DG (1999) ‹Please see and advise’: a qualitative study of patients’ experiences of psychiatric outpatient care. Soc Psych Psych Epid 34:442–450
Neale MS, Rosenheck RA (1995) Therapeutic alliance and outcome in a VA intensive case management program. Psychiatr Serv 46:719–721
Norwegian Board of Health Supervision (2001) The psychiatric outpatient manual (in Norwegian). Oslo
Nunnally JC (1994) Psychometric theory. McGraw-Hill, New York
Pedersen P (2006) SAMDATA Mental health services (in Norwegian). In: Pedersen P ed. SINTEF Health, Trondheim
Powell R-A, Holloway F, Lee J, Sitzia J (2004) Satisfaction research and the uncrowned king. Challenges and future directions. J Ment Health 13:11–20
Ruggeri M (1996) Satisfaction with psychiatric services. In: Thornicroft G, Tansella M (eds) Mental health outcome measures. Springer, Berlin, pp 27–51
Schroder A, Ahlstrom G, Larsson BW (2006) Patients’ perceptions of the concept of the quality of care in the psychiatric setting: a phenomenographic study. J Clin Nurs 15:93–102
Shapiro JP, Welker CJ, Jacobson BJ (1997) The youth client satisfaction questionnaire: development, construct validation, and factor structure. J Clin Child Psychol 26:87–98
Sitzia J, Wood N (1997) Patient satisfaction: a review of issues and concepts. Soc Sci Med 45:1829–1843
Sourander A, Helstelä L, Helenius H (1999) Parent–adolescent agreement on emotional and behavioral problems. Soc Psych Psych Epid 34:657–663
Sourander A, Pihlakoski L, Aromaa M, Rautava P, Helenius H, Sillanpää M (2006) Early predictors of parent- and self-reported perceived global psychological difficulties among adolescents. Soc Psych Psych Epid 41:173–182
Stuntzner-Gibson D, Koren PE, DeChillo N (1995) The youth satisfaction questionnaire—what kids think of services. Fam Soc J Contemp H 76:616–624
The Norwegian Directorate for Health and Social Affairs (2007) Free hospital choice Norway (in Norwegian). http://www.sykehusvalg.net. Access date 9-9-2007
Valenstein M, Mitchinson A, Ronis DL, Alexander JA, Duffy SA, Craig TJ, Barry KL (2004) Quality indicators and monitoring of mental health services: what do frontline providers think? Am J Psychiat 161:146–153
Wampold BE (2001) The great psychotherapy debate. Models, methods and findings. Lawrence Erlbaum, Mahwah
Acknowledgments
The collection of data was funded by the Social and Health Directorate in Norway. The writing of the paper was funded by the Norwegian Council for Mental Health and the Norwegian Foundation for Health and Rehabilitation. The views expressed are those of the authors.
Declaration of interests No conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bjørngaard, J.H., Wessel Andersson, H., Osborg Ose, S. et al. User satisfaction with child and adolescent mental health services. Soc Psychiat Epidemiol 43, 635–641 (2008). https://doi.org/10.1007/s00127-008-0347-8
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00127-008-0347-8