Advertisement

Social Psychiatry and Psychiatric Epidemiology

, Volume 29, Issue 6, pp 265–276 | Cite as

Acceptability, sensitivity and content validity of the VECS and VSSS in measuring expectations and satisfaction in psychiatric patients and their relatives

  • M. Ruggeri
  • R. Dall'Agnola
  • C. Agostini
  • G. Bisoffi
Original Paper

Abstract

The Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) are two newly developed, multidimensional instruments that measure expectations and satisfaction with community-based psychiatric services (CPS) in patients, relatives and professionals. This paper reports on the acceptability, sensitivity and content validity of the VECS and VSSS in 75 patients and 76 relatives attending the South-Verona CPS. The acceptability of the VECS and the VSSS to subjects was good: most items were easily understood and the vast majority of subjects cooperated and gave accurate evaluations. The VECS and VSSS proved to be sensitive to variation both between groups and across dimensions. We demonstrated that the VECS and VSSS questionnaires had a higher sensitivity than unstructured interviews in measuring service expectations and satisfaction and that a domain-specific measurement had a higher sensitivity than an overall one. The content validity of the questionnaires, according to patients' and relatives' views, was very good. We demonstrated that a key characteristic of the content validity was the questionnaire's multidimensionality, with major contributions from the dimensions “Professionals' Skills and Behaviour” and “Types of Intervention”. The findings presented in this paper constitute the first complete study available in the literature on the psychometric properties of the measurement of expectations and satisfaction in a psychiatric setting. They indicated that it is possible to measure such subjective aspects in an acceptable, sensitive and valid way and that the VECS and VSSS have good psychometric properties. The data presented appear promising in the qualitative evaluation of the South-Verona CPS and the method should be of interest to those evaluating CPS in other settings.

Keywords

Public Health Psychometric Property Content Validity Psychiatric Patient Accurate Evaluation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Andrews FM, Withey SB (1976) Social indicators of wellbeing: American perceptions of life quality. Plenum, New YorkGoogle Scholar
  2. Armitage P (1971) Statistical methods in medical research. Blackwell Scientific Publications, OxfordGoogle Scholar
  3. Bellantuono C, Fiorio R, Zanotelli R, Tansella M (1987) Psychiatric screening in general practice in Italy. A validity study of the GHQ. Soc Psychiatry 22:113–117Google Scholar
  4. Bene-Kociemba A, Cotton PG, Fortgang RC (1982) Assessing patient satisfaction with state hospital and aftercare services. Am J Psychiatry 139:660–662Google Scholar
  5. Bloom IJ, Trautt GM (1978) Psychotherapists' perceptions of clients' satisfaction following termination. Percep Mot Skills 48: 1165–1166Google Scholar
  6. Bugge I, Hendel DD, Moen R (1985) Client evaluations of therapeutic process and outcomes in a university mental health center. Coll Health 33:141–146Google Scholar
  7. Cattel RB (1978) The scientific use of factor analysis in behavior and life sciences. Plenum Press, New YorkGoogle Scholar
  8. Conte HR, Plutchik R, Buckley P, Spence DW, Karasu TB (1989) Outpatients view their psychiatric treatment. Hosp Community Psychiatry 40:641–643Google Scholar
  9. Distefano M, Pryer M, Garrison J (1980) Psychiatric patients' and staff's perceptions of client satisfaction with hospital services. Psychol Rep 46:1343–1344Google Scholar
  10. Dowds B, Fontana A (1977) Patients' and therapists' expectations and evaluations of hospital treatment. Compr Psychiatry 18: 295–300Google Scholar
  11. Elbeck M, Fecteau G (1990) Improving the validity of measures of patient satisfaction with psychiatric care and treatment. Hosp Community Psychiatry 9:145–157Google Scholar
  12. Endicott J, Spitzer RL (1976) The Global Assessment Scale. A procedure for measuring overall severity of psychiatric disturbance. Arch Gen Psychiatry 33:766–771Google Scholar
  13. Fontanesi F, Gobetti C, Zimmermann-Tansella Ch, Tansella M (1985) Validation of the Italian version of the GHQ in a general practice setting. Psychol Med 15:411–415Google Scholar
  14. Greenfield TK, Attkisson CC (1989) Steps toward a multifactorial satisfaction scale for primary care and mental health services. Eval Program Plann 12:271–278Google Scholar
  15. Grella CE, Grusky O (1989) Families of the seriously mentally ill and their satisfaction with services. Hosp Community Psychiatry 40:831–835Google Scholar
  16. Jones EE, Zuppell CL (1982) Impact of client and therapist gender on psychotherapy, process, and outcomes. J Consult Clin Psychol 50:259–272Google Scholar
  17. Lebow JL (1983) Research assessing consumer satisfaction with mental health treatment: a review of findings. Eval Program Plann 6:211–236Google Scholar
  18. Lorefice LS, Borus JF (1984) Consumer evaluation of a community mental health service, II: perceptions of clinical care. Am J Psychiatry 141:1449–1452Google Scholar
  19. Mayer J, Rosenblatt A (1974) Clash in perspective between mental patients and staff. Am J Orthopsychiatry 44:432–441Google Scholar
  20. Pascoe GC (1983) Patient satisfaction in primary health care: a literature review and analysis. Eval Program Plann 6:185–210Google Scholar
  21. Pascoe GC, Attkisson CC (1983) The evaluation ranking scale: a new methodology for assessing satisfaction. Eval Program Plann 6:335–347Google Scholar
  22. Ruggeri M (1991) Le ricerche sulla soddisfazione dei pazienti e dei loro familiari nei confronti dei Servizi Psichiatrici. Quad Ital Psichiatr 2:89–124Google Scholar
  23. Ruggeri M, Dall'Agnola R (1993) The development and use of the Verona Expectations for Care Scale (VECS) and the Verona Service Satisfaction Scale (VSSS) for measuring expectations and satisfaction with community-based psychiatric services in patients, relatives and professionals. Psychol Med 23:511–523Google Scholar
  24. Solomon P, Beck S, Gordon B (1988) Family member's perspectives on psychiatric hospitalization and discharge. Community Ment Health J 24:108–117Google Scholar
  25. Sorensen J, Kantor L, Margolis R, Alano J (1979) The extent, nature and utility of evaluating consumer satisfaction in community mental health services. Am J Community Psychol 7:329–337Google Scholar
  26. SPSS Inc. (1986) SPSS user's guide, 2nd edn. McGraw-Hill, New YorkGoogle Scholar
  27. Steinwachs DM, Cullum H, Dorwart RA, Flynn L et al (1992) Service systems research. Schizophr Bull 18:627–668Google Scholar
  28. Tansella M (1988) Evaluating community psychiatric services. In: Williams P, Wilkinson G, Kawnsley K (eds) The scope of epidemiological psychiatry. Routledge, London, pp 386–403Google Scholar
  29. Ware JE, Davies-Avery A, Stewart AL (1978) The measurement and meaning of patient satisfaction: a review of the recent literature. Health Med Care Serv Rev 1:1–15Google Scholar
  30. Westbrook RA, Oliver RL (1981) Developing better measures of consumer satisfaction: some preliminary results. In: Munroe KB (ed) Advances in consumer research, (vol 8). Association for Consumer Research, Ann Arbor, MI, pp 118–194Google Scholar
  31. World Health Organization (1988) International classification of impairments, disabilities, and handicaps: a manual of classification relating to consequences of disease. World Health Organization, GenevaGoogle Scholar

Copyright information

© Springer-Verlag 1994

Authors and Affiliations

  • M. Ruggeri
    • 1
  • R. Dall'Agnola
    • 1
  • C. Agostini
    • 1
  • G. Bisoffi
    • 1
  1. 1.Servizio di Psicologia Medica, Istituto di Psichiatria, Ospedale PoliclinicoUniversita di VeronaVeronaItaly

Personalised recommendations