Abstract
The Program Environment Scale (PES) was developed for use with clients of community-based programs for the severely mentally ill. It is intended to fill the gap in available tools for assessing clients' perceptions of program functioning as it affects their “quality of life” in a program. Formal pretests were conducted with 121 clients at 12 randomly selected programs near Washington, DC. The final field test used a revised form (29 domains; 129 items) with 221 clients in 22 programs selected randomly throughout the U.S., including Clubhouse, day treatment, psychosocial rehabilitation, and social club programs. Twenty-three subscales met at least five of eight psychometric criteria for internal consistency and discriminant validity. A 24th subscale was retained because of its substantive importance. Successful subscales cover program atmosphere and interactions (program cares about me, energy level, friendliness, openness, staff-client and client-client respect, reasonable rules, availability of positive physical contact, protection from bad touch, staff investment in their jobs, and confidentiality), client empowerment/staff-client equality (program and treatment empowerment, egalitarian space use), and service components (support for paid work, work importance, emergency access, family activities, housing, public benefits, community activities, medications, substance abuse, and continuity). Subscale validity is indicated by associations of specific service offerings with scores on scales measuring client perceptions of those services, and by an ability to differentiate among program models (i.e., Clubhouses, day treatment programs, and psychosocial rehabilitation programs look different from each other). Subscale scores were not influenced by client characteristics (gender, race, age, diagnosis, number of hospitalizations, length of time in program). The final scale has 97 items and takes about 25 minutes to complete. The PES succeeds in measuring different aspects of programs as clients perceive them. In the programs we visited, directors felt the PES covers the important things they want to know about how clients perceive their program. The PES should become a useful tool both for researchers interested in how client responses to programs may influence their therapeutic outcomes, and for practitioners interested in improving their clients' program experiences and/or increasing convergence of staff and client views of their program.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
REFERENCES
Barker, R. G. (1968). Ecological psychology: Concepts and methods for studying the environment of human behavior. Stanford, CA: Standford University Press.
Bennett, C. C., Anderson, L. S., Cooper, S., Hassol, L., Klein, D. C., & Rosenblum, G. (Eds.). (1966). Community psychology: A report of the Boston Conference on the Education of Psychologists for Community Mental Health. Boston: Boston University Press.
Brekke, J. S. (1987). The model-guided method for monitoring program implementation. Evaluation Review, 11 (3), 281–299.
Brekke, J. S. (1988). What do we really know about community support programs? Strategies for better monitoring. Hospital and Community Psychiatry, 39 (9), 946–952.
Brekke, J. S., & Test, M. A. (1987). An empirical analysis of services delivered in a model community support program. Psychosocial Rehabilitation Journal, 10 (4), 51–61.
Brekke, J. S., & Test, M. A. (1992). A model for measuring the implementation of community support programs: Results from three sites. Community Mental Health Journal, 28, 227–247.
Brekke, J. S., & Wolkon, G. H. (1988). Monitoring program implementation in community mental health settings. Evaluation and the Health Professions, 11 (4), 425–440.
Burt, M. R. (1997). Developing a Program Environment Scale: Final Report, Grant Number 1 RO1 MH 49196. (Available from the first author; see Footnotes 1 and 2.)
Burt, M. R., Duke, A. E., & Hargreaves, W. A. (1998). Using the Program Environment Scale to Assess Convergence and Divergence of Client and Staff Perceptions in Community Support Programs. Unpublished manuscript.
Cnaan, R. A., Blankertz, L., Messinger, K., & Gardner, J. (1988). Psychosocial rehabilitation: Toward a definition. Psychosocial Rehabilitation Journal, 11 (4), 61–77.
Cnaan, R. A., Blankertz, L., Messinger, K., & Gardner, J. (1989). Psychosocial rehabilitation: Toward a theoretical base. Psychosocial Rehabilitation Journal, 12 (1), 33–55.
Cnaan, R. A., Blankertz, L., Messinger, K., & Gardner, J. (1990). Experts' assessment of psychosocial rehabilitation principles. Psychosocial Rehabilitation Journal, 13 (3), 59–73.
Eddy, R. (1987). Clubhouse membership and hospitalization rates: A study. Paper presented at the Fourth International Seminar on the Clubhouse Model, Seattle, WA.
Fares, S., Hargreaves, W. A., & Burt, M. R. (1998). The CPPS and the PES: Complementary instruments to describe program characteristics. Unpublished manuscript.
Greenley, J. R., & Schoenherr, R. A. (1981). Organization effects on client satisfaction with humaneness of service. Journal of Health and Social Behavior, 22, 2–18.
Hargreaves, W. A., Shaw, R. E., Shadoan, R., Walker, E., Surber, R., & Gaynor, J. (1984). Measuring case management activity. Journal of Nervous and Mental Disease, 172, 296–300.
Hargreaves, W. A., Shumway, M., & Hu, T. W. (1996). Measuring services use and delivery. In M. Moscarelli & N. Sartorius (Eds.), Handbook of mental health economics and health policy: Vol. 1. Schizophrenia (pp. 347–358). London: Wiley.
Hargreaves, W. A., Shumway, M., Hu, T. W., & Cuffel, B. (1998). Cost-outcome methods for mental health. San Diego, CA: Academic Press.
Jerrell, J. M., & Hargreaves, W. A. (1991). The operating philosophy of community programs. (Working Paper 18, available from the Institute for Mental Health Services Research, 2001 Addison Street, Suite 230, Berkeley, CA 94704-1103).
Levine, I. S., Lezak, A. D., & Goldman, H. H. (1986). Community support systems for the homeless mentally ill. New Directions for Mental Health Services, 30, 27–42.
Moos, R. H. (1996a). Understanding environments: The key to improving social processes and program outcomes. American Journal of Community Psychology, 24, 193–201.
Moos, R. H. (1996b). Evaluating treatment environments: The quality of psychiatric and substance abuse programs (2nd ed.). New Brunswick, NJ: Transaction.
Morrissey, J. M., Mushkin, C., et al. (1990). Clients' needs, service system characteristics and mental health authority performance. Interim Report for the Site-Level Evaluations of the Robert Wood Johnson Foundation Program on the Chronically Mentally Ill. (Available from the Robert Wood Johnson Foundation, P.O. Box 2316, Princeton, NJ 08543-2316)
Rezmovic, E. L. (1984). Assessing treatment implementation amid the slings and arrows of reality. Evaluation Review, 8, 187–204.
Schein, E. H. (1996). Culture: The missing concept in organizational studies. Administrative Science Quarterly, 41, 229–240.
Scheirer, M. A., & Rezmovic, E. L. (1983). Measuring the degree of program implementation: A methodological review. Evaluation Review, 7, 599–633.
Shern, D. L., Bartsch, D. A., Coen, A. S., Ellis, R. H., & Wilson, N. Z. (1985). A model for estimating optimal residential/service settings for types of chronically mentally ill individuals: Project summary. (Available from the Colorado Department of Institutions, Division of Mental Health, Denver, Colorado.)
Tessler, R. C., & Goldman, H. H. (1982). The chronically mentally ill: Assessing community support programs. Cambridge, MA: Ballinger.
Test, M. A. (1984). Community support programs. In A. S. Bellack (Ed.), Treatment and care for schizophrenia (pp. 347–373). New York: Grune & Stratton.
Test, M. A. (1992). Training in community living. In R. P. Liberman (Ed.), Handbook of psychiatric rehabilitation (pp. 153–170). New York: Macmillan.
Test, M. A., & Stein, L. I. (Eds.). (1985). The training in community living model: A decade of experience. New Directions for Mental Health Services, 26.
Trickett, E. J. (1997). Ecology and primary prevention: Reflections on a meta-analysis. American Journal of Community Psychology, 25, 197–205.
Turner, J. E., & Shifren, I. (1979). Community support systems: how comprehensive? New Directions for Mental Health Services, 2, 1–23.
Turner, J. E., & Tenhoor, W. J. (1978). The NIMH Community Support Program: Pilot approach to a needed social reform. Schizophrenia Bulletin, 4, 319–344.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Burt, M.R., Duke, AE. & Hargreaves, W.A. The Program Environment Scale: Assessing Client Perceptions of Community-Based Programs for the Severely Mentally Ill. Am J Community Psychol 26, 853–879 (1998). https://doi.org/10.1023/A:1022246112973
Issue Date:
DOI: https://doi.org/10.1023/A:1022246112973