Abstract
This paper introduces a measure of continuity of care (CONNECT) developed for mental health services research. CONNECT addresses qualities of interpersonal interaction in service-user/practitioner relationships through 13 scales and one single-item indicator. The scales are grouped into five domains: knowledge, flexibility, availability, coordination, and transitions. Domains were derived from ethnographic data. Service users rate responses to items using 5-point scales. The measure is administered in interview format. CONNECT was developed for use with persons who have serious mental illness. Preliminary testing included cognitive interviews and two pilot studies. The results of a field test in which 400 persons with serious mental illness completed CONNECT indicate that the measure is easily administered and produces well-distributed responses. Five scales meet the .80 criterion for internal-consistency reliability for group-level research. Estimates of 2-week test-retest reliability indicate fair- to-good agreement. A broad initial validation strategy including known groups and convergent validity assessments produced results that will inform and focus future efforts. Next steps in the measure development process are discussed.
Similar content being viewed by others
REFERENCES
Aday, L. L. (1989). Designing and conducting health surveys. San Francisco: Jossey-Bass.
Alegria, M., Pescosolido, B. A., Santos, D., & Vera, M. (1997). Can we conceptualize and measure continuity of care in individual episodes? The case of mental health services in Puerto Rico. Sociological Focus 30(2, 113-129.
Bachrach, L. L. (1981). Continuity of care for chronic mental patients: A conceptual analysis. American Journal of Psychiatry, 138, 1449-1456.
Bachrach, L. L. (1993). Continuity of care and approaches to case management for long-term mentally ill patients. Hospital and Community Psychiatry, 44, 465-468.
Barbato, A., Terzian, E., Saraceno, B., Montero Barquero, F., & Tognoni, G. (1992). Patterns of aftercare for psychiatric patients discharged after short inpatient treatment. Social Psychiatry and Psychiatric Epidemiology, 27, 46-52.
Bass, R. D., & Windle, C. (1972). Continuity of care: An approach to measurement. American Journal of Psychiatry, 129, 110-115.
Bass, R. D., & Windle, C. (1973). A preliminary attempt to measure continuity of care in a community mental health center. Community Mental Health Journal, 9, 53-62.
Bickman, L. E., Guthrie, P. R., Foster, E. M., Lambert, E. W., Summerfelt, W. T., Breda, C. S., et al. (1995). Evaluating managed mental health services: The Fort Bragg experiment. New York: Plenum.
Bickman, L. E., Lambert, W., Andrade, A. R., & Penaloza, R. V. (2000). The Fort Bragg continuum of care for children and adolescents: Mental health outcomes over 5 years. Journal of Consulting and Clinical Psychology, 68(4), 710-716.
Bindman, J., Johnson, S., Szmukler, G., Wright, S., Kuipers, E., Thornicroft, G., et al. (2000). Continuity of care and clinical outcome: A prospective cohort study. Social Psychiatry and Psychiatric Epidemiology, 35(6), 242-247.
Brekke, J. S., Ansel, M., Long, J., Slade, E., & Weinstein, M. (1999). Intensity and continuity of services and functional outcomes in the rehabilitation of persons with schizophrenia. Psychiatric Services, 50(2), 248-256.
Brekke, J. S., & Test, M. A. (1992). A model for measuring the implementation of community support programs: Results from three sites. Community Mental Health Journal, 28, 227-247.
Chien, C. F., Steinwachs, D. M., Lehman, A., Fahey, M., & Skinner, E. A. (2000). Provider continuity and outcomes of care for persons with schizophrenia. Mental Health Services Research, 2(4), 201-211.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.
Cuffel, B. J., Bloom, J. R., Wallace, N., Hausman, J. W., & Hu, T. W. (2002). Two-year outcomes of fee-for-service and capitated Medicaid programs for people with severe mental illness. Health Services Research, 37(2), 341-359.
DeMaio, T. J., & Rothgeb, J. M. (1996). Cognitive interviewing techniques in the lab and the field. In N. Schwarz & S. Sudman (Eds.), Answering questions: Methodology for determining cognitive and communicative processes in survey research (pp. 177-195). San Francisco: Jossey-Bass.
DeVellis, R. (1991). Scale Development: Theory and Applications. Newbury Park, CA: Sage.
Dickey, B., Normand, S. L., Hermann, R., Eisen, S. V., Cortes, D., Cleary, P., et al. (2003). Guideline recommendations for treatment of schizophrenia: The impact of managed care. Archives of General Psychiatry, 60(4), 340-348.
Dill, A. E. P., & Rochefort, D. A. (1989). Coordination, continuity, and centralized control: A policy perspective on service strategies for the chronic mentally ill. Journal of Social Issues, 45(3), 145-149.
Donald, A. (2001). The Wal-marting of American psychiatry: An ethnography of psychiatric practice in the late 20th century. Culture, Medicine and Psychiatry, 25(4), 427-439.
Eisen, S. V. (1996). Behavior and symptom identification scale (BASIS-32). In L. I. Sederer & B. Dickey (Eds.), Outcomes assessment in clinical practice (pp. 65-69). Baltimore, MD: Williams & Wilkins.
Eisen, S. V., Shaul, J. A., Clarridge, B. R., Nelson, D., Spink, J., & Cleary, P. D. (1999). Development of a consumer survey for behavioral health services. Psychiatric Services, 50, 793-798.
Eisen, S. V., Shaul, J. A., Leff, H. S., Stringfellow, V., Clarridge, B. R., & Cleary, P. D. (2001). Toward a national consumer survey: Evaluation of the CABHS and MHSIP instruments. Journal of Behavioral Health Services and Research, 28(3), 347-369.
Estroff, S. E. (1981). Making it crazy: An ethnography of psychiatric clients in an American community. Berkeley: University of California Press.
Evans-Pritchard, E. E. (1940). The Nuer. Oxford University Press: Oxford, England.
Ference, J., Tobin, T., Ralph, R., Hornik, J., & Strowman, S. (2002). Resident-staff relationships in mental health residential programs. (Final Report). CMHS Housing Initiative. Upstate New York Research Site. Albany, NY: Advocacy for Human Potential, Inc.
Fleiss, J. L. (1981). Statistical methods for rates and proportions. New York: Wiley.
Goldman, H. H., Morrissey, J. P., & Ridgely, M. S. (1994). Evaluating the Robert Wood Johnson foundation program on chronic mental illness. The Milbank Quarterly, 72(1), 37-47.
Goldman, H. H., Morrissey, J. P., Rosenheck, R. A., Cocozza, J., Blasinsky, M., Randolph, F., et al. (2002). Lessons from the evaluation of the ACCESS program. Psychiatric Services, 53(8), 967-969.
Greenberg, G. A., Rosenheck, R. A., & Seibyl, C. L. (2002). Continuity of care and clinical effectiveness: Outcomes following residential treatment for severe substance abuse. Medical Care, 40(3), 246-259.
Hamner, K. M., Lambert, E. W., & Bickman, L. (1997). Children's mental health in a continuum of care: Clinical outcomes at 18 months for the Fort Bragg demonstration. Journal of Mental Health Administration, 24, 465-471.
Hohmann, A., & Shear, K. (2002). Community-based intervention research: Coping the “noise” of real life in study design. American Journal of Psychiatry, 159(2), 201-207.
Hopper, K., Jost, J., Hay, T., Welber, S., & Haugland, G. (1997). Homelessness, severe mental illness, and the institutional circuit. Psychiatric Services, 48, 659-665.
Huberman, A. M., & Miles, M. B. (1994). Data management and analysis methods. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 428-444). Thousand Oaks, CA: Sage.
Johnson, S., Prosser, D., Bindman, J., & Szumkler, G. (1997). Continuity of care for the severely mentally ill: Concepts and measures. Social Psychiatry and Psychiatric Epidemiology, 32, 137-142.
Kirschner, S. R., & Lachicotte, W. S. (2001). Managing managed care: Habitus, hysteresis and the end(s) of psychotherapy. Culture, Medicine and Psychiatry, 25(4), 441-456.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174.
Lehman, A. F. (1988). A quality of life interview for the chronically mentally ill. Evaluation and Program Planning, 11, 51-62.
Lehman, A. F., Postrado, L. T., Roth, D., McNary, S. W., & Goldman, H. H. (1994). Continuity of care and client outcomes in the Robert Wood Johnson foundation program on chronic mental illness. The Milbank Quarterly, 72, 105-122.
Lessler, J. T. (1995). Choosing questions that people can understand and answer. Medical Care, 33, 203-208.
Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140, 5-55.
Lovell, A. M., & Cohn, S. (1998). The elaboration of “choice” in a program for homeless persons labeled psychiatrically disabled. Human Organization, 57(1), 8-20.
Malinowski, B. (1922/1961). Argonauts of the Western Pacific. E. P. Dutton: New York.
Manning, W. G., Newhouse, J. P., & Ware, J. E. (1982). The status of health in demand estimation: Beyond excellent, good, fair, and poor. In V. R. Fuchs (Ed.), Economic aspects of health (pp. 143-184). Chicago: University of Chicago Press.
McHorney, C. (1997). Generic health measurement: Past accomplishments and a measurement paradigm for the 21st century. Annals of Internal Medicine, 127, 743-750.
McHorney, C. A., Ware, J. E., Rogers, W., Raczek, A., & Lu, J. F. R. (1992). The validity and relative precision of MOS short-and long-form health status scales and Dartmouth COOP Charts: Results from the Medical Outcomes Study. Medical Care, 30(Suppl.), MS253-MS265.
Mead, M. (1928/1961). Coming of age in Samoa: A psychological study of primitive youth for Western civilization. William Morrow: New York.
Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill.
Pescosolido, B. A., & Croghan, T. W. (1999). Conceptualizing the social, economic, and cultural issues underlying mental health care outcomes. A Proposal to the Robert Wood Johnson Foundation. Unpublished document.
Pugh, T. P., & MacMahon, B. (1967). Measurement of discontinuity of psychiatric inpatient care. Public Health Reports, 82, 533-538.
Reid, R., Haggerty, J., & McKendry, R. (2002). Defusing the confusion: Concepts and measures of continuity of health care. Final Report prepared for the Canadian Health Services Research Foundation, the Canadian Institute for Health Information, and the Advisory Committee on Health Services of the Federal/Provincial/Territorial Deputy Ministers of Health. Health Policy Research Unit Research Reports. Center for Health Services and Policy Research. University of British Columbia. Unpublished manuscript.
Robins, C. S. (2001). Generating revenues: Fiscal changes in public mental health care and the emergence of moral conflicts among care-givers. Culture, Medicine and Psychiatry, 25(4), 457-466.
Sands, R. G., & Cnaan, R. A. (1994). Two modes of case management: Assessing their impact. Community Mental Health Journal, 30, 441-457.
Slater, V., Linn, M., & Harris, R. (1982). A satisfaction with mental health care scale. Comprehensive Psychiatry, 23(1), 68-74.
Snowden, L. R., & Clancy, T. (1990). Service intensity and client improvement at a predominantly black community mental health center. Evaluation and Program Planning, 13, 205-210.
Stewart, A. L., & Ware, J. E. (1992). Measuring functioning and well-being: The medical outcomes study approach. Chapel Hill, NC: Duke University.
Sudman, S. (1996). Answering questions: Methodology for determining cognitive and communicative processes in survey research. San Francisco: Jossey-Bass.
Sytema, S., Micciolo, R., & Tansella, M. (1997). Continuity of care for patients with schizophrenia and related disorders: A comparative South-Verona and Groningen case register study. Psychological Medicine, 27, 1355-1362.
Tessler, R. C. (1987). Continuity of care and client outcome. Psychosocial Rehabilitation Journal, 11, 39-53.
Tessler, R. C., Willis, G., & Gubman, G. D. (1986). Defining and measuring continuity of care. Psychosocial Rehabilitation Journal, 10, 27-38.
Test, M. A. (1979). Continuity of care in community treatment. New Directions for Mental Health Services, 2, 15-23.
Thornicroft, G., & Tansella, M. (1999). Translating ethical principles into outcome measures for mental health services research. Psychological Medicine, 29, 761-767.
Tourangeau, R., Rasinski, K. A., & D'Andrade, R. (1991). Attitude structure and belief accessibility. Journal of Experimental Social Psychology, 27, 48-75.
Turner, J. C., & TenHoor, W. J. (1978). The NIMH community support program: Pilot approach to needed social reform. Schizophrenia Bulletin, 4(3), 319-344.
Ware, N. C., & Tugenberg, T. (2002). Representing user perspectives in mental health services research: A report from the field. Manuscript submitted for publication.
Ware, N. C., Tugenberg, T., Dickey, B., & McHorney, C. A. (1999). An ethnographic study of the meaning of continuity of care in mental health services. Psychiatric Services, 50(3), 395-400.
Wolcott, H. F. (1994). Transforming qualitative data: Description, analysis and interpretation. Thousand Oaks, CA: Sage.
Wolkon, G. H. (1970). Characteristics of clients and continuity of care into the community. Community Mental Health Journal, 6, 215-221.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Ware, N.C., Dickey, B., Tugenberg, T. et al. CONNECT: A Measure of Continuity of Care in Mental Health Services. Ment Health Serv Res 5, 209–221 (2003). https://doi.org/10.1023/A:1026276918081
Issue Date:
DOI: https://doi.org/10.1023/A:1026276918081