March 2008, Volume 35, Issue 1-2, pp 98-113
Date: 18 Dec 2007
Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
The organizational social context in which mental health services are provided is believed to affect the adoption and implementation of evidence-based practices (EBPs) as well as the quality and outcomes of the services. A fully developed science of implementation effectiveness requires conceptual models that include organizational social context and tools for assessing social context that have been tested in a broad cross-section of mental health systems. This paper describes the role of organizational social context in services and implementation research and evaluates a comprehensive contextual measure, labeled Organizational Social Context (OSC), designed to assess the key latent constructs of culture, climate and work attitudes. The psychometric properties of the OSC measure were assessed in a nationwide study of 1,154 clinicians in 100 mental health clinics with a second-order confirmatory factor analysis of clinician responses, estimates of scale reliabilities, and indices of within-clinic agreement and between-clinic differences among clinicians. Finally, the paper illustrates the use of nationwide norms in describing the OSC profiles of individual mental health clinics and examines the cross-level association of organizational-level culture and climate with clinician-level work attitudes.
The Research Network on Youth Mental Health is a collaborative network funded by the John D. and Catherine T. MacArthur Foundation. Network Members at the time this work was performed included: John Weisz, Ph.D. (Network Director), Bruce Chorpita, Ph.D., Robert Gibbons, Ph.D., Charles Glisson, Ph.D., Evelyn Polk Green, M.A., Kimberly Hoagwood, Ph.D., Peter S. Jensen, M.D., Kelly Kelleher, M.D., John Landsverk, Ph.D., Stephen Mayberg, Ph.D., Jeanne Miranda, Ph.D., Lawrence Palinkas, Ph.D., Sonja Schoenwald, Ph.D.
Argyris, C. (1958). Some problems in conceptualizing organizational climate: A case study of a bank Administrative Science Quarterly, 2, 501–520.CrossRef
Ashkanasy, N. M., Broadfoot, L. E., & Falkus, S. (2000a). Questionnaire measures of organizational culture. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 131–146). Thousand Oaks, CA: Sage Publications, Inc.
Ashkanasy, N. M., Wilderom, C. P. M., Peterson, M. F. (Eds.) (2000b). Handbook of organizational culture and climate. Thousand Oaks, CA: Sage Publications.
Bliese, P. (2000). Within-group agreement, non-independence, and reliability. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 349–381). San Francisco: Jossey-Bass.
Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health needs and access to mental health services by youths involved with child welfare: A national survey Journal of the American Academy of Child and Adolescent Psychiatry, 43(8), 960–970.PubMedCrossRef
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahway, NJ: Lawrence Erlbaum Associates.
Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models Journal of Applied Psychology, 83, 234–246.CrossRef
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Dowd, K., Kinsey, S., Wheeless, S., Thissen, R. Richardson, J., Suresh, R., et al. (2004). National Survey of Child and Adolescent Well-Being (NSCAW), combined waves 1–4, data file user’s manual, restricted release version. Research Triangle Institute, University of North Carolina at Chapel Hill, and Caliber Associates, University of California at Berkeley.
Fleishman, E. A. (1953). Leadership climate, human relations training, and supervisory behavior Personnel Psychology, 6, 205–222.CrossRef
Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations Administrative Science Quarterly, 33, 61–81.CrossRef
Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421.CrossRef
Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams Journal of Organizational Behavior, 23, 767–794.CrossRef
Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170.CrossRef
Handy, C. B. (1976). Understanding organizations. New York: Penguin Books.
Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: John Wiley & Sons.
Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of family-centered care Children’s Health Care, 30(2), 93–110.CrossRef
Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and intervention research Clinical Psychology: Science and Practice, 13(1), 73–93.CrossRef
Herman, J. B., Dunham, R. B., & Hulin, C. L. (1975). Organizational structure, demographic characteristics, and employee responses Organizational Behavior and Human Performance, 13(2), 206–232.CrossRef
Herman, J. B., & Hulin, C. L. (1972). Studying organizational attitudes from individual and organizational frames of reference Organizational Behavior and Human Performance, 8, 84–108.CrossRef
Hofmann, D. A., Griffin, M. H., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations. San Francisco: Jossey-Bass.
Hofstede, G. (1998). Attitudes, values and organizational culture: Disentangling the concepts Organization Studies, 19, 477–492.CrossRef
Hofstede, G., Neuijen, B., Ohayv, D. D., & Sanders, G. (1990). Measuring organizational cultures: A qualitative and quantitative study across twenty states. Administrative Science Quarterly, 35, 286–316.CrossRef
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling, 6, 1–55.CrossRef
James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning Journal of Applied Psychology, 74, 739–751.CrossRef
James, L. R., Demaree, R. G., & Wolf, G. (1993). Rwg: An assessment of within-group interrater agreement Journal of Applied Psychology, 75(2), 306–309.CrossRef
James, L. R., & Williams, L. J. (2000). The cross-level operator in regression, ANCOVA, contextual analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 382–424). San Francisco: Jossey-Bass.
Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions Organizational Behavior and Human Performance, 23, 201–250.CrossRef
Joyce, W. F., & Slocum, J. W. (1984). Collective climate: Agreement as a basis for defining aggregate climates in organizations Academy of Management Journal, 24(4), 721–742.CrossRef
Klein, K. J., & Kozlowski, S. W. J. (2000a). From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods, 3(3), 211–236.CrossRef
Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000b). Multi-level theory, research, and methods in organizations. San Francisco: Jossey-Bass.
Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.CrossRef
Locke, E. A. (1976). The nature and causes of job satisfaction. New York: McGraw-Hill.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling Psychological Methods, 1, 130–149.CrossRef
Morris, J. H., & Sherman, J. D. (1981). Generalizability of an organizational commitment model Academy of Management Journal, 24, 512–526.CrossRef
Mowday, R., Porter, L., & Steers, R. (1982). Organizational linkages: The psychology of commitment, absenteeism, and turnover. New York: Academic Press.
Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges Administrative Policy in Mental Health and Mental Health Services Research, 33, 398–409.CrossRef
NSCAW Research Group (2002). Methodological lessons from the National Survey of Child and Adolescent Well-Being: The first three years of the USA’s first national probability study of children and families investigated for abuse and neglect Children and Youth Services Review, 24(6–7), 513–541.
Pettigrew, A. (1979). On studying organizational cultures Administrative Science Quarterly, 24, 570–581.CrossRef
Porras, J. I., & Robertson, P. J. (1992). Organizational development: Theory, practice, and research. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3 pp. 719–822). Palo Alto, CA: Consulting Psychologists Press, Inc.
Raudenbush, S. W., & Bryk, A. S. (2002) Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Loncolnwood, IL: Scientific Software International.
Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco: Jossey-Bass.
Rousseau, D. M. (1977). Technological differences in job characteristics, employee satisfaction and motivation: A synthesis of job design research and sociotechnical systems theory Organizational Behavior and Human Performance, 19, 18–42.CrossRef
Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level, cross-level perspectives. In B. M. Stow & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1–37). Greenwich, CT: JAI Press.
Rousseau, D. M. (1990). Assessing organizational culture: The case for multiple methods. In B. Schneider (Ed.), Organizational climate and culture (pp. 153–192). San Francisco: Jossey-Bass.
Stackman, R. W., Pinder, C. C., & Connor, P. E. (2000). Values lost: Redirecting research on values in the workplace. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate, (pp. 37–54). Thousand Oaks, CA: Sage Publications.
Verbeke, W., Volgering, M., & Hessels, M. (1998). Exploring the conceptual expansion within the field of organizational behavior: Organizational climate and organizational culture. Journal of Management Studies, 35(3), 303–329.CrossRef
Viteles, M. S. (1953). Motivation and morale in industry. New York: W.W. Norton.
Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-basted treatments and case examples. Cambridge: Cambridge University Press.
Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231.CrossRef
- Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice
Administration and Policy in Mental Health and Mental Health Services Research
Volume 35, Issue 1-2 , pp 98-113
- Cover Date
- Print ISSN
- Online ISSN
- Springer US
- Additional Links
- Organizational social context
- Organizational culture
- Organizational climate
- Implementation research
- Services research
- Organizational assessment
- Author Affiliations
- 1. Children’s Mental Health Services Research Center, University of Tennessee, 128 Henson Hall, Knoxville, TN, 37996-3332, USA