Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice

  • Charles Glisson
  • John Landsverk
  • Sonja Schoenwald
  • Kelly Kelleher
  • Kimberly Eaton Hoagwood
  • Stephen Mayberg
  • Philip Green
  • The Research Network on Youth Mental Health
Original Paper

Abstract

The organizational social context in which mental health services are provided is believed to affect the adoption and implementation of evidence-based practices (EBPs) as well as the quality and outcomes of the services. A fully developed science of implementation effectiveness requires conceptual models that include organizational social context and tools for assessing social context that have been tested in a broad cross-section of mental health systems. This paper describes the role of organizational social context in services and implementation research and evaluates a comprehensive contextual measure, labeled Organizational Social Context (OSC), designed to assess the key latent constructs of culture, climate and work attitudes. The psychometric properties of the OSC measure were assessed in a nationwide study of 1,154 clinicians in 100 mental health clinics with a second-order confirmatory factor analysis of clinician responses, estimates of scale reliabilities, and indices of within-clinic agreement and between-clinic differences among clinicians. Finally, the paper illustrates the use of nationwide norms in describing the OSC profiles of individual mental health clinics and examines the cross-level association of organizational-level culture and climate with clinician-level work attitudes.

Keywords

Organizational social context OSC Organizational culture Organizational climate Implementation research Services research Organizational assessment 

References

  1. Aarons, G. A., & Palinkas, L. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.PubMedCrossRefGoogle Scholar
  2. Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301.PubMedCrossRefGoogle Scholar
  3. Argyris, C. (1958). Some problems in conceptualizing organizational climate: A case study of a bank Administrative Science Quarterly, 2, 501–520.CrossRefGoogle Scholar
  4. Ashkanasy, N. M., Broadfoot, L. E., & Falkus, S. (2000a). Questionnaire measures of organizational culture. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 131–146). Thousand Oaks, CA: Sage Publications, Inc.Google Scholar
  5. Ashkanasy, N. M., Wilderom, C. P. M., Peterson, M. F. (Eds.) (2000b). Handbook of organizational culture and climate. Thousand Oaks, CA: Sage Publications.Google Scholar
  6. Bickman, L. (1996a). The evaluation of a children’s mental health managed care demonstration Journal of Mental Health Administration, 23(1), 7–15.PubMedCrossRefGoogle Scholar
  7. Bickman, L. (1996b). A continuum of care: More is not always better American Psychologist, 51, 689–701.PubMedCrossRefGoogle Scholar
  8. Bliese, P. (2000). Within-group agreement, non-independence, and reliability. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 349–381). San Francisco: Jossey-Bass.Google Scholar
  9. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.Google Scholar
  10. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.Google Scholar
  11. Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents Clinical Child and Family Psychology Review, 2, 199–242.PubMedCrossRefGoogle Scholar
  12. Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health needs and access to mental health services by youths involved with child welfare: A national survey Journal of the American Academy of Child and Adolescent Psychiatry, 43(8), 960–970.PubMedCrossRefGoogle Scholar
  13. Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahway, NJ: Lawrence Erlbaum Associates.Google Scholar
  14. Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models Journal of Applied Psychology, 83, 234–246.CrossRefGoogle Scholar
  15. Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
  16. Dowd, K., Kinsey, S., Wheeless, S., Thissen, R. Richardson, J., Suresh, R., et al. (2004). National Survey of Child and Adolescent Well-Being (NSCAW), combined waves 1–4, data file user’s manual, restricted release version. Research Triangle Institute, University of North Carolina at Chapel Hill, and Caliber Associates, University of California at Berkeley.Google Scholar
  17. Fleishman, E. A. (1953). Leadership climate, human relations training, and supervisory behavior Personnel Psychology, 6, 205–222.CrossRefGoogle Scholar
  18. Glisson, C. (1978). Dependence of technological routinization on structural variables in human service organizations Administrative Science Quarterly, 23, 383–395.PubMedCrossRefGoogle Scholar
  19. Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.PubMedCrossRefGoogle Scholar
  20. Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations Administrative Science Quarterly, 33, 61–81.CrossRefGoogle Scholar
  21. Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448.PubMedCrossRefGoogle Scholar
  22. Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421.CrossRefGoogle Scholar
  23. Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams Journal of Organizational Behavior, 23, 767–794.CrossRefGoogle Scholar
  24. Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.PubMedCrossRefGoogle Scholar
  25. Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients’ care Lancet, 362(9391), 1225–1230.PubMedCrossRefGoogle Scholar
  26. Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170.CrossRefGoogle Scholar
  27. Handy, C. B. (1976). Understanding organizations. New York: Penguin Books.Google Scholar
  28. Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: John Wiley & Sons.Google Scholar
  29. Hedeker, D., Gibbons, R. D., & Flay, B. R. (1994). Random-effects regression models for clustered data with an example from smoking prevention research Journal of Consulting and Clinical Psychology, 62, 757–765.PubMedCrossRefGoogle Scholar
  30. Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of family-centered care Children’s Health Care, 30(2), 93–110.CrossRefGoogle Scholar
  31. Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and intervention research Clinical Psychology: Science and Practice, 13(1), 73–93.CrossRefGoogle Scholar
  32. Herman, J. B., Dunham, R. B., & Hulin, C. L. (1975). Organizational structure, demographic characteristics, and employee responses Organizational Behavior and Human Performance, 13(2), 206–232.CrossRefGoogle Scholar
  33. Herman, J. B., & Hulin, C. L. (1972). Studying organizational attitudes from individual and organizational frames of reference Organizational Behavior and Human Performance, 8, 84–108.CrossRefGoogle Scholar
  34. Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services Psychiatric Services, 52, 1190–1197.PubMedCrossRefGoogle Scholar
  35. Hofmann, D. A., Griffin, M. H., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations. San Francisco: Jossey-Bass.Google Scholar
  36. Hofstede, G. (1998). Attitudes, values and organizational culture: Disentangling the concepts Organization Studies, 19, 477–492.CrossRefGoogle Scholar
  37. Hofstede, G., Neuijen, B., Ohayv, D. D., & Sanders, G. (1990). Measuring organizational cultures: A qualitative and quantitative study across twenty states. Administrative Science Quarterly, 35, 286–316.CrossRefGoogle Scholar
  38. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling, 6, 1–55.CrossRefGoogle Scholar
  39. James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning Journal of Applied Psychology, 74, 739–751.CrossRefGoogle Scholar
  40. James, L. R., Demaree, R. G., & Wolf, G. (1993). Rwg: An assessment of within-group interrater agreement Journal of Applied Psychology, 75(2), 306–309.CrossRefGoogle Scholar
  41. James, L. R., & Williams, L. J. (2000). The cross-level operator in regression, ANCOVA, contextual analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 382–424). San Francisco: Jossey-Bass.Google Scholar
  42. Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions Organizational Behavior and Human Performance, 23, 201–250.CrossRefGoogle Scholar
  43. Joyce, W. F., & Slocum, J. W. (1984). Collective climate: Agreement as a basis for defining aggregate climates in organizations Academy of Management Journal, 24(4), 721–742.CrossRefGoogle Scholar
  44. Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments Journal of Consulting and Clinical Psychology, 66, 19–36.PubMedCrossRefGoogle Scholar
  45. Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment Journal of Applied Psychology, 86(1), 3–16.PubMedCrossRefGoogle Scholar
  46. Klein, K. J., & Kozlowski, S. W. J. (2000a). From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods, 3(3), 211–236.CrossRefGoogle Scholar
  47. Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000b). Multi-level theory, research, and methods in organizations. San Francisco: Jossey-Bass.Google Scholar
  48. Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.CrossRefGoogle Scholar
  49. Locke, E. A. (1976). The nature and causes of job satisfaction. New York: McGraw-Hill.Google Scholar
  50. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling Psychological Methods, 1, 130–149.CrossRefGoogle Scholar
  51. Morris, J. H., & Sherman, J. D. (1981). Generalizability of an organizational commitment model Academy of Management Journal, 24, 512–526.CrossRefGoogle Scholar
  52. Mowday, R., Porter, L., & Steers, R. (1982). Organizational linkages: The psychology of commitment, absenteeism, and turnover. New York: Academic Press.Google Scholar
  53. Nelson, T. D., & Steele, R. F. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34, 319–330.PubMedCrossRefGoogle Scholar
  54. Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges Administrative Policy in Mental Health and Mental Health Services Research, 33, 398–409.CrossRefGoogle Scholar
  55. NSCAW Research Group (2002). Methodological lessons from the National Survey of Child and Adolescent Well-Being: The first three years of the USA’s first national probability study of children and families investigated for abuse and neglect Children and Youth Services Review, 24(6–7), 513–541.Google Scholar
  56. Pettigrew, A. (1979). On studying organizational cultures Administrative Science Quarterly, 24, 570–581.CrossRefGoogle Scholar
  57. Porras, J. I., & Robertson, P. J. (1992). Organizational development: Theory, practice, and research. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3 pp. 719–822). Palo Alto, CA: Consulting Psychologists Press, Inc.Google Scholar
  58. Raudenbush, S. W., & Bryk, A. S. (2002) Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.Google Scholar
  59. Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Loncolnwood, IL: Scientific Software International.Google Scholar
  60. Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco: Jossey-Bass.Google Scholar
  61. Rousseau, D. M. (1977). Technological differences in job characteristics, employee satisfaction and motivation: A synthesis of job design research and sociotechnical systems theory Organizational Behavior and Human Performance, 19, 18–42.CrossRefGoogle Scholar
  62. Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level, cross-level perspectives. In B. M. Stow & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1–37). Greenwich, CT: JAI Press.Google Scholar
  63. Rousseau, D. M. (1990). Assessing organizational culture: The case for multiple methods. In B. Schneider (Ed.), Organizational climate and culture (pp. 153–192). San Francisco: Jossey-Bass.Google Scholar
  64. Stackman, R. W., Pinder, C. C., & Connor, P. E. (2000). Values lost: Redirecting research on values in the workplace. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate, (pp. 37–54). Thousand Oaks, CA: Sage Publications.Google Scholar
  65. Verbeke, W., Volgering, M., & Hessels, M. (1998). Exploring the conceptual expansion within the field of organizational behavior: Organizational climate and organizational culture. Journal of Management Studies, 35(3), 303–329.CrossRefGoogle Scholar
  66. Viteles, M. S. (1953). Motivation and morale in industry. New York: W.W. Norton.Google Scholar
  67. Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-basted treatments and case examples. Cambridge: Cambridge University Press.Google Scholar
  68. Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy American Psychologist, 47, 1578–1585.PubMedCrossRefGoogle Scholar
  69. Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Charles Glisson
    • 1
  • John Landsverk
    • 1
  • Sonja Schoenwald
    • 1
  • Kelly Kelleher
    • 1
  • Kimberly Eaton Hoagwood
    • 1
  • Stephen Mayberg
    • 1
  • Philip Green
    • 1
  • The Research Network on Youth Mental Health
    • 1
  1. 1.Children’s Mental Health Services Research CenterUniversity of TennesseeKnoxvilleUSA

Personalised recommendations