Skip to main content

Advertisement

Log in

Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice

  • Original Paper
  • Published:
Administration and Policy in Mental Health and Mental Health Services Research Aims and scope Submit manuscript

Abstract

The organizational social context in which mental health services are provided is believed to affect the adoption and implementation of evidence-based practices (EBPs) as well as the quality and outcomes of the services. A fully developed science of implementation effectiveness requires conceptual models that include organizational social context and tools for assessing social context that have been tested in a broad cross-section of mental health systems. This paper describes the role of organizational social context in services and implementation research and evaluates a comprehensive contextual measure, labeled Organizational Social Context (OSC), designed to assess the key latent constructs of culture, climate and work attitudes. The psychometric properties of the OSC measure were assessed in a nationwide study of 1,154 clinicians in 100 mental health clinics with a second-order confirmatory factor analysis of clinician responses, estimates of scale reliabilities, and indices of within-clinic agreement and between-clinic differences among clinicians. Finally, the paper illustrates the use of nationwide norms in describing the OSC profiles of individual mental health clinics and examines the cross-level association of organizational-level culture and climate with clinician-level work attitudes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aarons, G. A., & Palinkas, L. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.

    Article  PubMed  Google Scholar 

  • Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301.

    Article  PubMed  Google Scholar 

  • Argyris, C. (1958). Some problems in conceptualizing organizational climate: A case study of a bank Administrative Science Quarterly, 2, 501–520.

    Article  Google Scholar 

  • Ashkanasy, N. M., Broadfoot, L. E., & Falkus, S. (2000a). Questionnaire measures of organizational culture. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 131–146). Thousand Oaks, CA: Sage Publications, Inc.

    Google Scholar 

  • Ashkanasy, N. M., Wilderom, C. P. M., Peterson, M. F. (Eds.) (2000b). Handbook of organizational culture and climate. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Bickman, L. (1996a). The evaluation of a children’s mental health managed care demonstration Journal of Mental Health Administration, 23(1), 7–15.

    Article  PubMed  CAS  Google Scholar 

  • Bickman, L. (1996b). A continuum of care: More is not always better American Psychologist, 51, 689–701.

    Article  PubMed  CAS  Google Scholar 

  • Bliese, P. (2000). Within-group agreement, non-independence, and reliability. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 349–381). San Francisco: Jossey-Bass.

    Google Scholar 

  • Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

    Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.

    Google Scholar 

  • Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents Clinical Child and Family Psychology Review, 2, 199–242.

    Article  PubMed  CAS  Google Scholar 

  • Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health needs and access to mental health services by youths involved with child welfare: A national survey Journal of the American Academy of Child and Adolescent Psychiatry, 43(8), 960–970.

    Article  PubMed  Google Scholar 

  • Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahway, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models Journal of Applied Psychology, 83, 234–246.

    Article  Google Scholar 

  • Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Dowd, K., Kinsey, S., Wheeless, S., Thissen, R. Richardson, J., Suresh, R., et al. (2004). National Survey of Child and Adolescent Well-Being (NSCAW), combined waves 1–4, data file user’s manual, restricted release version. Research Triangle Institute, University of North Carolina at Chapel Hill, and Caliber Associates, University of California at Berkeley.

  • Fleishman, E. A. (1953). Leadership climate, human relations training, and supervisory behavior Personnel Psychology, 6, 205–222.

    Article  Google Scholar 

  • Glisson, C. (1978). Dependence of technological routinization on structural variables in human service organizations Administrative Science Quarterly, 23, 383–395.

    Article  PubMed  CAS  Google Scholar 

  • Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.

    Article  PubMed  Google Scholar 

  • Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations Administrative Science Quarterly, 33, 61–81.

    Article  Google Scholar 

  • Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448.

    Article  PubMed  Google Scholar 

  • Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421.

    Article  CAS  Google Scholar 

  • Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams Journal of Organizational Behavior, 23, 767–794.

    Article  Google Scholar 

  • Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.

    Article  PubMed  Google Scholar 

  • Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients’ care Lancet, 362(9391), 1225–1230.

    Article  PubMed  Google Scholar 

  • Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170.

    Article  Google Scholar 

  • Handy, C. B. (1976). Understanding organizations. New York: Penguin Books.

    Google Scholar 

  • Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: John Wiley & Sons.

    Google Scholar 

  • Hedeker, D., Gibbons, R. D., & Flay, B. R. (1994). Random-effects regression models for clustered data with an example from smoking prevention research Journal of Consulting and Clinical Psychology, 62, 757–765.

    Article  PubMed  CAS  Google Scholar 

  • Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of family-centered care Children’s Health Care, 30(2), 93–110.

    Article  Google Scholar 

  • Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and intervention research Clinical Psychology: Science and Practice, 13(1), 73–93.

    Article  Google Scholar 

  • Herman, J. B., Dunham, R. B., & Hulin, C. L. (1975). Organizational structure, demographic characteristics, and employee responses Organizational Behavior and Human Performance, 13(2), 206–232.

    Article  Google Scholar 

  • Herman, J. B., & Hulin, C. L. (1972). Studying organizational attitudes from individual and organizational frames of reference Organizational Behavior and Human Performance, 8, 84–108.

    Article  Google Scholar 

  • Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services Psychiatric Services, 52, 1190–1197.

    Article  PubMed  Google Scholar 

  • Hofmann, D. A., Griffin, M. H., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations. San Francisco: Jossey-Bass.

    Google Scholar 

  • Hofstede, G. (1998). Attitudes, values and organizational culture: Disentangling the concepts Organization Studies, 19, 477–492.

    Article  Google Scholar 

  • Hofstede, G., Neuijen, B., Ohayv, D. D., & Sanders, G. (1990). Measuring organizational cultures: A qualitative and quantitative study across twenty states. Administrative Science Quarterly, 35, 286–316.

    Article  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling, 6, 1–55.

    Article  Google Scholar 

  • James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning Journal of Applied Psychology, 74, 739–751.

    Article  Google Scholar 

  • James, L. R., Demaree, R. G., & Wolf, G. (1993). Rwg: An assessment of within-group interrater agreement Journal of Applied Psychology, 75(2), 306–309.

    Article  Google Scholar 

  • James, L. R., & Williams, L. J. (2000). The cross-level operator in regression, ANCOVA, contextual analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 382–424). San Francisco: Jossey-Bass.

    Google Scholar 

  • Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions Organizational Behavior and Human Performance, 23, 201–250.

    Article  Google Scholar 

  • Joyce, W. F., & Slocum, J. W. (1984). Collective climate: Agreement as a basis for defining aggregate climates in organizations Academy of Management Journal, 24(4), 721–742.

    Article  Google Scholar 

  • Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments Journal of Consulting and Clinical Psychology, 66, 19–36.

    Article  PubMed  CAS  Google Scholar 

  • Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment Journal of Applied Psychology, 86(1), 3–16.

    Article  PubMed  CAS  Google Scholar 

  • Klein, K. J., & Kozlowski, S. W. J. (2000a). From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods, 3(3), 211–236.

    Article  Google Scholar 

  • Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000b). Multi-level theory, research, and methods in organizations. San Francisco: Jossey-Bass.

  • Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.

    Article  Google Scholar 

  • Locke, E. A. (1976). The nature and causes of job satisfaction. New York: McGraw-Hill.

    Google Scholar 

  • MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling Psychological Methods, 1, 130–149.

    Article  Google Scholar 

  • Morris, J. H., & Sherman, J. D. (1981). Generalizability of an organizational commitment model Academy of Management Journal, 24, 512–526.

    Article  Google Scholar 

  • Mowday, R., Porter, L., & Steers, R. (1982). Organizational linkages: The psychology of commitment, absenteeism, and turnover. New York: Academic Press.

    Google Scholar 

  • Nelson, T. D., & Steele, R. F. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34, 319–330.

    Article  PubMed  Google Scholar 

  • Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges Administrative Policy in Mental Health and Mental Health Services Research, 33, 398–409.

    Article  Google Scholar 

  • NSCAW Research Group (2002). Methodological lessons from the National Survey of Child and Adolescent Well-Being: The first three years of the USA’s first national probability study of children and families investigated for abuse and neglect Children and Youth Services Review, 24(6–7), 513–541.

    Google Scholar 

  • Pettigrew, A. (1979). On studying organizational cultures Administrative Science Quarterly, 24, 570–581.

    Article  Google Scholar 

  • Porras, J. I., & Robertson, P. J. (1992). Organizational development: Theory, practice, and research. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3 pp. 719–822). Palo Alto, CA: Consulting Psychologists Press, Inc.

    Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2002) Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Loncolnwood, IL: Scientific Software International.

    Google Scholar 

  • Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco: Jossey-Bass.

    Google Scholar 

  • Rousseau, D. M. (1977). Technological differences in job characteristics, employee satisfaction and motivation: A synthesis of job design research and sociotechnical systems theory Organizational Behavior and Human Performance, 19, 18–42.

    Article  Google Scholar 

  • Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level, cross-level perspectives. In B. M. Stow & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1–37). Greenwich, CT: JAI Press.

    Google Scholar 

  • Rousseau, D. M. (1990). Assessing organizational culture: The case for multiple methods. In B. Schneider (Ed.), Organizational climate and culture (pp. 153–192). San Francisco: Jossey-Bass.

    Google Scholar 

  • Stackman, R. W., Pinder, C. C., & Connor, P. E. (2000). Values lost: Redirecting research on values in the workplace. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate, (pp. 37–54). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Verbeke, W., Volgering, M., & Hessels, M. (1998). Exploring the conceptual expansion within the field of organizational behavior: Organizational climate and organizational culture. Journal of Management Studies, 35(3), 303–329.

    Article  Google Scholar 

  • Viteles, M. S. (1953). Motivation and morale in industry. New York: W.W. Norton.

    Google Scholar 

  • Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-basted treatments and case examples. Cambridge: Cambridge University Press.

    Google Scholar 

  • Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy American Psychologist, 47, 1578–1585.

    Article  PubMed  CAS  Google Scholar 

  • Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Consortia

Corresponding author

Correspondence to Charles Glisson.

Additional information

The Research Network on Youth Mental Health is a collaborative network funded by the John D. and Catherine T. MacArthur Foundation. Network Members at the time this work was performed included: John Weisz, Ph.D. (Network Director), Bruce Chorpita, Ph.D., Robert Gibbons, Ph.D., Charles Glisson, Ph.D., Evelyn Polk Green, M.A., Kimberly Hoagwood, Ph.D., Peter S. Jensen, M.D., Kelly Kelleher, M.D., John Landsverk, Ph.D., Stephen Mayberg, Ph.D., Jeanne Miranda, Ph.D., Lawrence Palinkas, Ph.D., Sonja Schoenwald, Ph.D.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Glisson, C., Landsverk, J., Schoenwald, S. et al. Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice. Adm Policy Ment Health 35, 98–113 (2008). https://doi.org/10.1007/s10488-007-0148-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10488-007-0148-5

Keywords

Navigation