Abstract
The organizational social context in which mental health services are provided is believed to affect the adoption and implementation of evidence-based practices (EBPs) as well as the quality and outcomes of the services. A fully developed science of implementation effectiveness requires conceptual models that include organizational social context and tools for assessing social context that have been tested in a broad cross-section of mental health systems. This paper describes the role of organizational social context in services and implementation research and evaluates a comprehensive contextual measure, labeled Organizational Social Context (OSC), designed to assess the key latent constructs of culture, climate and work attitudes. The psychometric properties of the OSC measure were assessed in a nationwide study of 1,154 clinicians in 100 mental health clinics with a second-order confirmatory factor analysis of clinician responses, estimates of scale reliabilities, and indices of within-clinic agreement and between-clinic differences among clinicians. Finally, the paper illustrates the use of nationwide norms in describing the OSC profiles of individual mental health clinics and examines the cross-level association of organizational-level culture and climate with clinician-level work attitudes.
Similar content being viewed by others
References
Aarons, G. A., & Palinkas, L. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.
Aarons, G. A., & Sawitzky, A. C. (2006). Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services Administration and Policy in Mental Health and Mental Health Services Research, 33(3), 289–301.
Argyris, C. (1958). Some problems in conceptualizing organizational climate: A case study of a bank Administrative Science Quarterly, 2, 501–520.
Ashkanasy, N. M., Broadfoot, L. E., & Falkus, S. (2000a). Questionnaire measures of organizational culture. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate (pp. 131–146). Thousand Oaks, CA: Sage Publications, Inc.
Ashkanasy, N. M., Wilderom, C. P. M., Peterson, M. F. (Eds.) (2000b). Handbook of organizational culture and climate. Thousand Oaks, CA: Sage Publications.
Bickman, L. (1996a). The evaluation of a children’s mental health managed care demonstration Journal of Mental Health Administration, 23(1), 7–15.
Bickman, L. (1996b). A continuum of care: More is not always better American Psychologist, 51, 689–701.
Bliese, P. (2000). Within-group agreement, non-independence, and reliability. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 349–381). San Francisco: Jossey-Bass.
Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents Clinical Child and Family Psychology Review, 2, 199–242.
Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health needs and access to mental health services by youths involved with child welfare: A national survey Journal of the American Academy of Child and Adolescent Psychiatry, 43(8), 960–970.
Byrne, B. M. (1998). Structural equation modeling with LISREL, PRELIS, and SIMPLIS: Basic concepts, applications, and programming. Mahway, NJ: Lawrence Erlbaum Associates.
Chan, D. (1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models Journal of Applied Psychology, 83, 234–246.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
Dowd, K., Kinsey, S., Wheeless, S., Thissen, R. Richardson, J., Suresh, R., et al. (2004). National Survey of Child and Adolescent Well-Being (NSCAW), combined waves 1–4, data file user’s manual, restricted release version. Research Triangle Institute, University of North Carolina at Chapel Hill, and Caliber Associates, University of California at Berkeley.
Fleishman, E. A. (1953). Leadership climate, human relations training, and supervisory behavior Personnel Psychology, 6, 205–222.
Glisson, C. (1978). Dependence of technological routinization on structural variables in human service organizations Administrative Science Quarterly, 23, 383–395.
Glisson, C. (2002). The organizational context of children’s mental health services. Clinical Child and Family Psychology Review, 5(4), 233–253.
Glisson, C., & Durick, M. (1988). Predictors of job satisfaction and organizational commitment in human service organizations Administrative Science Quarterly, 33, 61–81.
Glisson, C., & Green, P. (2006). The effects of organizational culture and climate on the access to mental health care in child welfare and juvenile justice systems Administration and Policy in Mental Health and Mental Health Services Research, 33(4), 433–448.
Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children’s service systems. Child Abuse & Neglect, 22(5), 401–421.
Glisson, C., & James, L. R. (2002). The cross-level effects of culture and climate in human service teams Journal of Organizational Behavior, 23, 767–794.
Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.
Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients’ care Lancet, 362(9391), 1225–1230.
Hackman, J. R., & Oldham, G. R. (1975). Development of the job diagnostic survey. Journal of Applied Psychology, 60, 159–170.
Handy, C. B. (1976). Understanding organizations. New York: Penguin Books.
Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Hoboken, NJ: John Wiley & Sons.
Hedeker, D., Gibbons, R. D., & Flay, B. R. (1994). Random-effects regression models for clustered data with an example from smoking prevention research Journal of Consulting and Clinical Psychology, 62, 757–765.
Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of family-centered care Children’s Health Care, 30(2), 93–110.
Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and intervention research Clinical Psychology: Science and Practice, 13(1), 73–93.
Herman, J. B., Dunham, R. B., & Hulin, C. L. (1975). Organizational structure, demographic characteristics, and employee responses Organizational Behavior and Human Performance, 13(2), 206–232.
Herman, J. B., & Hulin, C. L. (1972). Studying organizational attitudes from individual and organizational frames of reference Organizational Behavior and Human Performance, 8, 84–108.
Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. K. (2001). Evidence-based practice in child and adolescent mental health services Psychiatric Services, 52, 1190–1197.
Hofmann, D. A., Griffin, M. H., & Gavin, M. B. (2000). The application of hierarchical linear modeling to organizational research. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations. San Francisco: Jossey-Bass.
Hofstede, G. (1998). Attitudes, values and organizational culture: Disentangling the concepts Organization Studies, 19, 477–492.
Hofstede, G., Neuijen, B., Ohayv, D. D., & Sanders, G. (1990). Measuring organizational cultures: A qualitative and quantitative study across twenty states. Administrative Science Quarterly, 35, 286–316.
Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives Structural Equation Modeling, 6, 1–55.
James, L. A., & James, L. R. (1989). Integrating work environment perceptions: Explorations into the measurement of meaning Journal of Applied Psychology, 74, 739–751.
James, L. R., Demaree, R. G., & Wolf, G. (1993). Rwg: An assessment of within-group interrater agreement Journal of Applied Psychology, 75(2), 306–309.
James, L. R., & Williams, L. J. (2000). The cross-level operator in regression, ANCOVA, contextual analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multi-level theory, research, and methods in organizations (pp. 382–424). San Francisco: Jossey-Bass.
Jones, A. P., & James, L. R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions Organizational Behavior and Human Performance, 23, 201–250.
Joyce, W. F., & Slocum, J. W. (1984). Collective climate: Agreement as a basis for defining aggregate climates in organizations Academy of Management Journal, 24(4), 721–742.
Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments Journal of Consulting and Clinical Psychology, 66, 19–36.
Klein, K. J., Conn, A. B., Smith, D. B., & Sorra, J. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment Journal of Applied Psychology, 86(1), 3–16.
Klein, K. J., & Kozlowski, S. W. J. (2000a). From micro to meso: Critical steps in conceptualizing and conducting multilevel research Organizational Research Methods, 3(3), 211–236.
Klein, K. J., & Kozlowski, S. W. J. (Eds.). (2000b). Multi-level theory, research, and methods in organizations. San Francisco: Jossey-Bass.
Klein, K. J., & Sorra, J. S. (1996). The challenge of innovation implementation. Academy of Management Review, 21, 1055–1080.
Locke, E. A. (1976). The nature and causes of job satisfaction. New York: McGraw-Hill.
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling Psychological Methods, 1, 130–149.
Morris, J. H., & Sherman, J. D. (1981). Generalizability of an organizational commitment model Academy of Management Journal, 24, 512–526.
Mowday, R., Porter, L., & Steers, R. (1982). Organizational linkages: The psychology of commitment, absenteeism, and turnover. New York: Academic Press.
Nelson, T. D., & Steele, R. F. (2007). Predictors of practitioner self-reported use of evidence-based practices: Practitioner training, clinical setting, and attitudes toward research. Administration and Policy in Mental Health and Mental Health Services Research, 34, 319–330.
Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges Administrative Policy in Mental Health and Mental Health Services Research, 33, 398–409.
NSCAW Research Group (2002). Methodological lessons from the National Survey of Child and Adolescent Well-Being: The first three years of the USA’s first national probability study of children and families investigated for abuse and neglect Children and Youth Services Review, 24(6–7), 513–541.
Pettigrew, A. (1979). On studying organizational cultures Administrative Science Quarterly, 24, 570–581.
Porras, J. I., & Robertson, P. J. (1992). Organizational development: Theory, practice, and research. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3 pp. 719–822). Palo Alto, CA: Consulting Psychologists Press, Inc.
Raudenbush, S. W., & Bryk, A. S. (2002) Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.
Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Loncolnwood, IL: Scientific Software International.
Reichers, A. E., & Schneider, B. (1990). Climate and culture: An evolution of constructs. In B. Schneider (Ed.), Organizational climate and culture (pp. 5–39). San Francisco: Jossey-Bass.
Rousseau, D. M. (1977). Technological differences in job characteristics, employee satisfaction and motivation: A synthesis of job design research and sociotechnical systems theory Organizational Behavior and Human Performance, 19, 18–42.
Rousseau, D. M. (1985). Issues of level in organizational research: Multi-level, cross-level perspectives. In B. M. Stow & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1–37). Greenwich, CT: JAI Press.
Rousseau, D. M. (1990). Assessing organizational culture: The case for multiple methods. In B. Schneider (Ed.), Organizational climate and culture (pp. 153–192). San Francisco: Jossey-Bass.
Stackman, R. W., Pinder, C. C., & Connor, P. E. (2000). Values lost: Redirecting research on values in the workplace. In N. M. Ashkanasy, C. P. M. Wilderom, & M. F. Peterson (Eds.), Handbook of organizational culture and climate, (pp. 37–54). Thousand Oaks, CA: Sage Publications.
Verbeke, W., Volgering, M., & Hessels, M. (1998). Exploring the conceptual expansion within the field of organizational behavior: Organizational climate and organizational culture. Journal of Management Studies, 35(3), 303–329.
Viteles, M. S. (1953). Motivation and morale in industry. New York: W.W. Norton.
Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-basted treatments and case examples. Cambridge: Cambridge University Press.
Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy American Psychologist, 47, 1578–1585.
Williams, L. J., & Hazer, J. T. (1986). Antecedents and consequences of satisfaction and commitment in turnover models: A reanalysis using latent variable structural equation methods. Journal of Applied Psychology, 71(2), 219–231.
Author information
Authors and Affiliations
Consortia
Corresponding author
Additional information
The Research Network on Youth Mental Health is a collaborative network funded by the John D. and Catherine T. MacArthur Foundation. Network Members at the time this work was performed included: John Weisz, Ph.D. (Network Director), Bruce Chorpita, Ph.D., Robert Gibbons, Ph.D., Charles Glisson, Ph.D., Evelyn Polk Green, M.A., Kimberly Hoagwood, Ph.D., Peter S. Jensen, M.D., Kelly Kelleher, M.D., John Landsverk, Ph.D., Stephen Mayberg, Ph.D., Jeanne Miranda, Ph.D., Lawrence Palinkas, Ph.D., Sonja Schoenwald, Ph.D.
Rights and permissions
About this article
Cite this article
Glisson, C., Landsverk, J., Schoenwald, S. et al. Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice. Adm Policy Ment Health 35, 98–113 (2008). https://doi.org/10.1007/s10488-007-0148-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-007-0148-5