Skip to main content
SpringerLink
Log in

Transportability of Multisystemic Therapy: Evidence for Multilevel Influences

  • Published:
Mental Health Services Research

Abstract

This study examines factors associated with the implementation and short-term outcomes in dissemination sites of Multisystemic Therapy (MST), an intensive, short-term, family- and community-based treatment for serious antisocial behavior in youth. Participants were 666 children and families served by 217 therapists in 39 sites. Pre- (T1) to immediate posttreatment (T2) differences in child problems and functioning were similar in magnitude to those found in randomized trials of MST. Results of random effects regression supported direct effects of therapist adherence, organizational climate, and structure at baseline on immediate posttreatment child outcomes. However, organizational factors were unrelated to adherence; thus, a hypothesized mediation model in which organizational climate and structure affect outcomes through therapist adherence to MST was not supported. Furthermore, the direction of associations between some organizational climate variables and outcomes countered expectations. Post hoc moderation analyses clarify these findings, with organizational effects differing by level of therapist adherence during treatment. Implications for the transfer of evidence-based psychosocial treatments for youth to usual care practice settings are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Achenbach T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington: University of Vermont, Department of Psychiatry.

    Google Scholar 

  • American College of Mental Health Administration. (1997). Final Report, The Santa Fe Summit on behavioral health: Preserving quality and value in the managed care equation. Pittsburgh, PA: Author.

    Google Scholar 

  • Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.

    Google Scholar 

  • Bickman, L. (1999). Practice makes perfect and other myths about mental health services. American Psychologist, 54, 965-987.

    Google Scholar 

  • Bickman, L., Lambert, E. W., Karver, M., & Andrade, A. R. (1998). Two low-cost measures of child and adolescent functioning for services research. Evaluation and Programming Planning, 21, 263-275.

    Google Scholar 

  • Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Brown, B. S. (1995). Reducing impediments to technology transfer in drug abuse programming. In T. E. Backer, S. L. David, & G. Soucy (Eds.), Reviewing the behavioral science knowledge base on technology transfer (NIDA Research Monograph 155, NIH Publication No. 95–4035) (pp. 169-185). Rockville, MD: National Institute on Drug Abuse.

    Google Scholar 

  • Brown, B. S. (2000). From research to practice: The bridge is out and the water's rising. In J. A. Levy, R. C. Stephens, & D. C. McBride (Eds.), Emerging issues in the field of drug abuse. Advances in Medical Sociology (Vol. 7, pp. 345-365). Stamford, CT: JAI Press.

    Google Scholar 

  • Burns, B. J. (1999). A call for a mental health services research agenda for youth with serious emotional disturbance. Mental Health Services Research, 1, 5-20.

    Google Scholar 

  • Burns, B. J., Hoagwood, K., & Mrazek, P. J. (1999). Effective treatment for mental disorders in children and adolescents. Clinical Child and Family Psychology Review, 2, 199-254.

    Google Scholar 

  • Gibbons, R. D., & Bock, R. D. (1987). Trend in correlated proportions. Psychometrika, 52, 113-124.

    Google Scholar 

  • Glisson, C. (1992). Structure and technology in human service organizations. In Y. Hasenfeld (Ed.), Human services as complex organizations (pp. 184-202). Newbury Park, CA: Sage.

    Google Scholar 

  • Glisson, C. (2000). Organizational culture and climate. In R. Patti (Ed.), The handbook of social welfare management (pp. 195-217). Thousand Oaks, CA: Sage Publications.

    Google Scholar 

  • Glisson, C., & Hemmelgarn, A. L. (1998). The effects of organizational climate and interorganizational coordination on the quality and outcomes of children's service systems. Child Abuse and Neglect, 22(5, 401-421.

    Google Scholar 

  • Goldstein, H. (1995). Multilevel statistical models (2nd ed.). New York: Halstead Press.

    Google Scholar 

  • Hage, J., & Aiken, M. (1967). Relationship of centralization to other structural properties. Administrative Science Quarterly, 12, 73-92.

    Google Scholar 

  • Hall, R. H. (1963). The concept of bureaucracy: An empirical assessment. American Journal of Sociology, 69, 32-40.

    Google Scholar 

  • Halliday-Boykins, C. A., & Henggeler, S. W. (2001). Multisystemic therapy: Theory, research and practice. In E. Walton, P. A. Sandau-Beckler, & M. Mannes (Eds.), Balancing family-centered services and child well-being (pp. 320-335). New York: Columbia University Press.

    Google Scholar 

  • Hemmelgarn, A. L., Glisson, C., & Dukes, D. (2001). Emergency room culture and the emotional support component of Family-Centered Care. Children's Health Care, 30, 93-110.

    Google Scholar 

  • Henggeler, S. W., & Borduin, C. M. (1992). Multisystemic Therapy Adherence Scales. Unpublished instrument, Department of Psychiatry and Behavioral Sciences, Medical University of South Carolina.

  • Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833.

    Google Scholar 

  • Henggeler, S. W., Melton, G. B., & Smith, L. A. (1992). Family preservation using multisystemic therapy: An effective alternative to incarcerating serious juvenile offenders. Journal of Consulting and Clinical Psychology, 60, 953-961.

    Google Scholar 

  • Henggeler, S. W., Pickrel, S. G., & Brondino, M. J. (1999). Multisystemic treatment of substance abusing and dependent delinquents: Outcomes, treatment fidelity, and transportability. Mental Health Services Research, 1, 171-184.

    Google Scholar 

  • Henggeler, S. W., Rowland, M. R., Randall, J., Ward, D., Pickrel, S. G., Cunningham, P. B., et al. (1999). Home-based multisystemic therapy as an alternative to the hospitalization of youth in psychiatric crisis: Clinical outcomes. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1331-1339.

    Google Scholar 

  • Henggeler, S. W., & Schoenwald, S. K. (1998). The MST supervisory manual: Promoting quality assurance at the clinical level. Charleston, SC: MST Services, Inc.

    Google Scholar 

  • Henggeler, S. W., & Schoenwald, S. K. (1999). The role of quality assurance in achieving outcomes in MST programs. Journal of Juvenile Justice and Detention Services, 14, 1-17.

    Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Borduin, C. M., Rowland, M. D., & Cunningham, P. B. (1998), Multisystemic treatment of antisocial behavior in children and adolescents. New York and London: Guilford Press.

    Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Liao, J. G., Letourneau, E. J., & Edwards, D. L. (2002). Transporting efficacious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs. Journal of Clinical Child Psychology, 31, 155-167.

    Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., & Munger, R. L. (1996). Families and therapists achieve clinical outcomes, systems of care mediate the process. Journal of Child and Family Studies, 5, 177-183.

    Google Scholar 

  • Henggeler, S. W., Schoenwald, S. K., Rowland, M. D., & Cunningham, P. B. (2002). Serious emotional disturbance in children and adolescents: Multisystemic therapy. New York: Guilford Press.

    Google Scholar 

  • Hoagwood, K., Burns, B. J., Kiser, L., Ringeisen, H., & Schoenwald, S. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179-1189.

    Google Scholar 

  • Hoagwood, K., Burns, B. J., & Weisz, J. (2002). A profitable conjunction: From science to service in children's mental health. In B. J. Burns & K. Hoagwood (Eds.), Community-based interventions for youth with severe emotional disturbances (pp. 327-338). New York: Oxford University Press.

    Google Scholar 

  • Hoagwood, K., Hibbs, E., Brent, D., & Jensen, P. (1995). Introduction to the special section: Efficacy and effectiveness studies of child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 683-687.

    Google Scholar 

  • Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24, 623-641.

    Google Scholar 

  • Hohmann, A. A., & Shear, M. K. (2002). Community-based intervention research: Coping with the noise in real life in study design. American Journal of Psychiatry, 159, 201-207.

    Google Scholar 

  • Holmbeck, G. N. (1997). Toward terminological, conceptual, and statistical clarity in the study of mediators: Examples from the child-clinical and pediatric psychology literatures. Journal of Consulting and Clinical Psychology, 65, 599-610.

    Google Scholar 

  • Huey, S. J., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451-467.

    Google Scholar 

  • James, L.R., & Sells, S.B. (1981). Psychological climate: Theoretical perspectives and empirical research. In D. Magnussen (Ed.), The situation: An interactional perspective (pp. 275-295). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.

    Google Scholar 

  • Letourneau, E. J., Sheidow, A. J., & Schoenwald, S. K. (2002). Structure and reliability of the MST therapist adherence scale in a large community sample. Charleston: Family Services Research Center, Medical University of South Carolina.

    Google Scholar 

  • Loeber, R., & Farrington, D. P. (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Raudenbush, S. W., & Bryk A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • Rogers, E. M. (1995). Diffusion of Innovations (4th ed.). New York: The Free Press.

    Google Scholar 

  • Rosenheck, R. A. (2001). Organizational process: A missing link between research and practice. Psychiatric Services, 52, 1607-1612.

    Google Scholar 

  • SAS Institute (2000). SAS/STAT User's Guide, Version 8. Cary, NC: SAS Institute Inc.

    Google Scholar 

  • Schoenwald, S. K. (1998). Multisystemic therapy consultation guidelines. Charleston, SC: MST Institute.

    Google Scholar 

  • Schoenwald, S. K., Halliday-Boykins, C., & Henggeler, S. W. (2003). Client-level predictors of adherence to MST in community service settings. Family Process, 42, 345-359.

    Google Scholar 

  • Schoenwald, S. K., & Henggeler, S. W. (2002). Services research and family based treatment. In H. A. Liddle, D. A. Santisteban, R. F. Levant, & J. H. Bray (Eds.), Family psychology: Science-based interventions (pp. 259-282). Washington, DC: American Psychological Association.

    Google Scholar 

  • Schoenwald, S. K., Henggeler, S. W., Brondino, M. J., & Rowland, M. D. (2000). Multisystemic therapy: Monitoring treatment fidelity. Family Process, 39, 83-103.

    Google Scholar 

  • Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1190-1197.

    Google Scholar 

  • Schoenwald, S. K., Letourneau, E. J., & Halliday-Boykins, C. A. (2003). Therapist and client predictors of adherence to MST in community service settings. Manuscript in preparation.

  • Scott, W. R. (1990). Technology and structure: An organizational level perspective. In P. S. Goodman & L. S. Sproull (Eds.), Technology and organizations. San Francisco: Jossey-Bass.

    Google Scholar 

  • Shaw, B. F., Olmsted, M., Dobson, K. S., Sotsky, S. M., Elkin, I., Yamaguchi, J., et al. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837-846.

    Google Scholar 

  • Sheidow, A. J., Schoenwald, S. K., & Liao, J. G. (2002). Adaptation of organizational climate and structure scales for use with child and family therapy providers. Charleston: Family Services Research Center, Medical University of South Carolina.

    Google Scholar 

  • Simpson, D. D. (2002). A conceptual framework for transferring research to practice. Journal of Substance Abuse Treatment, 4, 171-182.

    Google Scholar 

  • Snijders, T. A. B., & Bosker, R. J. (1994). Modeled variance in two-level models. Sociological Methods and Research, 22, 342-344.

    Google Scholar 

  • Stiratelli, R., Laird, N. M., & Ware, J. H. (1984). Random-effects models for serial observations with binary response. Biometrics, 40, 961-971.

    Google Scholar 

  • U.S. Public Health Service. (2000). Report of the Surgeon General's Conference on Children's Mental Health: A national action agenda. Washington, DC: Author.

    Google Scholar 

  • Weisz, J. R. (2000). Agenda for child and adolescent psychotherapy research: On the need to put science into practice. Archives of General Psychiatry, 57, 837-838.

    Google Scholar 

  • Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychiatry & Behavioral Sciences, Medical University of South Carolina, Charleston, South Carolina

    Sonja K. Schoenwald, Ashli J. Sheidow & Elizabeth J. Letourneau

  2. Division of Biometrics, University of Medicine and Dentistry of New Jersey, New Brunswick, New Jersey

    Jason G. Liao

Authors
  1. Sonja K. Schoenwald
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ashli J. Sheidow
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elizabeth J. Letourneau
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jason G. Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Schoenwald, S.K., Sheidow, A.J., Letourneau, E.J. et al. Transportability of Multisystemic Therapy: Evidence for Multilevel Influences. Ment Health Serv Res 5, 223–239 (2003). https://doi.org/10.1023/A:1026229102151

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1026229102151

Search

Navigation