Skip to main content

Advertisement

Log in

Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative

  • Published:
Prevention Science Aims and scope Submit manuscript

Abstract

Over the past four decades, significant strides have been made in the science of preventing youth problem behaviors. Subsequently, policymakers and funders have begun to insist on the use of evidence-based programs (EBPs) as a requirement for funding. However, unless practitioners are able to sustain these programs beyond initial seed funding, they are unlikely to achieve their ultimate goal of broad public health impact. Despite its obvious importance, sustainability has received relatively little attention in prevention science until recently. Moreover, there have been few opportunities to study the correlates of sustainability in large-scale, multi-year initiatives involving multiple programs. The present study examined rates of sustainment of a wide range of proven-effective prevention and intervention programs; identified factors related to organizational support and readiness, program and implementer characteristics, and sustainability planning that distinguished sustained programs; and examined variability in these associations across classroom-based, community/mentoring, family-focused prevention, and family treatment program types within the context of a state-wide EBP dissemination initiative in Pennsylvania over 4 years. The majority of EBPs sustained functioning 2 years or more beyond their initial funding. In general, sustained programs reported greater community coalition functioning, communication to key stakeholders, knowledge of the program's logical model, communication with the trainer or program developer, and sustainability planning. In addition to these universal correlates, important program-specific correlates emerged as well. Implications for the technical assistance and support necessary to promote the sustainability of EBPs in nonresearch contexts are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adelman, H. S., & Taylor, L. (2000). Moving prevention from the fringes into the fabric of school improvement. Journal of Educational and Psychological Consultation, 11, 7–36.

    Article  Google Scholar 

  • Adelman, H. S., & Taylor, L. (2003). On sustainability of project innovations as systemic change. Journal of Educational and Psychological Consultation, 14, 1–25.

    Article  Google Scholar 

  • Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211.

    Article  Google Scholar 

  • August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006). Can evidence-based prevention programs be sustained in community practice settings? The Early Risers' advanced-stage effectiveness trial. Prevention Science, 7, 151–165. doi:10.1007/s11121-005-0024-z.

    Article  PubMed  Google Scholar 

  • Barrera, M., Jr., & Sandler, I. N. (2006). Prevention: A report of progress and momentum into the future. Clinical Psychology: Science and Practice, 13, 221–226. doi:10.1111/j.1468-2850.2006.00028.x.

    Google Scholar 

  • Brown, L. D., Feinberg, M. E., & Greenberg, M. T. (2010). Determinants of community coalition ability to support evidence-based programs. Prevention Science, 11, 287–297.

    Article  PubMed Central  PubMed  Google Scholar 

  • Bumbarger, B., & Perkins, D. F. (2008). After randomised trials: Issues related to dissemination of evidence-based interventions. Journal of Children's Services, 3(2), 53–61.

    Article  Google Scholar 

  • Bumbarger, B., Perkins, D. F., & Greenberg, M. (2010). Taking effective prevention to scale. In B. Doll, W. Pfohl, & J. Yoon (Eds.), Handbook of youth prevention science (pp. 433–444). New York: Routledge.

    Google Scholar 

  • Chambers, D. A. (2011). Advancing sustainability research: Challenging existing paradigms. Journal of Public Health Dentistry, 71, S99–S100.

    Article  PubMed  Google Scholar 

  • Cohen, D. K., & Ball, D. L. (2007). Educational innovation and the problem of scale. Scale up in Education, 1, 19–36.

    Google Scholar 

  • Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.

    Article  PubMed  Google Scholar 

  • Elias, M. J., Zins, J. E., Graczyk, P. A., & Weissburg, R. P. (2003). Implementation, sustainability, and scaling up of social-emotional and academic innovations in public schools. School Psychology Review, 32(3), 303–319.

    Google Scholar 

  • Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–52.

    Article  PubMed  Google Scholar 

  • Emshoff, J. G. (2008). Researchers, practitioners, and funders: Using the framework to get us on the same page. American Journal of Community Psychology, 41, 393–403.

    Article  PubMed  Google Scholar 

  • Fagan, A. A., Hanson, K., Hawkins, J. D., & Arthur, M. W. (2008). Implementing effective community-based prevention programs in the community youth development study. Youth Violence and Juvenile Justice, 6, 256–278.

    Article  Google Scholar 

  • Fagen, M. C., & Flay, B. R. (2009). Comments on Challenges in sustaining public health interventions. Health Education & Behavior, 36, 29–30. doi:10.1177/1090198107299789.

    Article  Google Scholar 

  • Feinberg, M. E., Bontempo, D. E., & Greenberg, M. T. (2008). Predictors and level of sustainability of community prevention coalitions. American Journal of Preventive Medicine, 34, 495–501.

    Article  PubMed  Google Scholar 

  • Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida.

    Google Scholar 

  • Greenhalgh, T., Robert, G., MacFarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82, 581–629.

    Article  PubMed Central  PubMed  Google Scholar 

  • Gregory, A., Henry, D. B., Schoeny, M. E., & The Metropolitan Area Child Study Research Group. (2007). School climate and implementation of a preventive intervention. American Journal of Community Psychology, 40, 250–260. doi:10.1007/s10464-007-9142-z.

    Article  PubMed  Google Scholar 

  • Han, S. S., & Weiss, B. (2005). Sustainability of teacher implementation of school-based mental health programs. Journal of Abnormal Child Psychology, 33, 665–679.

    Article  PubMed  Google Scholar 

  • Hoelscher, D., Feldman, H. A., Johnson, C. C., Lytle, L. A., Osganian, S. K., Parcel, G. S., Kelder, S. H., et al. (2004). School-based health education programs can be maintained over time: Results from the CATCH Institutionalization study. Preventive Medicine, 38, 594–606. doi:10.1016/j.ypmed.2003.11.017.

    Article  PubMed  Google Scholar 

  • Johnson, K., Hays, C., Center, H., & Daley, C. (2004). Building capacity and sustainable prevention innovations: A sustainability planning model. Evaluation and Program Planning, 27, 135–149.

    Article  CAS  Google Scholar 

  • Langberg, J., & Smith, B. (2006). Developing evidence-based interventions for deployment into school settings: A case example highlighting key issues of efficacy and effectiveness. Evaluation and Program Planning, 29, 323–334. doi:10.1016/j.evalprogplan.2006.02.002.

    Article  PubMed  Google Scholar 

  • Lyon, A. R., Frazier, S. L., Mehta, T., Atkins, M. S., & Weisbach, J. (2011). Easier said than done: Intervention sustainability in an urban after-school program. Administration and Policy in Mental Health & Mental Health Services, 38, 504–517.

    Article  Google Scholar 

  • McCall, R. B. (2009). Evidence-based programming in the context of practice and policy. Social Policy Report, 23, 3–18.

    Google Scholar 

  • Miller, R. L., & Shinn, M. (2005). Learning from communities: Overcoming difficulties in dissemination of prevention and promotion efforts. American Journal of Community Psychology, 35, 169–183. doi:10.1007/s10464-005-3395-1.

    Article  PubMed  Google Scholar 

  • National Research Council and Institute of Medicine. (2009). Preventing mental, emotional, and behavioral disorders among young people: Progress and possibilities. Committee on the Prevention of Mental Disorders and Substance Abuse Among Children, Youth, and Young Adults: Research Advances and Promising Interventions. In M. E. O'Connell, T. Boat, & K. E. Warner (Eds.), Board on children, youth, and families, division of behavioral and social sciences and education. Washington, DC: The National Academies Press.

    Google Scholar 

  • Redmond, C., & Spoth. (2000). Research on family engagement in preventive interventions: Toward improved use of scientific findings in primary prevention practice. Journal of Primary Prevention, 21, 267–284.

    Article  Google Scholar 

  • Rhoades, B. L., Bumbarger, B. K., & Moore, J. E. (2012). The role of a state-level prevention support system in promoting high quality implementation and sustainability of evidence-based programs. American Journal of Community Psychology, 50, 386–401.

    Article  PubMed  Google Scholar 

  • Ringeisen, H., Henderson, K., & Hoagwood, K. (2003). Context matters: Schools and the “research to practice gap” in children's mental health. School Psychology Review, 32, 153–168.

    Google Scholar 

  • Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.

    Article  Google Scholar 

  • Scheirer, M. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26, 320–347.

    Article  Google Scholar 

  • Scheirer, M. A., & Dearing, J. W. (2011). An agenda for research on the sustainability of public health programs. American Journal of Public Health, 101, 2059–2067.

    Article  PubMed Central  PubMed  Google Scholar 

  • Simpson, D. (2011). A framework for implementing sustainable oral health promotion interventions. Journal of Public Health Dentistry, 71, S84–S94.

    Article  PubMed Central  Google Scholar 

  • Tibbits, M. K., Bumbarger, B. K., Kyler, S. J., & Perkins, D. F. (2010). Sustaining evidence-based interventions under real-world conditions: Results from a large-scale diffusion project. Prevention Science, 11, 252–262.

    Article  PubMed Central  PubMed  Google Scholar 

  • Willis, K., Small, R., & Brown, B. (2012). Using documents to investigate links between implementation and sustainability in a complex community intervention: The PRISM study. Social Science & Medicine, 75, 1222–1229.

    Article  Google Scholar 

  • Wiltsey Stirman, S., Kimberly, J., Cook, N., Calloway, A., Castro, F., & Charns, M. (2012). The sustainability of new programs and innovations: A review of the empirical literature and recommendations for future research. Implementation Science, 7, 1–19.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brittany Rhoades Cooper.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cooper, B.R., Bumbarger, B.K. & Moore, J.E. Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative. Prev Sci 16, 145–157 (2015). https://doi.org/10.1007/s11121-013-0427-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11121-013-0427-1

Keywords

Navigation