Abstract
Although program adaptation is a reality in community-based implementations of evidence-based programs, much of the discussion about adaptation remains theoretical. The primary aim of this study was to replicate two coding systems to examine adaptations in large-scale, community-based disseminations of the Strengthening Families Program for Parents and Youth 10–14, a family-based substance use prevention program. Our second aim was to explore intersections between various dimensions of facilitator-reported adaptations from these two coding systems. Our results indicate that only a few types of adaptations and a few reasons accounted for a majority (over 70 %) of all reported adaptations. We also found that most adaptations were logistical, reactive, and not aligned with program’s goals. In many ways, our findings replicate those of the original studies, suggesting the two coding systems are robust even when applied to self-reported data collected from community-based implementations. Our findings on the associations between adaptation dimensions can inform future studies assessing the relationship between adaptations and program outcomes. Studies of local adaptations, like the present one, should help researchers, program developers, and policymakers better understand the issues faced by implementers and guide efforts related to program development, transferability, and sustainability.
Similar content being viewed by others
Notes
The Extension system, a part of the land-grant university present in each of the United States, is a disseminated network of state university personnel. The mission of Extension is to identify community needs and to support the development of community practices, informed by university research, to meet those needs. County-based personnel serve as the link between campus-based researchers and community agencies, translating research to practice on the one hand and informing the research agenda of the university on the other.
References
August, G. J., Gewirtz, A., & Realmuto, G. M. (2010). Moving the field of prevention from science to service: Integrating evidence-based preventive interventions into community practice through adapted and adaptive models. Applied and Preventive Psychology, 14(1–4), 72–85. doi:10.1016/j.appsy.2008.11.001.
Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12(1), 23–33. doi:10.1007/s11121-010-0186-1.
Berkel, C., Murry, V. M., Roulston, K. J., & Brody, G. H. (2013). Understanding the art and science of implementation in the SAAF efficacy trial. Health Education, 113(4), 297–323. doi:10.1108/09654281311329240.
Blakely, C. H., Mayer, J. P., Gottschalk, R. G., Schmitt, N., Davidson, W. S., Roitman, D. B., & Emshoff, J. G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15(3), 253–268. doi:10.1007/BF00922697.
Bookstein, A. (1990). Informetric distributions, part 1: Unified overview. Journal of the American Society for Information Science, 41(5), 368–375. doi:10.1002/(SICI)1097-4571(199007)41:5<368:AID-ASI8>3.0.CO;2-C.
Bopp, M., Saunders, R. P., & Lattimore, D. (2013). The tug-of-war: Fidelity versus adaptation throughout the health promotion program life cycle. The Journal of Primary Prevention, 34(3), 193–207. doi:10.1007/s10935-013-0299-y.
Botvin, G. J., & Griffin, K. W. (2004). Life skills training: Empirical findings and future directions. Journal of Primary Prevention, 25(2), 211–232. doi:10.1023/B:JOPP.0000042391.58573.5b.
Breitenstein, S. M., Fogg, L., Garvey, C., Hill, C., Resnick, B., & Gross, D. (2010a). Measuring implementation fidelity in a community-based parenting intervention. Nursing Research, 59(3), 158–165. doi:10.1097/NNR.0b013e3181dbb2e2.
Breitenstein, S. M., Gross, D., Garvey, C. A., Hill, C., Fogg, L., & Resnick, B. (2010b). Implementation fidelity in community-based interventions. Research in Nursing & Health, 33(2), 164–173. doi:10.1002/nur.20373.
Byrnes, H. F., Miller, B. A., Aalborg, A. E., Plasencia, A. V., & Keagy, C. D. (2010). Implementation fidelity in adolescent family-based prevention programs: Relationship to family engagement. Health Education Research, 25(4), 531–541. doi:10.1093/her/cyq006.
Card, J. J., Solomon, J., & Cunningham, S. D. (2011). How to adapt effective programs for use in new contexts. Health Promotion Practice, 12(1), 25–35. doi:10.1177/1524839909348592.
Castro, F. G., Barrera, M., & Martinez, C. R. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5(1), 41–45. doi:10.1023/B:PREV.0000013980.12412.cd.
Catalano, R. F., Fagan, A. A., Gavin, L. E., Greenberg, M. T., Irwin, C. E, Jr, Ross, D. A., & Shek, D. T. (2012). Worldwide application of prevention science in adolescent health. The Lancet, 379(9826), 1653–1664. doi:10.1016/S0140-6736(12)60238-4.
Cohen, D. J., Crabtree, B. F., Etz, R. S., Balasubramanian, B. A., Donahue, K. E., Leviton, L. C., et al. (2008). Fidelity versus flexibility: Translating evidence-based research into practice. American Journal of Preventive Medicine, 35(5, Supplement ), S381–S389. doi:10.1016/j.amepre.2008.08.005.
Cooper, B. R., Bumbarger, B. K., & Moore, J. E. (2015). Sustaining evidence-based prevention programs: Correlates in a large-scale dissemination initiative. Prevention Science, 16, 145–157. doi:10.1007/s11121-013-0427-1.
Daele, T. V., Audenhove, C. V., Hermans, D., Bergh, O. V. D., & Broucke, S. V. D. (2014). Empowerment implementation: Enhancing fidelity and adaptation in a psycho-educational intervention. Health Promotion International, 29(2), 212–222. doi:10.1093/heapro/das070.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. doi:10.1007/s10464-008-9165-0.
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432. doi:10.1111/j.1467-8624.2010.01564.x.
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20(3), 308–313. doi:10.1093/her/cyg134.
Foxcroft, D. R., Ireland, D., Lister-Sharp, D. J., Lowe, G., & Breen, R. (2003). Longer-term primary prevention for alcohol misuse in young people: A systematic review. Addiction, 98(4), 397–411. doi:10.1046/j.1360-0443.2003.00355.x.
Glasgow, R. E., Lichtenstein, E., & Marcus, A. C. (2003). Why don’t we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health, 93(8), 1261–1267. Retrieved from http://ajph.aphapublications.org/doi/pdfplus/10.2105/AJPH.93.8.1261.
Hamre, B. K., Justice, L. M., Pianta, R. C., Kilday, C., Sweeney, B., Downer, J. T., & Leach, A. (2010). Implementation fidelity of MyTeachingPartner literacy and language activities: Association with preschoolers’ language and literacy growth. Early Childhood Research Quarterly, 25(3), 329–347. doi:10.1016/j.ecresq.2009.07.002.
Hansen, W. B. (2013). Introduction to the special issue on adaptation and fidelity. Health Education, 113(4), 260–263. doi:10.1108/09654281311329213.
Hansen, W. B., & McNeal, R. B. (1999). Drug education practice: Results of an observational study. Health Education Research, 14(1), 85–97. doi:10.1093/her/14.1.85.
Hansen, W. B., Pankratz, M. M., Dusenbury, L., Giles, S. M., Bishop, D. C., Albritton, J., et al. (2013). Styles of adaptation: The impact of frequency and valence of adaptation on preventing substance use. Health Education, 113(4), 345–363. doi:10.1108/09654281311329268.
Hardeman, W., Michie, S., Fanshawe, T., Prevost, A. T., Mcloughlin, K., & Kinmonth, A. L. (2008). Fidelity of delivery of a physical activity intervention: Predictors and consequences. Psychology & Health, 23(1), 11–24. doi:10.1080/08870440701615948.
Harn, B., Parisi, D., & Stoolmiller, M. (2013). Balancing fidelity with flexibility and fit: What do we really know about fidelity of implementation in schools? Exceptional Children, 79(2), 181–193. doi:10.1177/001440291307900204.
Hill, L. G., Maucione, K., & Hood, B. K. (2007). A focused approach to assessing program fidelity. Prevention Science, 8(1), 25–34. doi:10.1007/s11121-006-0051-4.
Hill, L. G., & Owens, R. W. (2013). Component analysis of adherence in a family intervention. Health Education, 113(4), 264–280. doi:10.1108/09654281311329222.
Lara, M., Bryant-Stephens, T., Damitz, M., Findley, S., Gavillán, J. G., Mitchell, H., et al. (2011). Balancing “fidelity” and community context in the adaptation of asthma evidence-based interventions in the “real world”. Health Promotion Practice, 12(6 suppl 1), 63S–72S. doi:10.1177/1524839911414888.
Lillehoj, C. J., Griffin, K. W., & Spoth, R. (2004). Program provider and observer ratings of school-based preventive intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31(2), 242–257. doi:10.1177/1090198103260514.
Miller-Day, M., Pettigrew, J., Hecht, M. L., Shin, Y., Graham, J., & Krieger, J. (2013). How prevention curricula are taught under real-world conditions: Types of and reasons for teacher curriculum adaptations. Health Education, 113(4), 324–344. doi:10.1108/09654281311329259.
Moore, J. E., Bumbarger, B. K., & Cooper, B. R. (2013). Examining adaptations of evidence-based programs in natural contexts. The Journal of Primary Prevention, 34(3), 147–161. doi:10.1007/s10935-013-0303-6.
Ozer, E. J., Wanis, M. G., & Bazell, N. (2010). Diffusion of school-based prevention programs in two urban districts: Adaptations, rationales, and suggestions for change. Prevention Science, 11(1), 42–55. doi:10.1007/s11121-009-0148-7.
Pankratz, M., Jackson-Newsom, J., Giles, S., Ringwalt, C., Bliss, K., & Bell, M. (2006). Implementation fidelity in a teacher-led alcohol use prevention curriculum. Journal of Drug Education, 36(4), 317–333. doi:10.2190/H210-2N47-5X5T-21U4.
Pettigrew, J., Graham, J. W., Miller-Day, M., Hecht, M. L., Krieger, J. L., & Shin, Y. J. (2015). Adherence and delivery: Implementation quality and program outcomes for the seventh-grade keepin’it REAL program. Prevention Science, 16(1), 90–99. doi:10.1007/s11121-014-0459-1.
Pettigrew, J., Miller-Day, M., Shin, Y., Hecht, M. L., Krieger, J. L., & Graham, J. W. (2013). Describing teacher–student interactions: A qualitative assessment of teacher implementation of the 7th grade keepin’it REAL substance use intervention. American Journal of Community Psychology, 51(1–2), 43–56. doi:10.1007/s10464-012-9539-1.
Rohrbach, L. A., Grana, R., Sussman, S., & Valente, T. W. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation and the Health Professions, 29(3), 302–333. doi:10.1007/s11121-014-0459-1.
Segrott, J., Murphy, S., Morgan-Trimmer, S., Scourfield, J., Holliday, J., Thomas, C., et al. (2014). Programme fidelity in a large pragmatic trial: Findings from a process evaluation of the Strengthening Families 10–14 UK Programme (SFP 10–14 UK). Presented at the Society for Prevention Research.
Spoth, R. L., Randall, G. K., Trudeau, L., Shin, C., & Redmond, C. (2008). Substance use outcomes 5 1/2 years past baseline for partnership-based, family-school preventive interventions. Drug and Alcohol Dependence, 96(1–2), 57–68. doi:10.1016/j.drugalcdep.2008.01.023.
Spoth, R., Redmond, C., & Lepper, H. (1999a). Alcohol initiation outcomes of universal family-focused preventive interventions: One- and two-year follow-ups of a controlled study. Journal of Studies on Alcohol and Drugs, Supplement, 13, 103–111. doi:10.15288/jsas.1999.s13.103.
Spoth, R., Reyes, M. L., Redmond, C., & Shin, C. (1999b). Assessing a public health approach to delay onset and progression of adolescent substance use: Latent transition and log-linear analyses of longitudinal family preventive intervention outcomes. Journal of Consulting and Clinical Psychology, 67(5), 619–630. doi:10.1037/0022-006X.67.5.619.
Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., et al. (2013). Addressing core challenges for the next generation of Type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prevention Science, 14(4), 319–351. doi:10.1007/s11121-012-0362-6.
Stirman, S. W., Miller, C. J., Toder, K., & Calloway, A. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8(1), 65. doi:10.1186/1748-5908-8-65.
Veniegas, R. C., Kao, U. H., & Rosales, R. (2009). Adapting HIV prevention evidence-based interventions in practice settings: An interview study. Implementation Science: IS, 4(1), 76. doi:10.1186/1748-5908-4-76.
Wandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., et al. (2008). Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology, 41(3–4), 171–181.
Acknowledgments
Portions of this research were supported by two grants from the National Institute of Drug Abuse of the U.S. National Institutes of Health (R21 DA025139-01Al, R21 DA19758-01). Our thanks to the program providers and families who participated in this research and to our undergraduate and graduate research assistants.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Cooper, B.R., Shrestha, G., Hyman, L. et al. Adaptations in a Community-Based Family Intervention: Replication of Two Coding Schemes. J Primary Prevent 37, 33–52 (2016). https://doi.org/10.1007/s10935-015-0413-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10935-015-0413-4