Swipe om te navigeren naar een ander artikel
The online version of this article (https://doi.org/10.1007/s10826-018-01319-y) contains supplementary material, which is available to authorized users.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Previous studies of parenting programs suggest that facilitator fidelity, participant attendance and engagement often influence treatment outcomes. While the number of parenting program evaluations has been growing in low- and middle-income countries, little is known about the implementation processes and their impact on participant outcomes in these settings.
This study was nested within a cluster-randomised trial of a parenting program in South Africa. The paper aims to, first, describe the implementation of the intervention over 14 weeks. Second, using longitudinal multilevel analyses, the paper examines the impact of variation in observer-rated fidelity, attendance, and engagement on participant outcomes – parenting and maltreatment reported by caregivers and adolescents aged 10–18 (N = 270 pairs), 14 outcome constructs.
Fidelity, attendance and participant engagement rates were similar to those reported in high-income country studies. However, the participation and implementation characteristics did not predict participant outcomes. This may be due to limited variation in dosage as home visits were comprehensively provided when participants could not attend group sessions, and fidelity was monitored by the implementers and researchers. One statistically significant predictor after the multiple testing correction was higher fidelity predicting an increase in adolescent-reported maltreatment at follow-up, possibly due to an increase in reporting (incidence rate ratio 1.33, 95% CI [1.19, 1.49], p < 0.01).
Our study confirms that a high quality of implementation can be achieved in a low-resource context. Suggestions for future research on parenting programs include examining therapeutic alliance alongside program fidelity and facilitator skill as well as systematically recording program adaptations.
Alvarez, M., Rodrigo, M. J., & Byrne, S. (2016). What implementation components predict positive outcomes in a parenting program? Research on Social Work Practice, 28(2), 1–15. https://doi.org/10.1177/1049731516640903.
Annan, J., Sim, A., Puffer, E. S., Salhi, C., & Betancourt, T. S. (2017). Improving mental health outcomes of Burmese migrant and displaced children in Thailand: a community-based randomized controlled trial of a parenting and family skills intervention. Prevention Science, 18(7), 793–803. https://doi.org/10.1007/s11121-016-0728-2.
Ashraf, N., Bandiera, O., & Lee, S. S.-H. (2014). Awards unbundled: evidence from a natural field experiment. Journal of Economic Behavior and Organization, 100, 44–63. https://doi.org/10.1016/j.jebo.2014.01.001.
Barlow, J., & Coren, E. (2018). The effectiveness of parenting programs. Research on Social Work Practice, 28(1), 99–102. https://doi.org/10.1177/1049731517725184.
Barr, D. J. (2013). Random effects structure for testing interactions in linear mixed-effects models. Frontiers in Psychology, 4, 328 https://doi.org/10.3389/fpsyg.2013.00328.
Baydar, N., Reid, M. J., & Webster-Stratton, C. (2003). The role of mental health factors and program engagement in the effectiveness of a preventive parenting program for head start mothers. Child Development, 74(5), 1433–1453. https://doi.org/10.1111/1467-8624.00616.
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, 57, 289–300. https://doi.org/10.2307/2346101.
Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12(1), 23–33. https://doi.org/10.1007/s11121-010-0186-1.
Berkel, C., Sandler, I. N., Wolchik, S. A., Brown, C. H., Gallo, C. G., Chiapa, A., & Jones, S. (2018). “Home Practice Is the Program”: Parents’ practice of program skills as predictors of outcomes in the new beginnings program effectiveness trial. Prevention Science, 19(5), 663–673. https://doi.org/10.1007/s11121-016-0738-0.
Breitenstein, S. M., Fogg, L., Garvey, C., Hill, C., Resnick, B., & Gross, D. (2010). Measuring implementation fidelity in a community-based parenting intervention. Nursing Research, 59, 158–165. https://doi.org/10.1097/NNR.0b013e3181dbb2e2.
Cantu, A., Hill, L., & Becker, L. (2010). Implementation quality of a family-focused preventive intervention in a community-based dissemination. Journal of Children’s Services, 5(4), 18–30. https://doi.org/10.5042/jcs.2010.0692.
Cluver, L. D., Lachman, J. M., Ward, C. L., Gardner, F., Peterson, T., Hutchings, J. M., & Redfern, A. A. (2016a). Development of a parenting support program to prevent abuse of adolescents in South Africa: findings from a pilot pre-post study. Research on Social Work Practice, 27(7), 758–766. https://doi.org/10.1177/1049731516628647.
Cluver, L. D., Meinck, F., Shenderovich, Y., Ward, C. L., Romero, R. H., Redfern, A., & Lechowicz, M. (2016b). A parenting programme to prevent abuse of adolescents in South Africa: Study protocol for a randomised controlled trial. Trials, 17(328), 1–10. https://doi.org/10.1186/s13063-016-1452-8.
Cluver, L. D., Meinck, F., Steinert, J., Shenderovich, Y., Doubt, J., Herrero-Romero, R., & Gardner, F. (2018). Parenting for lifelong health: a pragmatic cluster randomised controlled trial of a non-commcialised parenting programme for adolescents and their families in South Africa. BMJ Global Health, 3(1), 1–16. https://doi.org/10.1136/bmjgh-2017-000539.
Cluver, L. D., Meinck, F., Yakubovich, A., Doubt, J., Redfern, A., Ward, C., & Gardner, F. (2016c). Reducing child abuse amongst adolescents in low- and middle-income countries: a pre-post trial in South Africa. BMC Public Health, 16(567), 1–11. https://doi.org/10.1186/s12889-016-3262-z.
Devries, K. M., Knight, L., Allen, E., Parkes, J., Kyegombe, N., & Naker, D. (2017). Does the good schools toolkit reduce physical, sexual and emotional violence, and injuries, in girls and boys equally? A cluster-randomised controlled trial. Prevention Science, 18, 839–853. https://doi.org/10.1007/s11121-017-0775-3.
Doubt, J., Bray, R., Loening-Voysey, H., Cluver, L. D., Byrne, J., Nzima, D., & Medley, S. (2017). ‘It has changed’: understanding change in a parenting programme in South Africa. Annals of Global Health. https://doi.org/10.1016/j.aogh.2017.10.021.
DuBois, D. L., Holloway, B. E., Valentine, J. C., & Cooper, H. (2002). Effectiveness of mentoring programs for youth: a meta-analytic review. American Journal of Community Psychology, 30, 157–97. http://www.ncbi.nlm.nih.gov/pubmed/12002242
Durlak, J. A. (2015). Studying program implementation is not easy but it is essential. Prevention Science, 16, 1123–1127. https://doi.org/10.1007/s11121-015-0606-3.
Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. https://doi.org/10.1007/s10464-008-9165-0.
Dusenbury, L., Brannigan, R., Hansen, W. B., Walsh, J., & Falco, M. (2005). Quality of implementation: Developing measures crucial to understanding the diffusion of preventive interventions. Health Education Research, 20, 308–313. https://doi.org/10.1093/her/cyg134.
Eames, C., Daley, D., Hutchings, J., Whitaker, C. J., Jones, K., Hughes, J. C., & Bywater, T. (2009). Treatment fidelity as a predictor of behaviour change in parents attending group-based parent training. Child: Care, Health and Development, 35, 603–612. https://doi.org/10.1111/j.1365-2214.2009.00975.x.
Elvins, R., & Green, J. (2008). The conceptualization and measurement of therapeutic alliance: an empirical review. Clinical Psychology Review, 28, 1167–1187. https://doi.org/10.1016/j.cpr.2008.04.002.
Fixsen, D. L., Blase, K. A., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79, 213–230.
Forgatch, M. S., & DeGarmo, D. S. (2011). Sustaining fidelity following the nationwide PMTO implementation in Norway. Prevention Science, 12, 235–246. https://doi.org/10.1007/s11121-011-0225-6.
Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005). Evaluating fidelity: predictive validity for a measure of competent adherence to the Oregon model of parent management training. Behavior Therapy, 36(1), 3–13. https://doi.org/10.1016/S0005-7894(05)80049-8.
Essau, C. A., Sasagawa, S., & Frick, P. J. (2006). Psychometric properties of the Alabama parenting questionnaire. Journal of Child and Family Studies, 15(5), 595–614.
Furlong, M., McGilloway, S., Bywater, T., Hutchings, J., Smith, S. M., & Donnelly, M. (2012). Behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. Cochrane Database of Systematic Reviews, 2. https://doi.org/10.1002/ebch.1905
Gardner, F., Montgomery, P., & Knerr, W. (2015). Transporting evidence-based parenting programs for child problem behavior (age 3–10) between countries: systematic review and meta-analysis. Journal of Clinical Child & Adolescent Psychology, 45, 749–762. https://doi.org/10.1080/15374416.2015.1015134.
Gross, D., Garvey, C., Julion, W., Fogg, L., Tucker, S., & Mokros, H. (2009). Efficacy of the Chicago Parent Program with low-income African American and Latino parents of young children. Prevention Science, 10(1), 54–65. https://doi.org/10.1007/s11121-008-0116-7.
Hawe, P., Shiell, A., & Riley, T. (2004). Complex interventions: how “out of control” can a randomised controlled trial be? British Medical Journal, 328, 1561–1563. https://doi.org/10.1136/bmj.328.7455.1561.
Hickey, G., McGilloway, S., Furlong, M., Leckey, Y., Bywater, T., & Donnelly, M. (2016). Understanding the implementation and effectiveness of a group-based early parenting intervention: a process evaluation protocol. BMC Health Services Research, 16(490), 1–14. https://doi.org/10.1186/s12913-016-1737-3.
Hill, L. G., & Owens, R. W. (2013). Component analysis of adherence in a family intervention. Health Education, 113(4), 264–280. https://doi.org/10.1108/09654281311329222.
Humphrey, N., Barlow, A., & Lendrum, A. (2018). Quality matters: implementation moderates student outcomes in the PATHS curriculum. Prevention Science, 19(2), 197–208. https://doi.org/10.1007/s11121-017-0802-4.
Hurst, A., Price, A., Walesby, R., Doolan, M., Lanham, W., & Ford, T. (2014). Routine outcome monitoring of evidence-based parenting programmes: Indications of effectiveness in a community context. Journal of Children’s Services, 9(1), 58–74. https://doi.org/10.1108/JCS-09-2013-0030.
Kazdin, A. E., & Rabbitt, S. M. (2013). Novel models for delivering mental health services and reducing the burdens of mental illness. Clinical Psychological Science, 1(2), 170–191. https://doi.org/10.1177/2167702612463566.
Kim, J. C., Watts, C. H., Hargreaves, J. R., Ndhlovu, L. X., Phetla, G., Morison, L. A., & Pronyk, P. (2007). Understanding the impact of a microfinance-based intervention on women’s empowerment and the reduction of intimate partner violence in South Africa. American Journal of Public Health, 97(10), 1794–1802. https://doi.org/10.2105/AJPH.2006.095521.
Kjøbli, J., Bjørknes, R., & Askeland, E. (2012). Adherence to brief parent training as a predictor of parent and child outcomes in real-world settings. Journal of Children’s Services, 7(3), 165–177. https://doi.org/10.1108/17466661211261352.
Knerr, W., Gardner, F., & Cluver, L. D. (2013). Improving positive parenting skills and reducing harsh and abusive parenting in low- and middle-income countries: a systematic review. Prevention Science, 14(4), 352–363. https://doi.org/10.1007/s11121-012-0314-1.
Lachman, J. M., Cluver, L. D., Boyes, M. E., Kuo, C., & Casale, M. (2014). Positive parenting for positive parents: HIV/AIDS, poverty, caregiver depression, child behavior, and parenting in South Africa. AIDS Care, 26(3), 304–13. https://doi.org/10.1080/09540121.2013.825368.
Lachman, J. M., Kelly, J., Cluver, L. D., Ward, C. L., Hutchings, J., & Gardner, F. (2016). Process evaluation of a parenting program for low-income families in South Africa. Research on Social Work Practice, 28(2), 188–202.
Meinck, F., Boyes, M., Cluver, L. D., Ward, C., Schmidt, P., DeStone, S., & Dunne, M. (2018). Adaptation and psychometric properties of the ISPCAN Child Abuse Screening Tool for use in trials (ICAST-Trial) among South African adolescents and their primary caregivers. Child Abuse and Neglect, 82, 45–58.
Moerbeek, M., & Teerenstra, S. (2016). Power analysis of trials with multilevel data. Boca Raton, FL: CRC Press.
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., & Baird, J. (2015). Process evaluation of complex interventions: medical research council guidance. British Medical Journal, 350, h1258 https://doi.org/10.1136/bmj.h1258.
Mowbray, C. T., Holter, M. C., Gregory, B., & Bybee, D. (2003). Fidelity criteria: development, measurement, and validation. American Journal of Evaluation, 24(3), 315–340. https://doi.org/10.1177/109821400302400303.
Nix, R. L., Bierman, K. L., & McMahon, R. J. (2009). How attendance and quality of participation affect treatment response to parent management training. Journal of Consulting and Clinical Psychology, 77(3), 429–438. https://doi.org/10.1037/a0015028.
Olofsson, V., Skoog, T., & Tillfors, M. (2016). Implementing group based parenting programs: a narrative review. Children and Youth Services Review, 69, 67–81. https://doi.org/10.1016/j.childyouth.2016.07.004.
Patel, V., Chowdhary, N., Rahman, A., & Verdeli, H. (2011). Improving access to psychological treatments: lessons from developing countries. Behaviour Research and Therapy, 49(9), 523–528. https://doi.org/10.1016/j.brat.2011.06.012.
Peugh, J. L. (2010). A practical guide to multilevel modeling. Journal of School Psychology, 48(1), 85–112. https://doi.org/10.1016/j.jsp.2009.09.002.
Ros, R., Hernandez, J., Graziano, P. A., & Bagner, D. M. (2016). Parent training for children with or at risk for developmental delay: the role of parental homework completion. Behavior Therapy, 47(1), 1–13. https://doi.org/10.1016/j.beth.2015.08.004.
Schmidt, F., Chomycz, S., Houlding, C., Kruse, A., & Franks, J. (2014). The association between therapeutic alliance and treatment outcomes in a group triple P intervention. Journal of Child and Family Studies, 23(8), 1337–1350. https://doi.org/10.1007/s10826-013-9792-4.
Sheidow, A. J., Schoenwald, S. K., Wagner, H. R., Allred, C. A., & Burns, B. J. (2007). Predictors of workforce turnover in a transported treatment program. Administration and Policy in Mental Health and Mental Health Services Research, 34(1), 45–56. https://doi.org/10.1007/s10488-006-0061-3.
Shenderovich, Y., Eisner, M., Cluver, L., Doubt, J., Berezin, M., Majokweni, S., & Murray, A. L. (2018). What affects attendance and engagement in a parenting program in South Africa? Prevention Science, 19(7), 977–986. https://doi.org/10.1007/s11121-018-0941-2.
Steinert, J. I., Cluver, L. D., Meinck, F., Doubt, J., & Vollmer, S. (2018). Household economic strengthening through financial and psychosocial programming: evidence from a field experiment in South Africa. Journal of Development Economics, 134, 443–466. https://doi.org/10.1016/j.jdeveco.2018.06.016.
Viner, R. M., Ozer, E. M., Denny, S., Marmot, M., Resnick, M., Fatusi, A., & Currie, C. (2012). Adolescence and the social determinants of health. The Lancet, 379(9826), 1641–1652. https://doi.org/10.1016/s0140-6736(12)60149-4.
Ward, C., Sanders, M. R., Gardner, F., Mikton, C. R., & Dawes, A. (2016). Preventing child maltreatment in low- and middle-income countries. Parent support programs have the potential to buffer the effects of poverty. Child Abuse and Neglect, 54, 97–107. https://doi.org/10.1016/j.chiabu.2015.11.002.
Webster-Stratton, C., & McCoy, K. P. (2015). Bringing The Incredible Years programs to scale. New Directions for Child and Adolescent Development, 149, 81–95. https://doi.org/10.1002/cad.20115
Weeland, J., Chhangur, R. R., van der Giessen, D., Matthys, W., de Castro, B. O., & Overbeek, G. (2017). Intervention effectiveness of The Incredible Years: New insights into sociodemographic and intervention-based moderators. Behavior Therapy, 48(1), 1–18. https://doi.org/10.1016/j.beth.2016.08.002.
Wessels, I. M. (2017). Parental Engagement in Parent Training Interventions: Findings from the Sinovuyo Caring Families Project. Cape Town, South Africa: University of Cape Town.
World Health Organization. (2016). INSPIRE: seven strategies for ending violence against children. Luxembourg: World Health Organization.
Zolotor, A. J., Runyan, D. K., Dunne, M. P., Jain, D., Péturs, H. R., Ramirez, C., & Isaeva, O. (2009). ISPCAN Child Abuse Acreening Tool Children’s Version (ICAST-C): Instrument development and multi-national pilot testing. Child Abuse and Neglect, 33, 833–841. https://doi.org/10.1016/j.chiabu.2009.09.004.
- Delivering a Parenting Program in South Africa: The Impact of Implementation on Outcomes
Aja Louise Murray
- Springer US
Journal of Child and Family Studies
Print ISSN: 1062-1024
Elektronisch ISSN: 1573-2843