Introduction
The prevalence of substance use among mothers who are involved in childcare proceedings is high and is related to negative child placement outcomes, such as lower rates of reunification, higher rates of out-of-home placement, greater risk of re-entry into the child welfare system and permanent loss of parental rights (Green et al.,
2007; Taplin & Mattick,
2015; Tracy,
1994; Tsantefski et al.,
2014). An estimated 50% to 80% of childcare proceeding cases across the world involved mothers with substance use problems (Harp & Oser,
2016; Public Health England,
2018; Taplin & Mattick,
2013) and approximately 50% of mothers in substance use treatment services have experienced the loss of the care of at least one of their children (Porowski et al.,
2004; Tsantefski et al.,
2014). However, the relationship between maternal substance use and child removal is not straightforward, with substance use rarely being the only contributor to the relationship (Wall-Wieler et al.,
2018).
Mothers who use substances and are involved in the child welfare system tend to have multiple and complex needs, which include mental health comorbidities (Williams et al.,
2011), trauma histories (Gilchrist & Taylor,
2009), poor parenting skills (Canfield et al.,
2017; Forrester & Harwin,
2007), intimate partner violence victimisation (Canfield et al.,
2021; Chowdry,
2018; Tsantefski et al.,
2014), low social support (Sarkola et al.,
2007), and deprived socioeconomic status (Basnet et al.,
2015; Doab et al.,
2015). There is also extensive evidence suggesting that the mothers’ ability to care for their children tends to deteriorate in the context of these multiple needs (Canfield et al.,
2017). This in turn has been associated with an increased risk of child abuse and/or neglect of their children (Nair et al.,
2003).
In recent years, there has being a growing emphasis towards understanding how social and psychological characteristics of the mothers can interact with substance use to influence child abuse (Berger,
2005; Grella et al.,
2006; Magura & Laudet,
1996). Within this, research has found that well-integrated treatment approaches, which comprehensively address the individualised factors that lead to substance use and child abuse, were key in improving maternal and child outcomes (Marsh & Cao,
2005). For instance, the use of multidisciplinary integrated treatment programmes, which include substance use treatment with interventions for maternal well-being (e.g., medical and nutrition-, mental health-, psychological-, parenting services; education and employment assistance), as well as other services (e.g., case management-, child-related services) (Marsh et al.,
2011), revealed better parenting behaviours, such as improved parent–child interaction and lower child abuse risk, higher substance use treatment retention and reduction of maternal substance use, when compared with those who attended non-integrated treatment programmes or substance use treatment-as-usual (Milligan et al.,
2010,
2011; Moreland & McRae-Clark,
2018; Niccols et al.,
2012a). A systematic review by Niccols et al.
(2012b) also showed positive association between integrated treatment programmes for mothers with substance use problems and the improvements in their child development, physical growth (e.g., length, weight, and head circumference), emotional and behavioural functioning. The provision of comprehensive interventions or targeted services within an integrated treatment programme appears to fulfil the dynamic needs of the mothers (Sword et al.,
2009), therefore suggesting that integrated treatment programmes may be more effective for mothers with substance use problems and their children, as compared to single-focus interventions (Lieberman,
1998; McHugh et al.,
2010).
Even though research on integrated treatment programmes has shown promising findings, a majority of the studies focused on clinical outcomes, such as patterns of substance use, parenting behaviours or child behaviours (Dutra et al.,
2008; Messina et al.,
2015; Niccols et al.,
2012a,
2012b). There appears to be a lack of emphasis on the practical outcomes of such interventions, for instance, the mitigation of the mothers’ involvement in childcare proceedings (Canfield et al.,
2017). Important work has been carried out to evaluate the effectiveness of integrated family dependency treatment courts (Harwin et al.,
2018; Zhang et al.,
2019). However, they focused on parents rather than mothers specifically. While both maternal and paternal substance use are considered significant risks for child maltreatment and neglect, mothers are usually the primary caregivers. As a result, they are more likely to be involved with child protection services and to manage the negative effects of their substance use from their children (Douglas & Walsh,
2009). To date, only two reviews were conducted looking into the interventions that were designed to address the needs of mothers with substance use problems and how they could support family reunification outcomes (Doab et al.,
2015; Murphy et al.,
2017). While both reviews concluded that participation in integrated treatment programmes might increase the likelihood of reunification between mothers and their children, it is unclear if the integrated treatment programmes could reduce the risks of removal from mothers who were caring for dependent children. Furthermore, the findings from the two reviews were synthesised narratively. An objective estimate of the effectiveness of these programmes is needed to develop a comprehensive understanding on how they can better support mothers in retaining their rights to care for their children.
The primary objective of this review was to determine whether integrated treatment programmes for mothers with substance use problems were effective in reducing out-of-home child placement (temporally/permanent), when compared with control groups. The secondary objective was to explore the effectiveness of these programmes on other maternal factors that could influence the outcomes of the childcare proceedings, including patterns of substance use, treatment completion and parenting behaviours, such as managing parent–child conflict and child abuse risk.
Methods
A systematic review with meta-analysis was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analyses Protocols (Moher et al.,
2009). This protocol was registered with the International Prospective Register of Systematic Reviews (Neo et al.,
2020; PROSPERO
2020, CRD42020184863)
Eligibility
The PICOS (Population, Interventions, Comparators, Outcomes, Study designs) was used to format the inclusion criteria (see Supplementary Materials Table S1 for detailed eligibility criteria). Citations were included if the full text articles were published in English. Studies were eligible if: (1) they included mothers with substance use problems of one or more children younger than 18 years old; (2) they used a controlled design involving either randomisation (i.e. randomised controlled trials (RCTs)) or non-randomised controlled studies with an appropriate comparator group, such as those not receiving any intervention or who took part in treatment-as-usual; (3) they used integrated treatment programmes broadly defined as comprehensive services that concurrently address substance use and other maternal needs through prenatal services, mental health services, parenting programmes, childcare, or other child-centred services; and (4) they included quantitative measures of the outcomes of childcare proceedings, including the loss or retention of care of the child, foster care, kinship care, residential care, and family reunification.
The review also considered secondary outcomes, including: (1) treatment completion as defined by the rate of participants’ adherence or retention to the treatment programme, (2) maternal substance use as defined by the intake of illicit drugs or alcohol by the mothers measured after treatment, and (3) parenting behaviours, such as the mother’s ability to manage conflicts with child or her attitudes and risk towards child abuse.
Search Strategy
The following databases were searched from inception to 1 March 2021: Cochrane Drugs and Alcohol Group Specialized Register, Cochrane Central Register of Controlled Trials (CENTRAL), CINHAL via Ecohost platform, EMBASE, MEDLINE and PsycINFO via OVID interface (see Supplementary Materials S2 for search terms). Relevant citations were also sourced from the reference list of key papers and the ‘grey’ literature, including WorldCat and OpenGrey.
Identified citations from the search strategy were uploaded to Zotero 5.0.89 and the duplicates were removed manually. In cases where findings from technical reports (grey literature) were also published in peer-reviewed journal, only the peer-reviewed article was included. The full text of the remaining citations was retrieved and assessed according to the inclusion/exclusion criteria by two independent reviewers (SNe and DK). Discrepancies were resolved by discussion and consensus. In the event that disagreements occurred regarding the inclusion of the studies, the final decisions were reached through referral to a third author.
Using a standardised form, SNe extracted the relevant data and results of each study from the following areas: authors, publication year, country where the research was conducted, participants’ characteristics, study design, interventions, and primary and secondary outcomes (Table
1).
Table 1
Characteristics of the study, interventions, and outcome measures
| Non-randomised controlled study | EMP | ICMS | 15 months | Reunification (n, %) | 15 months | Graduation from FTDC (n, %) | - | - | - | - |
| RCT | EMP | ICMS | 18 months | Reunification (n, %) | 18 months | Graduation from FTDC (n, %) | ASI Drug (Mean, SD) | ASI Alcohol (Mean, SD) | Brief-CAP (M, SD) | CTSPC Minor Physical Assault subscale (M, SD) |
| RCT | FBT | TAU | 10 months | Out-of-home placement (Mean, SD) | 10 months | Treatment retention (n, %) | TLFB Hard Drug and Marijuana (M, SD) | TLFB Alcohol Intoxication (M, SD) | - | CAPI (M, SD) |
| Non-randomised controlled study | FDAC | NIL | 6.5 months | Reunification (n, %) | 6.5 months | - | Drug cessation rate (n, %) | - | - | - |
| Non-randomised controlled study | MST-BSF | CCT | 24 months | Out-of-home placement (n, %) | Pre-post treatment (M = 9.5 months) | - | ASI Drug (M, SD) | ASI Alcohol (M, SD) | | CTSPC Physical Assault subscale (M, SD) |
| Non-randomised controlled study | FTDC | NIL | 24 months | Reunification (n, propensity scores) | 24 months | At least one completed alcohol and drug treatment (n, propensity scores) | - | - | - | - |
Quality Assessment
Study quality was rated by two authors independently using the Cochrane Risk of Bias tool version 2 (RoB2, Sterne et al.,
2019). The tool assesses five domains of study quality: randomisation; allocation concealment; blinding of participants, therapists, and outcome assessors; incomplete outcome data; and selective outcome reporting (Fig.
2). Each domain was scored according to whether there was high, moderate, or low risk of bias. Conflicting assessments were resolved through discussion. In addition to the RoB2, the Risk Of Bias in Non-randomised Studies - of Intervention (ROBINS-I) was used to evaluate the risk of bias for non-randomised studies (Sterne et al.,
2016) from pre, during and post intervention (see Supplementary Materials Figure and Table S3 for ROBINS-I risk assessment).
Statistical Analysis
Effect sizes were calculated in terms of odds ratios (
OR) for dichotomous outcomes and standardised mean differences (
SMD) for continuous outcomes, with 95% confidence interval (CI). The software program RevMan 5.4.1 (
Review Manager (RevMan), n.d.) and an online calculator (Wilson, n.d.) were used to calculate the effect sizes. Where available, the effect sizes were calculated based on quantitative data analyses performed on an intent-to-treat basis for RCTs (Higgins, Li, et al.,
2019) and on adjusted scores for non-randomised controlled studies (Reeves et al.,
2019). For studies that have multiple effect estimates of an outcome domain, a decision was made to either calculate an average of the effect estimates if the measures were assessed to be interchangeable, or to select the most relevant data from the most comparable time period of measurement and outcome measure (Higgins, Li, et al.,
2019; McKenzie et al.,
2019).
Heterogeneity was assessed by examining the clinical variability within the study and by calculating the statistical heterogeneity through the use of the chi-squared test and
I2 statistic (Brown & Richardson,
2017). The chi-squared test was used to examine if the observed differences in the results were due to chance alone. The
I2 statistic was used to assess the impact of heterogeneity on the variability of effect estimates, where
I2 > 30% may be indicative of moderate to substantial heterogeneity (Deeks & Higgins,
2019).
A meta-analysis using the random-effects method was conducted on the outcomes. Generic inverse variance method was used to calculate the weighted average of the effect sizes in either
OR or
SMD (Deeks et al.,
2001). Forest plots with the pooled effect size were generated for each outcome using RevMan 5.4.1. When possible, exploratory subgroup analysis was conducted to identify the source of heterogeneity (Deeks & Higgins,
2019).
Discussion
This systematic review and meta-analysis evaluated whether integrated treatment programmes for mothers with substance use problems reduced the likelihood of out-of-home child placements and improved maternal factors that could influence the outcomes of childcare proceedings. Despite our broad inclusion criteria, only six studies were identified, of which five were conducted in the USA. Overall, the evidence from these studies is in favour of integrated treatment programmes. However, the small number and overall low methodological quality of the included studies limits the confidence with which firm conclusions can be drawn about the effectiveness of the programmes. Only two studies assessed the effects of the interventions on child placement outcomes using a randomised controlled trial design. Thus, the lack of rigorous scientific examination of the integrated treatment programmes hampers the effort of addressing the objectives of this review and suggests that presently these programmes are being utilised with unclear or unsupported benefit from a scientific standpoint. There is a clear and urgent need for adequately powered randomised controlled trials. Without further robust evaluative evidence, challenges will remain to demonstrate and persuade health and public policy on the far-reaching value of the integrated approaches.
In line with other reviews in the context of parental substance use and child welfare intervention research (Harwin et al.,
2018; Zhang et al.,
2019), our review demonstrates that the methodological quality of the studies has not improved over the years. The underpowered single centre trials impose important methodological limitations in this field as it is the reliance on retrospective administrative data for follow-up studies. One reason for the lack of robustly designed studies may be due to the difficulty and cost of randomised controlled trials. It is clear that greater investment is needed to overcome the methodological challenges of undertaking trials in this field. Researchers, social and health services, and commissioners must engage and develop collaborative strategies that could potentially increase research delivery capacity.
Out of the six studies included in this review, only two studies measured the effects of the interventions on child placement outcomes using a randomised controlled trial design. A wide difference in the treatment effects was also observed for randomised versus non-randomised controlled studies, for example, the odds ratio of out-of-home child placement post-treatment for studies using a randomised design was lower than what was observed from the odds ratio from non-randomised controlled studies. This suggests that the true estimate of the treatment effect may be closer to the lower value if more high quality randomised controlled studies were included in the review. Relatedly, the nature of the sample, which focused exclusively on mothers with a history of substance use problems who were involved in the child welfare system, may have influenced the magnitude of some of the significant effect sizes in this review. For instance, the effect size for treatment completion in this review is nearly to two times larger than the effect size observed in a review by Milligan et al. (
2011), who examined the impact of integrated treatment programmes on treatment completion among mothers with substance use problems. The desire to attain the care of their child could have motivated the mothers to attend and complete treatment for their substance use (Jessup et al.,
2003; Neger & Prinz,
2015; Taplin & Mattick,
2015), which may potentially inflate the effect size for treatment completion. Moreover, this review did not explore the possible impact of mothers’ patterns of substance use (e.g., use of alcohol with/without other types of illicit drugs) on child placement outcomes, despite the association between these two factors (Canfield et al.,
2017). Further re-evaluation of the treatment effects is required by comparing the differences in treatment effects between mothers who were referred or not referred to the welfare system (Grella et al.,
2009) and also between mothers who use alcohol in or not in combination with other types of drug use (Canfield et al.,
2017). Such information is warranted to be able to inform who benefits from the integrated treatment programmes and under what type of circumstances.
Nevertheless, this review does provide an indication that mothers who participated in integrated treatment programmes were significantly less likely to have their children placed in out-of-home care (temporally/permanently) post-treatment, when compared with matched control groups who took part in treatment-as-usual or no intervention. In addition, integrated treatment programmes showed some potential in supporting mothers to complete treatment and in reducing their maternal substance use. These findings are in line with past reviews conducted on integrated treatment programmes in the context of parental substance use (Milligan et al.,
2010,
2011; Moreland & McRae-Clark,
2018; Niccols, Milligan, Sword, et al.,
2012). Specifically, the FTDC/ FDAC model appears to be a useful paradigm in achieving family reunification and improving maternal outcomes for mothers with substance use problems in the USA and UK (Family Drug and Alcohol Court, n.d.; Harwin et al.,
2014,
2016; Oliveros & Kaufman,
2011; Zhang et al.,
2019; Australia and Northern Ireland (Review Group,
2016)). Since FTDC integrates the criminal justice system with substance use treatment and relevant social services (e.g., employment, domestic violence intervention, and housing), the model is able to comprehensively address the multiple needs of the mothers, thereby supporting them in their recovery against substance use, child abuse and re-entry to the welfare system (Doab et al.,
2015; Murphy et al.,
2017; Zhang et al.,
2019). Relatedly, such collaboration between the services could allow quicker identification of mothers with early substance use problems, thereby providing them and their families with the relevant social services and potentially reducing their involvement in the childcare proceedings (Canfield et al.,
2017). Having such specialised family courts that incorporate comprehensive health and social services may be the way forward in helping mothers with substance use problems during their childcare proceedings (Kerwin,
2005; Osterling & Austin,
2008).
Strengths and Limitations
This systematic review and meta-analysis is the first review to consider the effectiveness of integrated treatment programmes on child placement outcomes for mothers with substance use problems. A high-quality methodology was used in this review and the findings could support further developments in the field of maternal substance use and child welfare.
The main limitation of this review is the low number of studies identified. The small sample of studies, coupled with the presence of non-randomised study designs, could only generate preliminary evidence on the effectiveness of the integrated treatment programmes. Additional subgroup analyses to compare the treatment effects across the studies and programme characteristics could not be performed. Relatedly, four of the six included studies used samples from the FTDC or FDAC model in the USA and UK respectively, and they explored only family reunification outcomes. It remains unclear if the impact of integrated treatment programmes could be generalised to other types of child placement outcomes (e.g., having their children in foster care), or to countries that do not adopt a FTDC/ FDAC model in supporting mothers with substance use problems.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.