Skip to main content
Download PDF
Download ePub

Cost, cost-consequence and cost-effectiveness evaluation of a practice change intervention to increase routine provision of antenatal care addressing maternal alcohol consumption

Implementation Science volume 17, Article number: 14 (2022) Cite this article

Abstract

Background

Implementation of antenatal clinical guideline recommendations for addressing maternal alcohol consumption is sub-optimal. There is a complete absence of evidence of the cost and cost-effectiveness of delivering practice change interventions addressing maternal alcohol consumption amongst women accessing maternity services. The study sought to determine the cost, cost-consequence and cost-effectiveness of developing and delivering a multi-strategy practice change intervention in three sectors of a health district in New South Wales, Australia.

Methods

The trial-based economic analyses compared the costs and outcomes of the intervention to usual care over the 35-month period of the stepped-wedge trial. A health service provider perspective was selected to focus on the cost of delivering the practice change intervention, rather than the cost of delivering antenatal care itself. All costs are reported in Australian dollars ($AUD, 2019). Univariate and probabilistic sensitivity analyses assessed the effect of variation in intervention effect and costs.

Results

The total cost of delivering the practice change intervention across all three sectors was $367,646, of which $40,871 (11%) were development costs and $326,774 (89%) were delivery costs. Labour costs comprised 70% of the total intervention delivery cost. A single practice change strategy, ‘educational meetings and educational materials’ contributed 65% of the delivery cost. Based on the trial’s primary efficacy outcome, the incremental cost effectiveness ratio was calculated to be $32,570 (95% CI: $32,566–$36,340) per percent increase in receipt of guideline recommended care. Based on the number of women attending the maternity services during the trial period, the average incremental cost per woman who received all guideline elements was $591 (Range: $329 - $940) . The average cost of the intervention per eligible clinician was $993 (Range: $640-$1928).

Conclusion

The intervention was more effective than usual care, at an increased cost. Healthcare funders’ willingness to pay for this incremental effect is unknown. However, the strategic investment in systems change is expected to improve the efficiency of the practice change intervention over time. Given the positive trial findings, further research and monitoring is required to assess the sustainability of intervention effectiveness and whether economies of scale, or reduced costs of intervention delivery can be achieved without impact on outcomes.

Trial registration

The trial was prospectively registered with the Australian and New Zealand Clinical Trials Registry, No. ACTRN12617000882325 (date registered: 16/06/2017).

Peer Review reports

Background

Alcohol consumption during pregnancy is associated with adverse obstetric and infant outcomes that can have lifelong social and economic consequences [1, 2]. Specifically, alcohol consumption during pregnancy increases the risk of miscarriage, still birth and Fetal Alcohol Spectrum Disorder (FASD) which is the most common preventable cause of intellectual impairment in the western world [2]. Despite this, the 2019 Australian National Drug Strategy Household survey reports that 55% of Australian women consumed any alcohol during pregnancy, and 14.5% continued to drink once they knew they were pregnant [3]. No safe level of alcohol exposure has been established and Australian national alcohol guidelines recommend women abstain from drinking alcohol whilst pregnant, trying to become pregnant, or breastfeeding [4].

Public maternity services are important settings for the provision of antenatal care to a large proportion of pregnant women [5, 6]. International [7] and Australian [8, 9] antenatal clinical practice guidelines recommend that during initial and subsequent antenatal appointments all pregnant women: have their alcohol consumption assessed; be advised that it is safest not to consume alcohol during pregnancy and of the potential risks of consumption; and be offered referral for additional alcohol treatment services if required [3]. Despite such guideline recommendations, assessment and care for antenatal alcohol consumption in public maternity services is sub-optimal [10, 11]. For example, in Canada approximately only half of surveyed health professionals reported providing advice to pregnant women regarding the consumption of alcohol [12]. In the United Kingdom two thirds of women reported receiving such advice from a midwife [13]. In a recent Australian survey less than two thirds of pregnant women reported that they received an assessment of their alcohol consumption and just over one third received advice and referral appropriate to their level of alcohol consumption at their initial antenatal visit [11]. Less than 10% of women received recommended care at subsequent antenatal visits [11]. Practice change strategies have been demonstrated to be effective in increasing the provision of evidence-based care in various clinical settings. Such strategies include educational meetings, local opinion leaders providing expert opinion, audit and feedback and electronic prompt and reminder systems [14,15,16,17]. No studies have reported the effectiveness of such strategies in improving the provision of care addressing maternal alcohol consumption by maternity services. Whilst effective, the delivery of these practice change strategies should be considered against their resource requirements [18].

Despite the increasing use of economic evaluation in health services research, its application to the assessment of the cost and cost effectiveness of practice change intervention strategies is limited [18] [19, 20]. A 2019 systematic review by Roberts et al. identified 30 studies that included implementation or improvement as part of an economic evaluation [20]. Of those, 14 were implementation studies and the most common focus was on implementation strategies of new care pathways or novel services [20]. Of these, seven included a cost-effectiveness analysis (CEA), of which two were conducted in the Australian setting, one was a web-based intervention [21] implementation designed to improve the management of minor head injury in emergency departments [22]. Of the 14 implementation studies identified in this review, only six included specific implementation costs, such as those associated with staff training and education, the impacts of new processes on patient and carer costs and the cost of developing new processes [20]. Another recent systematic review of economic evaluations and cost analyses of guideline implementation strategies identified 235 implementation studies, of which only 10% provided information about implementation costs, with none providing detailed cost information [23]. Furthermore, this review identified 63 studies (27%) that reported an economic evaluation, however, overall the methodological quality was poor and very few included conclusions on the effectiveness or efficiency of implementing the guideline into practice [23]. Similarly, a systematic review of economic evaluations of antenatal nutrition and alcohol interventions and their implementation identified 12 studies, ten addressing nutrition intervention effectiveness and two addressing alcohol interventions [24]. The review found that although the alcohol interventions were cost-effective or cost saving, the cost and cost-effectiveness of the intervention and its associated practice change interventions were not reported, and have not been reported previously [24]. Failure to identify, measure and value explicit costs associated with implementation risks underestimation of the investment required to change practice. This has been identified as a missed opportunity to develop evidence about the importance of fixed and recurring costs associated with practice change interventions [20].

The importance of economic evaluation in the context of implementation science and how these analyses can be most efficiently incorporated into decision-making process has been recognised [19]. To address this evidence gap, a trial-based economic evaluation was conducted of a practice change implementation intervention that aimed to improve delivery of guideline recommended antenatal care addressing alcohol consumption by women during pregnancy. The aims of the economic evaluation were to:

  1. 1)

    Identify, measure and value the cost of developing and delivering a multi-strategy practice change intervention;

  2. 2)

    Report the costs and consequences of a multi-strategy practice change intervention; and

  3. 3)

    Determine the cost-effectiveness of a multi-strategy practice change intervention in improving antenatal care provider adherence to antenatal care guidelines compared to usual care.

The secondary aims for the economic evaluation were to report each of the aims by sector.

Methods

The trial

The practice change intervention trial has been reported by Kingsland et al. [25]. In summary, a randomised stepped-wedge controlled trial of a maternal alcohol practice change intervention was conducted in maternity services in three sectors in the Hunter New England Local Health District (HNELHD), New South Wales, Australia. Combined, the sectors provide antenatal care for approximately 6,100 women annually, accounting for 70% of public hospital births in the district [25]. The sectors provided antenatal care to women in a major city (Sector One: 4300 births per annum) and two regional/rural areas (Sectors Two and Three: 1200 and 600 births per annum respectively). The participating maternity services provided antenatal care for women through hospital and community-based midwifery clinics; hospital medical clinics; midwifery continuity of care group practices; Aboriginal Maternal and Infant Health Services (AMIHS); and specialist services caring for women with complex pregnancies or social vulnerabilities. All antenatal care providers in these services were eligible to receive the implementation strategies, including midwifery and medical staff and Aboriginal Health Workers (AHWs).

Outcome data were collected over a 35 month period from seven-months prior to commencement of the practice change intervention in the first sector to seven-months following completion of the intervention in the third sector [11]. Stepped delivery of the seven-month intervention period in each of the three sectors occurred in a random order at seven-month intervals [25]. All antenatal care providers who worked in the participating maternity services were eligible to receive the practice change intervention. The trial primary outcome measures were the proportion of antenatal appointments at ‘booking in’ (initial antenatal , 27–28 weeks gestation and 35–36 weeks gestation for which women report [1] being assessed for alcohol consumption, [2] being provided with brief advice related to alcohol consumption during pregnancy, [3] receiving relevant care for addressing alcohol consumption during pregnancy, and [4] being assessed for alcohol consumption and receiving relevant care [25].

Guideline recommended model of antenatal care

An evidence- and guideline-based model of antenatal care was developed to address alcohol consumption by pregnant women [25]. The model of care involved health care provider assessment of a woman’s alcohol risk status using the AUDIT-C tool at the initial antenatal visit, and at follow up antenatal appointments at 27-29 weeks and 35-37 weeks gestation. The model of care also required all pregnant women were to be provided with brief advice indicating it is safest not to consume alcohol during pregnancy and of the risks associated with alcohol consumption. Women who were assessed as being at ‘medium risk’ of harm (AUDIT-C score: 3-4) were to be offered a referral to the NSW Get Healthy in Pregnancy Service, a free government provided evidence-based telephone coaching service for Aboriginal women, or to a face-to-face counselling service where available. Women who were assessed as being at ‘high risk’ of harm (AUDIT C score: 5+) were referred to Hunter New England Drug and Alcohol Clinical Services for further assessment and follow-up.

Practice change intervention

A multi-strategy practice change intervention to support the provision of the antenatal model of antenatal care was co-designed with input from health service stakeholders (e.g. senior maternity service staff, drug and alcohol service staff) and Aboriginal health organisations and women, and was guided by an implementation framework [26,27,28,29]. The intervention involved seven evidence-based practice change strategies: leadership and management; local clinical practice guidelines; electronic prompt and reminder system; local clinical/academic opinion leaders (change champions); educational meetings and educational materials; academic detailing (including audit and feedback); and monitoring and accountability for the performance of the delivery of health care [25]. Refer to Table 1.

Usual care

Prior to delivery of the practice change intervention in each of the three sectors, usual antenatal care addressing maternal alcohol consumption during pregnancy was provided [11]. An observational study was conducted in 2017-2018 to examine pregnant women’s reported receipt of guideline recommended care addressing alcohol consumption during pregnancy [11]. The study found that although assessment and care for maternal alcohol consumption is highly acceptable to pregnant women, receipt of such care in public antenatal services is suboptimal and inconsistent [11].

Economic evaluation

Details of the approach to conducting the economic evaluation have been reported in the economic evaluation protocol [30]. A trial-based economic evaluation was conducted to assess cost, cost-consequence and cost-effectiveness of the development and delivery of the intervention. The analysis was conducted from a healthcare provider perspective and was based on opportunity cost. The perspective was chosen as ongoing investment in the intervention, if translated into routine practice, would fall on public health services [30]. Costs incurred in 2017 and 2018 were adjusted for inflation using annual consumer price index [31]. All costs are reported in 2019 Australian dollars ($AUD).

The economic evaluation was conducted and reported in accordance with the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) publication guidelines and good reporting practices [32]. Adherence to the CHEERS checklist is available in Supplementary Table 1.

Identification and measurement of outcomes

The economic evaluation was based on the trial primary outcome: the proportion of women at the initial, 27-28 weeks gestation and 35–36 weeks gestation antenatal visits who reported being assessed for alcohol consumption using the Alcohol Use Disorders Identification Test (AUDIT-C) tool, and who received the recommended elements of care (advice and referral) appropriate to their level of risk, as determined by AUDIT-C risk categories for pregnancy [30]. The trial primary outcome and the economic cost data were combined in an incremental cost-effectiveness ratio (ICER) calculated as the incremental cost per percentage increase in self-reported receipt of all guideline elements. ICERS by sector were reported as secondary outcomes.

Identification, measurement and valuation of practice change costs

At present, there are no guidelines for costing practice change interventions that aim to improve the implementation of guideline recommendations in health care settings [33, 34]. A recent pragmatic method for costing implementation strategies using time-driven activity based costing has been proposed by Cidav et al [33]. Time-driven activity-based costing is a micro-costing method widely used in business settings, which delivers detailed, accurate and transparent information on activity costs designed to inform quality assurance processes and decision making [33, 35, 36]. The costing method involves three parameters; (i) frequency of the activity, (ii) time required to perform one single event of the activity, and (iii) per-hour price of the resources used to perform the activity [33]. The detailed information collected using this approach provides a direct link between the implementation inputs (resources utilized) and implementation outcomes [33]. Cidav’s methods were used to inform the identification, measurement and valuation of implementation intervention data in the economic evaluation [33].

Intervention costs were prospectively identified and measured using a time-driven activity based cost-capture tool [30]. The cost-capture tool was developed in Microsoft Excel (2013) and allowed researchers to document the activity and materials consumed at different phases of the trial (development and delivery) and for all relevant stakeholders [30]. The cost-capture tool included the following resource use categories: [1] Labour [2]; Materials; and [3] Miscellaneous costs. Table 2 presents the approach to the valuation of unit costs for each item. Researcher officers involved in the trial delivery completed the cost-capture tool at the time of the cost being incurred throughout the trial duration. Labour, materials, and other implementation costs were captured, with the cost-capture tool built to allow expenses to be allocated to pre-coded cost categories and to one or more pre-coded implementation strategies. Following the reporting convention established in the CHEERs checklist, development and research costs are deemed ‘start-up’ costs [1]. We excluded development costs in this analysis as they represent the investment made by the research team to formulate the intervention components, and are not representative of the resource use required in ‘steady state’ operations. However, we separately reported the calculated value of the development costs to inform the upfront investment required to develop this intervention, where no similar model of care exists. Research related costs together with intervention development costs were excluded from the cost-consequence and cost-effectiveness analysis to achieve a focus on the costs and efficiency of the practice change intervention alone.

Cost data were treated as counts of resource use, weighted by unit costs. The cost for each sector was determined by summing the intervention delivery costs relevant to and coded for that sector. A cost per practice change strategy is reported to demonstrate the investment required for each of the seven strategies and to inform future intervention scale up and sustainability. The intervention was wholly additional to usual care, that is, no usual practice activity was displaced as a result of the intervention. Costs to providers, patients and private care providers (including opportunity costs) were not assessed.

Cost-consequence (CCA) and cost-effective analyses (CEA)

The results of the CCA are presented as the total cost of delivering the intervention alongside the range of outcomes reflected in the primary and secondary trial outcomes (consequences). The cost per eligible clinical provider is presented to demonstrate the cost and consequence of the intervention for those intended to provide the evidence-based model of care. Eligible clinical providers were all clinicians within the participating maternity services who provided antenatal care during the intervention period. Eligible clinical providers included midwifery and medical staff as well as Aboriginal Health Workers. It excluded clinicians who were not the primary providers of antenatal care (e.g. dietitians, diabetes educators and drug and alcohol clinicians). Eligible clinical providers were identified through rostering and payroll systems obtained from the participating maternity services. Modelled extrapolation of the self-report survey data was conducted to estimate the proportion of all women attending the participating maternity services who received all guideline elements during the intervention follow-up period. This extrapolation enabled estimation of the incremental cost per woman who received all guideline elements, in each sector. The average cost per woman was calculated as the cost of the practice change intervention, divided by the total number of women who are anticipated to have received all guideline elements based on the sample of women surveyed.

The trial-based CEA aligned the cost of the intervention against self-reported receipt of all guideline elements of antenatal care. The trial outcomes, reported as odds ratios, were converted to risk differences for inclusion in the CEA, e.g. the risk difference for the primary outcome refers to the percentage point (proportion) increase in the self-reported receipt of all guideline elements of antenatal care. This information was used to generate an ICER.

Uncertainty, sensitivity and sub-group analyses of ICERs

ICERs were calculated by sector to enable reporting of the variation in costs and effect sizes between the three sectors. One-way probabilistic sensitivity analyses assessed the effect of variation in the magnitude of treatment effect using the lower and upper confidence interval limits and variation in costs of intervention components using the lower and upper bounds of staff salaries. Non-parametric bootstrapping was undertaken to derive uncertainty intervals around the estimates for total cost and cost-effectiveness. Results from the sensitivity analyses were visually presented on a cost-effectiveness plane where the joint distribution of incremental costs were plotted against the incremental change in effect size between baseline and follow-up. Refer to Figs. 2 and 3.

Results

Cost

The resources invested to increase compliance with the guideline-based model of care were calculated as being wholly incremental to usual practice. The total cost of the practice change intervention across all three sectors was $367,646 of which $40,871 (11%) were development costs and $326,774 (89%) ($AUD, 2019) were intervention delivery costs. Of the intervention delivery costs, Sector one cost $133,188 (41%) of the practice change intervention costs. Sectors two and three incurred similar proportions of the practice change intervention cost, 30% and 29% respectively. The cost of labour was the main cost driver for the intervention, comprising 70% of the total intervention costs. Refer to Table 3.

Of the seven practice change intervention strategies ‘educational meetings and educational materials’ comprised 65% of the total intervention cost, followed by ‘local opinion leaders/champions’ with 18% of the intervention costs. The salary of the clinician midwife educator (CME) was the main cost driver for the ‘educational meetings and educational materials’ strategy. A CME was employed in each sector for the duration of the 7-month intervention. The CME for Sector one was employed at 1.0 full-time equivalent (FTE), the CME for Sector two at 0.6 FTE and Sector three at 0.4 FTE, relative to the number of births in each Sector. The remaining five intervention strategies each incurred between 1% and 8% of the total intervention costs. Refer to Fig. 1.

Fig. 1
figure 1

Cost ($AUD, 2019) per practice change strategy, by sector. Practice change strategies: 1) Leadership/managerial supervision; 2) Local clinical practice guidelines; 3) Electronic prompt and reminder system; 4) Local opinion leaders/champions; 5) Educational meetings and educational materials; 6) Academic detailing, including audit and feedback; 7) Monitoring and accountability for the performance of the delivery of healthcare

Full size image

Cost-consequence and cost-effectiveness analyses

Significant intervention effects were found for receipt of all guideline elements (risk difference 9.33; 95% CI 7.67–10.98; p = <0.001). The increase in receipt of all guideline elements was seen across all three sectors. The average cost of delivering the practice change intervention per eligible clinician was $993 (Range: $640-$1928). Based on the average number of women in the service per month over the trial follow-up period, the extrapolated average cost per woman who received all guideline elements was calculated to be $591 (Range: $329 - $940). Variation in the average cost per woman was associated with variation in the average number of women through each service, per month between sectors. Sector one had a total of 6862 women through the antenatal service during the 21-month follow-up period, an average of 58 women per month reporting receipt of all guideline elements for the duration of the intervention. In comparison, Sector two had an average of 29 women per month reporting receipt of all guideline elements for a 14-month time period and Sector three had an average of 14 women per month for the seven-month time period. Refer to Table 4.

The calculated ICER per percentage point increase in self-reported receipt of all guideline elements was $32,570 (95% CI: $32,566–$36,340). The incremental cost per percent increase in women receiving all guideline elements ranged from $15,951 (95% CI: $13,109–$20,365) in Sector one and $5,618 (95% CI: $4,261–$8,25) in Sector two. Refer to Table 5.

Sensitivity analysis

The ICER in the sensitivity analysis was $35,024 (95% CI; $29,761 - $42,604), indicating that the ICER was sensitive to variation in labour costs Table 5.

Figures 2 and 3 present the joint distribution of incremental intervention cost and incremental effectiveness. All replications show a positive incremental benefit of the intervention over usual care, at increased cost. Figure 2 is a focussed view demonstrating limited variation of ICER pairs.

Fig. 2
figure 2

Cost effectiveness plane

Full size image
Fig. 3
figure 3

Cost-effectiveness plane area of interest

Full size image

Discussion

This economic evaluation outlined the costs, consequences, and cost-effectiveness associated with the first published randomised controlled trial to examine the effectiveness and efficiency of delivering a practice change intervention to improve the implementation of guideline recommended care for maternal alcohol consumption. The intervention was effective at improving reported receipt of all guideline elements of care. The incremental cost of intervention delivery was calculated to be $326,774. Labour (staff time) was the main cost driver and variation in delivery costs across sectors was associated with design differences in labour time and travel costs for each sector.

The average cost over the trial period of delivering the practice change intervention per eligible clinician was $993, and $591 per woman who received all guideline elements. The cost of delivering clinician training was upfront and is not expected to require additional investment beyond the trial horizon. Clinician training modules were developed during the intervention and made permanently available online for staff to access as part of their ongoing clinician training. Further, in an effort to sustain the intervention effect size, implementation strategies were deliberately designed to affect permanent and scalable change within the health system, e.g. the inclusion of specific modules into the state-based e-maternity patient record management system, and performance measures were embedded into the health system. Therefore, these implementation strategies are expected to sustain the effect size post-intervention. As such, the average cost per woman is expected to reduce markedly with continued delivery of this new model of care over time (e.g. beyond the trial time horizon), with increased women receiving antenatal care and with scaling up to involve other maternity services/clinicians. Similarly, with respect to potential ongoing costs (beyond the trial time horizon) associated with this intervention and maintaining the intervention effect size beyond the trial time horizon.

Direct comparison between the results of this and previously reported studies of the cost and cost effectiveness of practice change interventions is not possible given the significant differences in the design and methods of the various studies. Broad comparisons with studies included in previous systematic reviews were also limited as the costs associated with the implementation of the practice change strategies is not often considered [20, 24, 37]. The review by Roberts et al. [20] identified one modelled CEA of a universal alcohol screening and brief intervention program in primary care in England [38]. This analysis compared the health and social care costs verses health benefits and found screening patients for alcohol consumption upon registration with a family doctor would steadily capture up to 96% of the population over a 10-year programme [38]. This study showed that alcohol screening and the provision of brief advice, led by practice nurses, provided cost savings to the health care system of £120m over 30 years [38]. Similar to the methods and findings of the present study, the cost of the intervention was estimated using activity costs and identified that resourcing needs for this intervention would be highest in the early years of the program due to the volume of new patients being screened, and would decrease over time [38]. This study did not include the cost of implementing this model of care into routine practice or addressing barriers to care delivery by relevant health service providers. In comparison, the practice change strategies used in the current study were designed to be embedded into the health care system to maintain the new model of care beyond the intervention delivery and follow-up period. As such, it is plausible that the demonstrated change in practice could be sustained beyond the trial time horizon and the average cost per woman screened would decrease as more women attend the antenatal service. Future studies could include longer intervention follow-up periods to capture the number of women receiving care over a longer time period, as well as the health and societal benefits for mothers and their infants. Further research is also required to determine the cost of delivering the intervention at scale and whether economies of scale can be achieved in its delivery.

Implementation costs are recognised as an understudied aspect of implementation science [39, 40]. Saldana et al. proposed that one of the reasons implementation costs are not routinely examined is the lack of standard measurement [39]. More recently, Cidav et al. proposed a pragmatic approach to systematically estimating detailed resource use and costs of implementation strategies that combine time-driven activity-based costing with a leading implementation science framework [41] to guide specification and reporting of implementation strategies [33]. One of the key strengths of this study was the use of this time-driven activity based micro-costing to map implementation processes with actions, actors and strategies. This method provides transparent, granular cost estimation and allowed for a cost comparison of the different implementation strategies. It has been proposed that there could be value to using standardised methods for estimating implementation costs as it could allow decision makers responsible for determining the viability and feasibility of adopting new practices to benefit from the ability to generalise across settings [39, 42]. The transparent reporting of activity costs using a published time-driven activity-based costing method is intended to inform researchers and decision makers how specific components of an implementation intervention influence the total cost.

Another strength of this economic evaluation is the identification, measurement and valuation of development costs. That is, once the practice change intervention has been delivered, there are non-recoverable intervention components that remain within each sector. For example, the cost of developing and producing local clinical guidelines, the cost of developing educational materials and the cost of developing site-specific systems level monitoring and accountability measures. Saldana et al. argue development costs are an important consideration in decision making as policy makers must decide ex ante whether to invest in a new model of care and unrecoverable costs must be considered amongst the future benefits [39]. Transparent reporting of costs associated with the practice change intervention is intended to inform decision makers of when, during the practice change process, different costs and benefits can be expected [19].

It was not possible to calculate an ICER for the cost per additional service user (pregnant woman) who received all guideline elements of care. The study was designed and powered to measure effectiveness at the health sector level, thus precluding this ICER calculation. Given this limitation, the average cost per additional service user (pregnant woman) exposed to the recommended treatment was calculated. Another, limitation of the study was that the ICER was calculated on the assumption that the intervention was wholly additional to usual care, that is, no usual practice activity was displaced as a result of the intervention. Identifying, measuring and valuing the cost of usual care was beyond the scope of the trial and hence a limitation of the analysis. The trial time horizon was 35-months, and as such only upfront and short-term costs to health service providers were included. Similarly, the potential impact of increased referrals to drug and alcohol services and the longer-term benefits of alcohol-harm reduction to society at large, was not captured in this trial and is a noted limitation. Future economic evaluations should endeavour to include these components. The range of costs associated with sustaining changes in provider behaviour and maternal alcohol consumption is complex [2], and beyond the scope of the analyses.

Conclusion

The practice change intervention was effective at improving women’s reported receipt of all guideline elements of care. The incremental cost of delivering the intervention was calculated to be $326,774. To our knowledge, no similar studies have been published in the literature. The economic evaluation provides information for decision and policy makers regarding the cost, cost-consequence and cost-effectiveness of delivering a practice change intervention to support the introduction of a model of care for addressing alcohol consumption by pregnant women. Given the positive trial findings, further research is required to assess sustainability and determine the cost of delivering the intervention at scale and whether economies of scale can be achieved.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AUD:

Australian dollars

AUDIT-C:

Alcohol Use Disorders Identification Test

BIA:

Budget impact assessment

CEA:

Cost-effectiveness evaluation

DCEA:

Distributional cost-effectiveness analysis

ICER:

Incremental cost-effectiveness ratio

References

  1. Kingsland M, Doherty E, Anderson AE, Crooks K, Tully B, Tremain D, et al. A practice change intervention to improve antenatal care addressing alcohol consumption by women during pregnancy: research protocol for a randomised stepped-wedge cluster trial. Implementation Sci : IS. 2018;13(1):112.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Popova S, Lange S, Burd L, Rehm J. The Economic Burden of Fetal Alcohol Spectrum Disorder in Canada in 2013. Alcohol Alcohol. 2016;51(3):367–75.

    Article  PubMed  Google Scholar 

  3. Department of Health. Clinical Practice Guidelines: Pregnancy Care. Canberra Australian Government Department of Health; 2018.

  4. National Health and Medical Research Council. Alcohol.: NHMRC; 2020. Contract No.: 11/11/2020.

  5. Health Do. Improving Maternity Services in Australia. The Report of the Maternity Services Review. Canberra2009.

  6. Welfare AIoHa. Australia's mothers and babies 2018: in brief. Canberra: AIHW; 2020.

  7. World Health Organisation. Guidelines for the identification and management of substance use and substance use disorders in pregnancy. Geneva; 2014.

  8. Gynaecologists TRAaNZCoOa. Alcohol in pregnancy. 2014.

  9. Council AHMA. Clinical practice guidelines: antenatal care – module I. Canberra: Australian Government Department of Health; 2012.

  10. Health Do. Models of Maternity Care Canberra2009 [Available from: https://www1.health.gov.au/internet/publications/publishing.nsf/Content/msr-report~msr-report-tables~msr-report-table2.

  11. Doherty E, Wiggers J, Wolfenden L, Anderson AE, Crooks K, Tsang TW, et al. Antenatal care for alcohol consumption during pregnancy: pregnant women’s reported receipt of care and associated characteristics. BMC Preg Childbirth. 2019;19(1):299.

    Article  Google Scholar 

  12. Health Canada. A National Survey Regarding Knowledge and Attitudes of Health Professionals About Fetal Alcohol Syndrom. Calgary: Health Canada; 2003.

  13. Health and Social Care Information Centre. Infant Feeding Survey. Health and Social Care Information Centre,; 2007.

  14. Flodgren G, O'Brien MA, Parmelli E, Grimshaw JM. Local opinion leaders: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2019;6(6):Cd000125.

  15. Shojania KG, Jennings A, Mayhew A, Ramsay CR, Eccles MP, Grimshaw J. The effects of on-screen, point of care computer reminders on processes and outcomes of care. Cochrane Database Syst Rev. 2009;2009(3):Cd001096.

  16. Reeves S, Perrier L, Goldman J, Freeth D, Zwarenstein M. Interprofessional education: effects on professional practice and healthcare outcomes (update). Cochrane Database Syst Rev. 2013;2013(3):Cd002213.

  17. Chaillet N, Dubé E, Dugas M, Audibert F, Tourigny C, Fraser WD, et al. Evidence-based strategies for implementing guidelines in obstetrics: a systematic review. Obstetrics and gynecology. 2006;108(5):1234–45.

    Article  PubMed  Google Scholar 

  18. Reeves P, Edmunds K, Searles A, Wiggers J. Economic evaluations of public health implementation-interventions: a systematic review and guideline for practice. Public Health. 2019;169:101–13.

    Article  CAS  PubMed  Google Scholar 

  19. Hoomans T, Severens JL. Economic evaluation of implementation strategies in health care. Implement Sci : IS. 2014;9:168.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Roberts SLE, Healey A, Sevdalis N. Use of health economic evaluation in the implementation and improvement science fields—a systematic literature review. Implement Sci. 2019;14(1):72.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Maloney S, Haas R, Keating JL, Molloy E, Jolly B, Sims J, et al. Breakeven, cost benefit, cost effectiveness, and willingness to pay for web-based versus face-to-face education delivery for health professionals. J Med Internet Res. 2012;14(2):e47.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Mortimer D, Bosch M, McKenzie JE, Turner S, Chau M, Ponsford JL, et al. Economic evaluation of the NET intervention versus guideline dissemination for management of mild head injury in hospital emergency departments. Implement Sci. 2018;13(1):147.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Vale L, Thomas R, MacLennan G, Grimshaw J. Systematic review of economic evaluations and cost analyses of guideline implementation strategies. Eur J Health Econ: HEPAC : Health Econ Prevention Care. 2007;8(2):111–21.

    Article  Google Scholar 

  24. Szewczyk Z, Holliday E, Dean B, Collins C, Reeves P. A systematic review of economic evaluations of antenatal nutrition and alcohol interventions and their associated implementation interventions. Nutrition Rev. 2020;79(3):261–73.

    Article  Google Scholar 

  25. Kingsland M, Doherty E, Anderson AE, Crooks K, Tully B, Tremain D, et al. A practice change intervention to improve antenatal care addressing alcohol consumption by women during pregnancy: research protocol for a randomised stepped-wedge cluster trial. Implementation Sci. 2018;13(1):112.

    Article  Google Scholar 

  26. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci. 2009;4(1):50.

    Article  Google Scholar 

  27. Atkins L, Francis J, Islam R, O'Connor D, Patey A, Ivers N, et al. A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems. Implement Sci : IS. 2017;12(1):77.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Quality and Safety in Health Care. 2005;14(1):26.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7(1):37.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Reeves P, Szewczyk Z, Kingsland M, Doherty E, Elliott E, Dunlop A, et al. Protocol for an economic evaluation and budget impact assessment of a randomised, stepped-wedge controlled trial for practice change support to increase routine provision of antenatal care for maternal alcohol consumption. Implement Sci Commun. 2020;1(1):91.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Welfare AIoHa. Health expenditure Australia 2018–19. Canberra AIHW; 2020.

  32. Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)--explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health : J Intern Soc Pharmacoeconomics and Outcomes Res. 2013;16(2):231–50.

    Article  Google Scholar 

  33. Cidav Z, Mandell D, Pyne J, Beidas R, Curran G, Marcus S. A pragmatic method for costing implementation strategies using time-driven activity-based costing. Implement Sci. 2020;15(1):28.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Gold R, Bunce AE, Cohen DJ, Hollombe C, Nelson CA, Proctor EK, et al. Reporting on the Strategies Needed to Implement Proven Interventions: An Example From a "Real-World" Cross-Setting Implementation Study. Mayo Clin Proc. 2016;91(8):1074–83.

    Article  PubMed  Google Scholar 

  35. Frick KD. Microcosting quantity data collection methods. Med Care. 2009;47(7 Suppl 1):S76–81.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Filene JH, Brodowski ML, Bell J. Using Cost Analysis to Examine Variability in Replications of an Efficacious Child Neglect Prevention Program. J Public Child Welfare. 2014;8(4):375–96.

    Article  Google Scholar 

  37. Hoomans T, Evers SM, Ament AJ, Hübben MW, van der Weijden T, Grimshaw JM, et al. The methodological quality of economic evaluations of guideline implementation into clinical practice: a systematic review of empiric studies. Value Health : J Int Soc Pharmacoeconomics Outcomes Res. 2007;10(4):305–16.

    Article  Google Scholar 

  38. Purshouse RC, Brennan A, Rafia R, Latimer NR, Archer RJ, Angus CR, et al. Modelling the Cost-Effectiveness of Alcohol Screening and Brief Interventions in Primary Care in England. Alcohol and Alcoholism. 2012;48(2):180–8.

    Article  PubMed  Google Scholar 

  39. Saldana L, Chamberlain P, Bradford WD, Campbell M, Landsverk J. The Cost of Implementing New Strategies (COINS): A Method for Mapping Implementation Resources Using the Stages of Implementation Completion. Child Youth Serv Rev. 2014;39:177–82.

    Article  PubMed  Google Scholar 

  40. Ginexi EM, Hilton TF. What's Next for Translation Research? Eval Health Prof. 2006;29(3):334–47.

    Article  PubMed  Google Scholar 

  41. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76.

    Article  PubMed  Google Scholar 

  42. Ritzwoller DP, Sukhanova A, Gaglio B, Glasgow RE. Costing behavioral interventions: a practical guide to enhance translation. Ann Behav Med. 2009;37(2):218–27.

    Article  PubMed  Google Scholar 

  43. Kingsland M, Doherty E, Anderson AE, Crooks K, Tully B, Tremain D, et al. A practice change intervention to improve antenatal care addressing alcohol consumption by women during pregnancy: research protocol for a randomised stepped-wedge cluster trial. Implement Sci 2018;13(1):N.PAG-N.PAG.

Download references

Acknowledgements

We extend our thanks to Milly Licata and Julia Dray for their contribution to the development of the data collection tools.

Funding

This economic evaluation is funded by the National Health and Medical Research Council (NHMRC) Partnership Project grant (APP1113032). The NHMRC has not had any role in the design of the study as outlined in this protocol and will not have a role in data collection, analysis of data, interpretation of data and dissemination of findings. As part of the NHMRC Partnership Grant funding arrangement, the following partner organisations also contribute fund: Hunter New England Local Health District Clinical Services Nursing and Midwifery, the Foundation for Alcohol Research and Education, and the NSW Health Office of Preventive Health. Individuals in positions that are fully or partly funded by these partner organisations (as described in ‘Competing Interests’) will have a role in the study design, data collection, analysis of data, interpretation of data and dissemination of findings. The University of Newcastle will make final decisions on each of these study aspects.

Author information

Authors and Affiliations

  1. Hunter Medical Research Institute, New Lambton Heights, New South Wales, Australia

    Zoe Szewczyk, Penny Reeves, Melanie Kingsland, Emma Doherty, Andrew Searles & John Wiggers

  2. School of Medicine and Public Health, The University of Newcastle, Callaghan, New South Wales, Australia

    Zoe Szewczyk, Penny Reeves, Melanie Kingsland, Emma Doherty, Luke Wolfenden, Adrian Dunlop, Andrew Searles & John Wiggers

  3. Hunter New England Population Health, Hunter New England Local Health District, Wallsend, New South Wales, Australia

    Melanie Kingsland, Emma Doherty, Luke Wolfenden & John Wiggers

  4. School of Medicine, The University of Sydney, Camperdown, New South Wales, Australia

    Elizabeth Elliott & Tracey W. Tsang

  5. Sydney Children’s Hospital Network, Kids Research Institute, Westmead, New South Wales, Australia

    Elizabeth Elliott & Tracey W. Tsang

  6. Drug and Alcohol Clinical Services, Hunter New England Local Health District, Newcastle, New South Wales, Australia

    Adrian Dunlop

Authors
  1. Zoe Szewczyk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Penny Reeves
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Melanie Kingsland
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emma Doherty
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Elizabeth Elliott
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Luke Wolfenden
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Tracey W. Tsang
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Adrian Dunlop
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Andrew Searles
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. John Wiggers
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MK, EE, JW, AS, AD, LW, TS and PR developed the original research concept and developed the study design. MK, EE, ED are responsible for overseeing data collection. ZS conducted the analysis. PR oversaw the analysis and provided feedback. ZS and PR developed the draft manuscript. All authors made substantial contributions to the manuscript development, read and approved the final manuscript.

Corresponding author

Correspondence to Zoe Szewczyk.

Ethics declarations

Ethics approval and consent to participate

The trial was approved by the Hunter New England Human Research Ethics Committee (16/11/16/4.07; 16/10/19/5.15), the Aboriginal Health and Medical Research Council (1236/16) and the University of Newcastle Human Research Ethics Committee (H-2017-0032; H-2016-0422).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

A full description of component details has been published elsewhere [43].

Contributions to the literature

• This is the first trial-based economic evaluation that identified, measured and valued the resources associated with the development and implementation of a practice change intervention to improve delivery of guideline recommended antenatal care addressing alcohol consumption by pregnant women.

• The findings inform decision makers of the cost, cost-consequence and cost-effectiveness of delivering a practice change intervention.

• Resource requirements were highest during the intervention period, however the average cost per woman is expected to decrease over time. Evidence of the cost profile is intended to inform decision makers of when, during the practice change process, different costs and benefits are expected.

Supplementary Information

Appendices

Appendices

Table 1 Implementation Strategy Summary
Full size table
Table 2 Approach to valuation of resources, by cost category
Full size table
Table 3 Total intervention cost disaggregated by sector, resource use category and practice change strategy
Full size table
Table 4 Cost-consequence results (baseline to follow-up)
Full size table
Table 5 Incremental cost-effectiveness ratios for the primary and secondary outcomes
Full size table

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Szewczyk, Z., Reeves, P., Kingsland, M. et al. Cost, cost-consequence and cost-effectiveness evaluation of a practice change intervention to increase routine provision of antenatal care addressing maternal alcohol consumption. Implementation Sci 17, 14 (2022). https://doi.org/10.1186/s13012-021-01180-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13012-021-01180-6

Keywords

Implementation Science

ISSN: 1748-5908