Skip to main content

Optimising child outcomes from parenting interventions: fathers’ experiences, preferences and barriers to participation

Abstract

Background

Early childhood interventions can have both immediate and long-term positive effects on cognitive, behavioural, health and education outcomes. Fathers are underrepresented in interventions focusing on the well-being of children. However, father participation may be critical for intervention effectiveness, especially for parenting interventions for child externalising problems. To date, there has been very little research conducted to understand the low rates of father participation and to facilitate the development of interventions to meet the needs of fathers. This study examined fathers’ experiences of, and preferences for, parenting interventions as well as perceptions of barriers to participation. It also examined how these factors were associated with child externalising behaviour problems, and explored the predictors of participation in parenting interventions.

Methods

A community sample of 1001 fathers of children aged 2–16 years completed an online survey about experiences with parenting interventions, perceived barriers to participation, the importance of different factors in their decision to attend, and preferred content and delivery methods. They also completed ratings of their child’s behaviour using the Strengths and Difficulties Questionnaire.

Results

Overall, 15% of fathers had participated in a parenting intervention or treatment for child behaviour, with significantly higher rates of participation for fathers of children with high versus low levels of externalising problems. Fathers rated understanding what is involved in the program and knowing that the facilitator is trained as the two most important factors in their decision to participate. There were several barriers to participation that fathers of children with high-level externalising problems were more likely to endorse, across practical barriers and help-seeking attitudes, compared to fathers of children with low-level externalising problems. Almost two-thirds of fathers of children with high-level externalising behaviour had not participated in a parenting intervention or treatment. The only significant predictors of intervention participation were severity of child externalising behaviour problems and child age.

Conclusions

The findings have important implications for services seeking to increase father engagement and highlight a number of strategies to enhance the promotion and delivery of parenting interventions to fathers. These strategies include more public health messaging about parenting programs and the importance of father participation.

Peer Review reports

Background

The seeds of lifetime achievement, as well as social, physical and mental health are sown early in childhood [1]. Many adult physical and mental health problems have their origins in childhood [2, 3], and evidence suggests that early childhood interventions can have immediate and long-term positive effects on cognitive, behavioural, health and education outcomes [4]. Crucially, however, fathers are largely missing from interventions focussing on the well-being of children. Numerous reviews have highlighted the underrepresentation of fathers in parenting interventions [5], child welfare services [6,7,8], pediatrics [9, 10], as well as interventions targeting: childhood autism [11]; externalising problems such as oppositional behaviour, temper tantrums and aggression [12]; Attention Deficit Hyperactivity Disorder (ADHD) [13]; and internalising problems such as anxiety [14]. The low level of father engagement is concerning, especially as there is evidence to suggest that father involvement in interventions can lead to improved outcomes for children [15]. There has been very little research conducted with fathers about their needs and preferences for interventions. Such research is critical for developing father-inclusive interventions which may increase father engagement and intervention efficacy, especially among the most at-risk families. The current paper reports on the findings of a survey of fathers regarding their needs and preferences for parenting interventions, and their perceptions of barriers to participation. In this paper, we focus on parenting interventions for childhood externalising problems, as this is the intervention for which most is known in relation to father involvement.

There is significant evidence that parenting interventions, which focus on enhancing the quality and consistency of parenting, produce reliable improvement in externalising behaviour problems [16], with effects lasting up to 20 years after the intervention [17]. The majority of participants in parenting interventions are mothers and many studies do not even report on rates of father participation [5, 18, 19]. When rates have been reported, only around 13–21% of attendees are fathers [13, 20, 21]. Importantly, there is evidence that including fathers in parenting interventions leads to reductions in child externalising behaviours. Lundahl et al. (2008) conducted a meta-analytic review (k = 26) and found that father engagement in parenting interventions was associated with reduced child externalising behaviour and improved parenting behaviour in the short-term, but not in the longer-term. However, other research has found long-term improvements in outcomes for children when fathers are included in interventions [22, 23]. It is not surprising that father engagement improves the intervention effectiveness, as inclusion of fathers (and the core parenting team) is likely to be necessary for: (1) addressing father-specific (in addition to mother-specific) risk factors (e.g., harsh, coercive parenting) that may cause or maintain child externalising problems, (2) enhancing inter-parental consistency in implementation of parenting strategies, and (3) reducing parenting conflict, which is in itself a key risk factor for child externalising problems [24].

While interventions appear to be more effective if fathers take part, there is also evidence to suggest that fathers who participate receive fewer benefits from parenting interventions than do mothers. Meta-analyses have demonstrated smaller effect sizes for changes in fathers’ ratings of parenting and child behaviour compared with mothers’ ratings [18, 25], although it should be noted that many studies do not report on outcome measures separately for mothers and fathers [5, 12]. Due to the lack of research, the reasons for the smaller effects for fathers versus mothers are largely unknown. One possibility is that, as parenting interventions have largely been developed for, and empirically tested with mothers, they may not adequately meet the needs of fathers [26]. Therefore, research is required to better understand fathers’ needs and preferences regarding parenting programs.

Little empirical research has investigated reasons for the low rates of father engagement, with available studies characterised by either small samples and qualitative methodologies [27,28,29], or practitioner surveys [30,31,32]. Overall, this research suggests that there are likely to be a range of interrelated factors that act as barriers to father engagement, including: (1) practical factors, such as fathers’ work commitments and availability of child care; (2) program factors, such as content not being relevant for fathers; (3) personal factors, such as fathers’ beliefs about help-seeking or awareness of parenting interventions; (4) family factors, such as mothers’ facilitation of father engagement, known as ‘maternal gatekeeping’ [31]; (5) practitioner factors, such as skills and confidence in engaging fathers, and; (6) organisational factors, such as offering sessions outside working hours, and policies and practices regarding father inclusion.

To date there have been only two surveys of fathers to examine their experiences of parenting or participation in parenting programs. The first surveyed 933 Australian fathers [33] and found 11% of fathers reported that they had participated in a parenting program in the last 12 months (a further 6% had consulted a professional about their child’s behaviour). The second surveyed 161 New Zealand fathers [34] and found a lifetime participation rate of 3%. The features of parenting interventions that fathers rated as most important to them were demonstrated program effectiveness, the personal relevance of the program content, and having a trained practitioner run the program [34]. Fathers also preferred less intensive delivery formats involving seminars, father-only groups, television series and internet-based programs, rather than weekly or more intensive programs. Finally, the topics fathers rated as most important were building a positive parent–child relationship, increasing children’s confidence and social skills, and positively influencing children’s development [34]. While these studies provide insights into fathers’ general needs and preferences, the specific needs and preferences of fathers of children with high levels of externalising behaviour problems have not been explored. As noted by Frank et al. [34], to achieve the goal of increasing the reach of parenting interventions, information is needed on the needs of many father groups, including those with low and high externalising problems.

Although parenting interventions can be offered as a universal intervention to all parents in order to prevent the onset or escalation of behaviour problems in children, many interventions target parents of children who are already displaying externalising behaviour problems, as these families are thought most likely to benefit. Despite this, research suggests that only a minority of these families participate in evidence-based parenting interventions [33]. Given the high prevalence of child externalising problems [35] and low rates of program participation, it is particularly important to examine whether parents of children with high externalising behaviours have different needs and preferences to those with low externalising problems, in order to design effective and engaging interventions for this population [34]. Aligning parent preferences with the content and delivery of interventions for specific presenting problems (such as externalising problems) may improve engagement and outcomes [36]. However, most of the research on parent preferences to date has been conducted with mothers [37].

It is also important to examine predictors of participation in parenting interventions to help identify the factors associated with participation of fathers. Only one study to date examined variables associated with help-seeking, which was conceptualised as both participation in a parenting program and consulting a professional about their child’s behaviour [33]. This study found that social advantage (e.g., higher education level) was positively associated with fathers' participation in parenting programs, but negatively associated with consulting a professional about their child’s behaviour; severity of child behaviour difficulty was associated with both help-seeking outcomes. However, this study did not use a standardised measure of child behavioural difficulty. In addition, the conclusions in this paper (that fathers in low socioeconomic circumstances seek help for child behaviour, but not for parenting), are tempered by the small number of fathers endorsing help-seeking and the unclear analytical strategy. Further research is needed with a standardised measure of child outcomes to investigate predictors of help-seeking for fathers.

In summary, research on fathers’ needs and preferences regarding parenting interventions is limited. There is also little research on factors associated with father participation in parenting interventions. Finally, it is unknown whether father preferences differ depending on the levels of child externalising behaviour problems. Thus, there is currently little knowledge to draw from to inform the tailoring or development of father-friendly interventions, especially for families at greatest risk. Given the low rates of father engagement and the reduced efficacy for fathers relative to mothers when they do participate in parenting interventions, it is critical to conduct large-scale community surveys to inform the development of engaging and effective father-inclusive interventions, particularly for fathers of children with high levels of externalising problems. To address these issues, the current study provides data from an online survey of Australian fathers of children aged 2 to 16 years that examined their experiences with parenting interventions, perceived barriers to participation, the importance of a range of factors in their decision to attend, and preferred content and delivery methods. The study also examined whether fathers’ needs and preferences differed on the basis of whether or not their child had elevated levels of externalising behaviour problems. Finally, the study examined the predictors of participation in parenting interventions.

Methods

Participants and procedure

Participants were fathers/male caregivers aged over 18 who lived in Australia and had a child aged 2 to 16 years. Potential participants were recruited to participate in the survey from a research panel of 450,000 Australian people. The panel provider used online recruitment such as online messaging and email to make initial contact with potential participants. Prior to completing the screening questions to assess inclusion criteria (i.e., male caregiver, aged over 18 years, caregiver of a child aged 2–16 years, and Australian resident), potential participants were told that it was a survey about parenting that would take approximately 20 min to complete. Only after they had completed the screening questions and were deemed eligible were they given the participant information statement and consent form. If they did not meet the eligibility criteria, they were told that they did not meet the requirements but were not given the reason why they were ineligible. These steps minimised the risk of ineligible participants participating in the survey. Digital fingerprinting was used to ensure that the same respondent did not complete the survey more than once from the same device.

The online survey was available for completion during a two-week period in March 2016. The survey was anonymous and took on average 10 min to complete. Participants were required to read an online participant information sheet and provide consent prior to completing the survey. During the recruitment period, a total of 1478 respondents accessed the survey link. Of those, 189 (13.0%) were not eligible after completing the screening questions. The reasons for exclusion included: not having children (n = 75, 39.7%), aged under 18 years (n = 29; 15.3%), female (n = 13, 6.9%), not having the necessary browser requirements to complete the survey (n = 4, 2.1%), and not having children in the 2–16 years age range (n = 68; 36.0%). Of the 1289 eligible respondents, 208 (16.1%) did not answer any questions and 51 (3.9%) commenced the survey but dropped out prior to completion. Of the 1030 who completed the full survey, 29 were excluded for completing it too quickly (indicating a likely invalid response), giving a final sample size of 1001. Participants were provided a small reimbursement to compensate them for their time. This incentive was in the form of online points which could be redeemed for a gift card chosen from a website once a certain point threshold was reached. The survey was part of a project called Like Father Like Son, which seeks to enhance the engagement of fathers in parenting interventions in Australia.

Measures

The questions included in the survey were determined through a comprehensive review of existing literature on topics such as barriers to participation, aspects of parenting interventions seen as important, preferred delivery formats and content of interest to fathers. In addition, eight clinical psychologists with extensive experience in delivering parenting interventions helped to generate survey questions, which were then pilot tested with 69 fathers. Based on feedback from the pilot test, items were revised for wording clarity before being included in the final survey.

Father and child demographic characteristics

Data was collected on fathers’ age, marital and education status, whether English was the main language spoken at home, and number of children. Respondents with more than one child were asked to select a ‘target child’, about whom to answer further questions. The target child was a child within the 2–16 age range whose behaviour they were most concerned about. If they had no concerns about their child/ren’s behaviour, they were asked to select their youngest child within the 2–16 age range. Respondents were then asked the age and gender of their selected target child, how involved they were in this child’s life, and whether they lived with this child full-time, part-time or not at all.

Child externalising behaviour

To assess child externalising behaviour, participants completed the Strengths and Difficulties Questionnaire (SDQ) [38] about the target child. The SDQ is a 25 item questionnaire using a three response option format (not true, somewhat true, certainly true). The questionnaire yields a total difficulty score, and five subscales (each consisting of five items): hyperactivity, conduct problems, peer problems, emotional symptoms and prosocial behaviour. In order to compare fathers of children with high and low externalising behaviour, children were divided into two groups based on their scores on the conduct disorder and/or hyperactivity scales. Children with scores of 4 or above on the conduct disorder scale and/or 8 or above for the hyperactivity scale were considered to have externalising behaviours in the high/very high range (high EXT group), while those who scored in the normal range on both these scales were considered as having low levels of externalising behaviour (low EXT group) [39].

Previous participation in parenting intervention

Participants were asked whether they had previously participated in a parenting intervention or treatment for child behaviour problems. If they had previously participated, respondents were asked their perceptions of how helpful this intervention had been for their child’s behaviour and for their own parenting, on a five-point scale ranging from extremely helpful (5) to not at all helpful (1). They were also asked how relevant the program was for them as a father, on a five-point scale ranging from extremely relevant (5) to not at all relevant (1).

Perceived barriers

Respondents were asked about perceived barriers to their participation in parenting interventions or treatment for child behaviour problems. Fathers were asked why they had not participated in a parenting program before, or, if they had participated before, what would prevent them from participating again in the future. A series of 20 barriers were listed which fathers could endorse. These included practical barriers (e.g., cost of service, work commitments, long waiting lists); lack of knowledge or awareness about parenting programs (e.g., not knowing whether programs are effective); help-seeking attitudes or beliefs (e.g., not feeling like their child’s behaviour is a problem); and other factors (e.g., worry about being judged, cultural/religious factors). These barriers were considered individually, and an overall index of total barriers for each respondent was created by summing the number of barriers they endorsed.

Preferred supplementary content

Participants were provided with a list of topics and asked how interested they would be in receiving information about each topic (in addition to receiving information about core parenting strategies). Topics included: bully-proofing your child, co-parenting, problem-solving without aggression, quality time and play, social skills, and healthy body image. Participants rated their interest on a five-point scale from extremely interested (5) through to not at all interested (1).

Program factors important to the decision to participate

Participants rated the importance of different program factors in their decision to participate in a parenting program on a five-point scale from extremely important (5) to not at all important (1). These included practical factors (e.g., convenient location, convenient time); knowledge about the program (e.g., understanding what is involved, knowing that the program has been tested and is effective); practitioner characteristics (e.g., knowing that the facilitator is trained) and recruitment method (e.g., receiving a personal recommendation from another father).

Preferred delivery formats

Participants were also asked to rate how likely they were to participate in different program delivery formats on a five-point scale ranging from extremely likely (5) to not at all likely (1). Formats included internet-based, mobile application, weekly groups or individual sessions (both parents and father only), one-off session (both parents and father only) and telephone sessions.

Procedure

The Human Research Ethics Committee at the University of Sydney provided ethics approval for the study (2015/821). Participants read an online information statement and gave informed consent before commencing the survey. As the survey was online, participants did not provide written consent, but indicated their consent to participate by clicking a box acknowledging that they had read the information statement and they agreed to participate. Potential participants could not complete the survey without clicking this box. The questionnaire was anonymous and no identifying information was obtained.

Statistical analysis

Data were weighted using post-stratification sampling weights to adjust for potential sampling biases. Weights adjusted the data for under- and over-sampling based on father age and geographic region, against 2011 Australian Bureau of Statistics’ Census data on Male Parents of Children aged 2–16 years [40]. All data and analyses conducted and reported were adjusted for these sampling weights, with the exception of drop out analyses (i.e., weights were not available for the participants who dropped out of the survey).

Initially all variables were examined using descriptive statistics. To compare responses from fathers of children in the high EXT versus low EXT groups, a series of chi-square tests were used for dichotomous dependent variables; analysis of covariance (ANCOVAs) and multivariate analysis of covariance (MANCOVAs) were conducted for continuous dependent variables. As there were significant differences between high and low EXT groups on two socio-demographic characteristics (see participants section below), two covariates were included in analyses with continuous outcomes variables. Due to the challenges in controlling for covariates in the chi-square tests, significant results were followed up by stepwise logistic regressions using forward entry (covariates on the first step, EXT group on the second step) to determine whether the significant effect of EXT group across outcomes remained after controlling for covariates.

To investigate predictors of father attendance in parenting programs or treatment for child behavioural problems, a logistic regression analysis was conducted with seven independent variables simultaneously entered into the model: father education, father age, father relationship status, number of children, child age, child gender and level of child externalising behaviour.

Results

Participants

To compare fathers who dropped out of the survey (n = 51) with those who remained (n = 1001), t-tests and chi-square tests were performed across socio-demographic variables. Significant differences emerged for two variables: fathers’ age and number of children. Fathers who dropped out of the survey were significantly older (M = 46.3, SD = 11.0 years) than completers (M = 42.3, SD = 9.6 years), t (1051) = −2.9, p < .01, and had significantly more children (M = 2.5, SD = 1.5 vs. M = 2.1, SD = 1.1), t (1045) = −2.1, p < .05.

The socio-demographic characteristics for the entire sample are displayed in Table 1. Fathers in the final sample were on average 42 years of age (range = 18–80 years), and the majority were married/defacto. Just over half of respondents had completed a university degree, just over one-third had completed secondary school or equivalent, and less than one in ten had completed grade 10 or less. Respondents had on average 2 children (range = 1–11). The target child was male in just under two-thirds of families, and aged 8 years on average. The majority of fathers indicated the target child lived with them full-time and most fathers described themselves as extremely or very involved in child rearing. The majority of fathers also indicated that English was the main language spoken at home.

Table 1 Sample Characteristics for fathers in the High and Low Externalising Groups

Overall, 296 (29.6%) fathers had children who scored in the high EXT group and the remaining 705 (70.4%) had children who scored in the low EXT group. Socio-demographic characteristics for the high and low EXT groups are displayed in Table 1, along with the t-tests and chi-square analyses for comparison between the two groups. Fathers of children in the high EXT group were significantly younger when compared to fathers of children in the low EXT group. In addition, a significantly higher proportion of the children in the high EXT group were boys compared to the low EXT group. These two variables (father age and child gender) were included as covariates in subsequent analyses comparing the high and low externalising groups.

Previous participation in parenting interventions

Of the total sample, 153 (15.3%) fathers indicated they had previously participated in a parenting program or treatment for child behaviour problems. Those who had participated rated the intervention an average of 3.66 (SD = 1.00) out of 5 for helpfulness for child behaviour and 3.62 (SD = 1.00) for helpfulness for parenting. They also rated the intervention an average of 3.71 (SD = 0.93) for relevance to them as a father.

Participation rates differed according to the level of child externalising problems. Of the fathers who had participated in a parenting intervention, significantly more had children in the high externalising group (n = 88, 57.5%) than in the low externalising group (n = 65, 42.5%), χ2(1, N = 1001) = 67.73, p < .001. Thirty percent (88/296) of fathers with a child in the high EXT group indicated that they had participated in a parenting program or treatment for child conduct problems. Univariate ANCOVAs showed that there were no significant differences between the high and low EXT groups in terms of perceived helpfulness of the program for child behaviour [F (1, 161) = 0.13, p = 0.72] or parenting [F (1, 161) = 0.34, p = 0.56], or relevance of the program to them as fathers [F (1, 167) = 0.54, p = 0.47], after controlling for covariates.

Perceived barriers to participation

Table 2 displays the number and proportion of fathers endorsing a range of barriers to participation in parenting programs and comparison of the high and low EXT group for each barrier. The most endorsed barriers for the entire sample (after ‘I don’t feel like my child’s behaviour is a problem’ and ‘I don’t feel like I need help with my parenting’) were: cost of service (20%), work commitments (20%), not knowing whether the program is effective (17%), not knowing what the program is about (16%), and not being aware of parenting programs (16%).

Table 2 Proportion of Fathers Experiencing Barriers to Treatment by Level of Child Externalising Disorders

Fathers in the high EXT group were significantly more likely than those in the low EXT group to endorse several factors as barriers to participation. These included practical barriers such as cost of the service, long waiting lists, problems with transport and lack of child care (see Table 2). Fathers in the high EXT group were also significantly more likely to endorse the belief that child behaviour problems require treatment of the child rather than the parent, and that programs are not suitable for fathers, compared to fathers in the low EXT group. In addition, worry about being judged, cultural/religious factors, and their partner attending without encouraging their participation were more frequently reported as barriers to participation for high EXT fathers compared to low EXT fathers. On the other hand, low EXT fathers were more likely to endorse that they did not feel like their child’s behaviour was a problem and that they did not feel like they needed help with parenting. Follow-up analyses on these significant chi-square tests demonstrated that the differences between high and low EXT groups remained significant after controlling for the covariates.

When examining the total number of barriers endorsed overall, there was a significant difference between high and low EXT fathers, after controlling for covariates. High EXT fathers endorsed a significantly greater number of barriers overall (M = 3.01, SD = 2.30) compared to low EXT fathers (M = 2.48, SD = 2.30), F (1, 1090) = 11.76, p < .001.

Preferred supplementary content

Table 3 displays fathers’ ratings of interest in receiving information across six topics for the entire sample, and separately for the high and low EXT groups. For the entire sample, the topics with the highest ratings were ‘bully-proofing your child’, ‘teaching your child social skills’, and ‘encouraging child development through quality time and play’. The MANCOVA for comparison between high and low EXT groups found significant differences in ratings of preferred topics, F (6, 1081) = 5.67, p < .001, after controlling for covariates. Follow-up univariate ANCOVAs were conducted to examine the significant effects for each topic (see Table 3). The high EXT group was significantly more interested than the low EXT group in receiving information on co-parenting, helping their child solve problems without aggression, and teaching their child social skills.

Table 3 Perceived Interest in Different Topics by Level of Child Externalising Disorders

Program factors important to the decision to participate

Table 4 displays the ratings of perceived importance of a range of program factors and results for comparisons between the high and low EXT groups. Overall, most factors received relatively high mean ratings of importance (at least 3.5/5). The exceptions were male facilitator, receiving a personal recommendation from another father and receiving a personal invitation from the facilitator, which received lower ratings. The highest ratings were for understanding what is involved in the program and for knowing the facilitator is trained.

Table 4 Perceived Importance of Factors in Determining Participation in Treatment by Level of Child Externalising Disorders

The MANCOVA for comparison between high and low EXT groups found significant differences in ratings of perceived importance across all factors listed, F (11, 1076) = 5.04, p < .001, after controlling for covariates. Univariate ANCOVAs showed high EXT fathers rated having a male facilitator as significantly more important to their decision to participate compared to low EXT fathers (see Table 4). However, for both groups, this factor ranked as least important overall (in terms of average importance ratings). High EXT fathers also rated having a personal invitation from the facilitator as significantly more important to their decision to participate compared to low EXT fathers, but even so, this received a relatively low average importance score.

Preferred delivery formats

Table 5 displays fathers’ ratings of perceived likelihood of participating in different formats of parenting programs for the entire sample and comparisons between the high EXT and low EXT groups. For the overall sample, an internet-based parenting program was rated highest followed by a brief one-off seminar. The MANCOVA for comparison between high and low EXT groups found significant differences in ratings of perceived likelihood of participation across all formats listed, F (9, 1078) = 12.61, p < .001, after controlling for covariates. Univariate ANCOVAs showed that across all program formats, high EXT fathers gave significantly higher ratings of likelihood of participation compared to low EXT fathers (see Table 5).

Table 5 Perceived Likelihood of Participating in Treatment by Level of Child Externalising Disorders

Predictors of participation in parenting programs

A logistic regression was conducted to examine factors predicting participation in parenting intervention for the overall sample (see Table 6). The model for the overall sample was significant χ2 (7, N = 1001) = 84.25, p < .001, but only two significant predictors were found. These predictors were severity of child externalising behaviour and age of child, although the latter was only marginally significant. For each additional year of child’s age, fathers were 1.05 times more likely to participate in parenting programs. For every additional point a child was rated on the SDQ externalising scale, fathers were 1.25 times more likely to participate in a parenting program.

Table 6 Logistic regression model predicting attendance at parenting program or treatment for child conduct problems for the entire sample

Discussion

This paper examined fathers’ experiences with parenting interventions, perceived barriers to participation, and preferred intervention content and delivery methods. It also explored whether preferences differed for fathers of children with high versus low levels of externalising problems, and examined predictors of participation in parenting interventions. Overall, 15% of fathers in the current study reported lifetime participation in a parenting program, which is in keeping with previous research that found 16% of Australian fathers had either participated in a parenting intervention in the previous year or consulted a professional about their child’s behaviour in the past 6 months [33], although higher than the 3% lifetime participation rate reported in a survey with New Zealand fathers [34]. In the current study, those who had participated in a parenting intervention or treatment for child behaviour rated the intervention relatively highly in terms of helpfulness for parenting and child behaviour, and relevance to them as fathers. This suggests that programs available in the community are generally perceived as both relevant and helpful to fathers who participate in them.

Rates of participation in parenting programs or treatment for child behaviour were higher among fathers of children with high than low levels of externalising problems, which is consistent with previous research that found that parents (predominantly mothers) are more likely to participate in parenting programs if they report higher levels of child behavioural problems [41,42,43]. However, it is important to highlight that it is not possible to determine what impact participation in parenting programs had on levels of externalising problems, given that fathers were asked to report on current levels of child behaviour and retrospective program participation. We also did not ask fathers about the timing of previous program participation. Given that just under two-thirds of fathers who reported prior program participation had a child with clinical levels of externalising problems, it is possible that the program was of limited effectiveness for child behaviour, or alternatively that children’s behaviour improved to some extent, but remained at clinical levels. It is also possible that program participation took place a number of years prior, with the impact on levels of child behaviour diminishing over time. Finally, we did not ask whether the program or treatment received was specifically in relation to the target child for whom the father answered the SDQ, so it is possible that treatment was for another child in the family. While future research should include questions about timing of, and target for, program participation, it does appear that a significant proportion of fathers who reported previous participation in parenting interventions or treatment for child behaviour problems may require further assistance for their child’s behaviour.

Overall just under one in three fathers in the present study rated their child as having conduct problems or ADHD symptoms at levels that were classified as being high or very high. These rates are higher than those reported in a recent Australian prevalence survey [44] where 10.5% of children aged 4–10 years met the criteria for conduct disorder (8.8% for 11–17 years) and 13.0% of children aged 4–10 years met the criteria for hyperactivity (13.8% for 11–17 years). This result may indicate that fathers of children with high levels of externalising behaviour problems were more likely to participate in the survey. Just less than one in three fathers who had a child with high externalising behaviour reported participation in a parenting program or treatment for child behaviour, which is very similar to father participation rates reported in previous research [33], and suggests that many fathers who may be in need of assistance are not receiving help. This finding highlights the need for services and interventions to implement strategies to enhance the engagement of fathers, especially for those fathers who have concerns about their child’s behaviour.

The only significant predictor of participation in parenting programs or treatment for child behaviour problems (aside from child’s age) was severity of child’s externalising behaviour problems, which confirms previous research with fathers [33], and parents generally [45]. Contrary to previous research, however, socio-demographic variables such as education levels did not predict attendance at parenting programs [33, 45]. This is an encouraging finding as it suggests that fathers from a range of socio-demographic backgrounds are seeking help for parenting and child behaviour problems, at least for the current sample of fathers. It is not surprising that the older the child’s age the more likely the father was to have participated in a parenting program, as increased child age would have presented more opportunities to participate over time. It should be noted that in previous research on factors associated with fathers’ help-seeking, participation in a parenting program and seeking professional help for child behaviour were examined separately, and a different pattern of findings emerged for each outcome variable [33]. That is, higher participation in parenting programs was associated with high social advantage and consulting a professional about child behaviour was associated with lower social advantage. However, in the present study we included a help-seeking variable that examined both participation in parenting program and/or treatment for child behaviour problems, given that we expected that most interventions for child behaviour problems would likely involve some parenting strategies. Clearly, further research is needed to examine predictors of parenting program participation for fathers, and to explore whether predictors differ based on the type of program or intervention received.

Internet-based parenting programs and brief parenting programs were the most preferred delivery formats, both for the overall sample and for the high and low externalising groups, which is consistent with previous research with samples of fathers [34] and (predominantly) mothers [46]. It is not surprising that these less intensive interventions are preferred over weekly individual or group programs, as they make fewer demands on families and may also help address barriers such as child care and transportation difficulties. As there is increasing research to demonstrate the effectiveness of internet-based parenting programs [47] and brief parenting programs [48], these program formats should be made widely available in the community. The findings also point to topics of interest to fathers such as bully-proofing your child, teaching social skills to your child and encouraging child development through quality time and play. While these topics differed to those included in previous surveys [34], they highlight potential content that could be added to parenting interventions to make them more appealing for fathers.

This study provides important information about fathers’ perceived barriers to participation. Cost of the service emerged as one of the most frequently rated barriers, which is surprising given many community-level parenting programs are offered free of charge, and may relate to costs in consulting private practitioners such as psychiatrists, psychologists and paediatricians. Other key barriers identified by fathers included work commitments and not knowing whether the program is effective, which were also found to be key barriers in previous research [34], and suggest that program flexibility and informing fathers about the program’s evidence base may be especially important when engaging fathers. Almost one in six fathers indicated that they were not aware of parenting programs at all, or did not know where to go to participate, which points to the need for media campaigns to increase community awareness about the availability and purpose of parenting programs.

Fathers of children in the high externalising group endorsed significantly more barriers overall, across practical barriers, help-seeking attitudes and other factors, compared to the low externalising group. As fathers of children in the high externalising group had higher levels of participation in parenting programs than the low externalising group, it is likely that they had greater awareness of barriers to participation such as long waiting lists, transport difficulties and lack of available childcare. There were also a range of other barriers that were more frequently endorsed by fathers of children in the high externalising group than the low externalising group, including factors related to stigma (worry about being judged), maternal gatekeeping (my partner attended without me and did not encourage my participation), and help-seeking attitudes (problems with my child’s behaviour require treatment of the child, I don’t think programs are suitable for fathers). Stigma has been found to be predictive of lower levels of help-seeking in parents of children with behavioural problems [49] which indicates the importance of normalising attendance at parenting programs, both in promotional materials and by practitioners who are working with families. It is also important for promotional materials to provide information in order to address misconceptions that child behavioural problems require treatment of the child only rather than the parents, and that programs are not suitable for fathers. Given that fathers in the high externalising group were more likely to endorse the barrier that their partner attended without them and did not encourage their participation, it is important for practitioners to emphasise to mothers the importance of engaging fathers, and to develop skills to engage fathers directly as well as through mothers. Together, these findings suggest that it is important for practitioners to be aware that fathers who seek assistance for their child’s externalising problems may experience numerous barriers to help-seeking, and practitioners should be sensitive to fathers’ experiences of these barriers and use collaborative problem-solving when working to address these barriers.

In terms of factors important to their decision to participate in parenting programs, fathers gave highest ratings to: understanding what is involved in the program, knowing the facilitator is trained, knowing the program has been tested in research and is effective, as well as holding the program at a convenient location and convenient time. These findings, which were similar to those of a New Zealand survey [34], suggest that information about what the program involves, training of facilitator and the evidence base for the program should be included in promotional materials, and every effort should be made to hold programs at convenient times and locations for fathers. Preference for a male facilitator received the lowest importance rating of all factors listed. This finding was again consistent with previous research [34], which found male practitioner gender to be the second least important of several factors. While many researchers have recommended increasing the number of male practitioners in order to increase father participation [50], findings from the present study suggest that other factors (such as the training of the facilitator and fathers’ feeling that the facilitator understands them) may be more important to fathers than practitioner gender. However, male practitioner was rated as more important to fathers of children with high than low externalising behaviour, although it was the factor that received the lowest importance rating for the high externalising group. Similarly, fathers of children in the high externalising group were more likely to rate receiving a personal invitation from the facilitator as important, however once again, this factor had one of the lowest average importance ratings across those listed.

The current study has a number of strengths, including a large sample size of community fathers, weighted to ensure representativeness of the sample on father age and geographic region, and the use of a standardised measure of child externalising problems. However, the findings of this study should be interpreted with caution given four key limitations to the study. First, as participants were members of an online panel, they may not have been representative of fathers in the community on factors other than age and location, and this may have introduced bias that resulted in specific findings, such as high preferences for internet-based parenting interventions. The sample also included a preponderance of university-educated fathers from two-parent families, highlighting the possibility that the sample may not be representative of fathers on education and relationship status, and possibly limiting our ability to generalise these findings to high-risk fathers who are most in need of parenting interventions. Second, while steps were taken to ensure only eligible participants took part in the survey (i.e., by not revealing the purpose of the survey prior to completion of screening questions) and that each respondent only completed the survey once (i.e., by using digital fingerprinting), there is no way to confirm that these strategies were successful. Third, it is important to keep in mind that stated preferences of fathers may not necessarily correspond to choices participants make when actually seeking help, as noted by other researchers [46]. Indeed, given that only 15% of fathers had participated in a parenting program and just under one-third said that they did not need help with their parenting, it is likely that many of their responses about barriers and preferences were based on conjecture rather than their actual experiences. Finally, because we did not include a sample of mothers in this study, we cannot contrast whether fathers’ needs and preferences are similar or different to those of mothers. Future research with fathers should aim to include fathers from a range of socio-economic backgrounds, and also aim to compare mothers’ and fathers’ needs and perceptions in relation to parenting interventions.

While further research is needed to replicate and extend these findings with other samples of fathers, this survey is an important first step to understanding fathers’ perceptions of barriers to participation in parenting interventions, their preferences for content and delivery formats. As such, there are several implications of the findings of this study for the promotion and tailoring of current evidence-based parenting programs to enhance father engagement. First, services should provide programs for free or at low cost, hold them at times and locations convenient to fathers and provide a well-trained facilitator. Research has suggested that only around 40% of practitioners report that their service frequently provides sessions outside working hours [51], and this may be critical to increasing father involvement. Second, promotional materials for a program should include the key points which fathers have indicated are important to their decision to attend, such as describing what is involved in the program, that the program has been tested in research and found to be effective, and the level of training of the facilitator. Third, since around one in six fathers indicated that they did not know about parenting programs, more public health messaging is needed about availability and aims of programs in the community and the importance of father participation. Finally, internet-based or brief parenting interventions need to be widely available, as fathers rated these delivery formats highest in terms of their likelihood of participation. Despite these promising findings, it is important to keep in mind that there is a lack of research on whether tailoring programs to meet the needs of fathers (by modifying content or format) results in significantly higher levels of father involvement and/or more effective programs [52]. In addition, caution is needed in adapting interventions to meet the needs and preferences of fathers, as modification to program content could impact on program fidelity and compromise program effectiveness [52].

Conclusions

This study provides important information about fathers’ needs and preferences in relation to content and delivery of evidence-based parenting interventions. The findings highlight a number of practical, easy-to-implement strategies that can be used to better promote parenting programs and to tailor the delivery of parenting programs to fathers. Only a small number of fathers had participated in a parenting intervention or treatment for child behaviour, and the majority of fathers of children with high levels of externalising behaviour had not received assistance, indicating the need for services and interventions to directly target fathers, especially those with concerns about child behaviour. While this study provides an important first step in addressing the paucity of research on fathers, much more research on the needs and preferences of fathers is needed in order to increase rates of father participation and to maximise the efficacy of parenting interventions in preventing childhood social and health problems, thereby enhancing child outcomes at a population level.

Abbreviations

ADHD:

Attention deficit hyperactivity disorder

EXT:

Externalising behaviour

SDQ:

Strengths and difficulties questionnaire

References

  1. Campbell F, Conti G, Heckman JJ, Moon SH, Pinto R, Pungello E, et al. Early childhood investments substantially boost adult health. Science. 2015;343:1478–85.

  2. Kim-Cohen J, Caspi A, Moffitt TE, Harrington H, Milne BJ, Poulton R. Prior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort. Arch Gen Psychiatry. 2003;60:709–17.

    Article  PubMed  Google Scholar 

  3. Copeland WE, Shanahan L, Costello EJ, Angold A. Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Arch Gen Psychiatry. 2009;66:764–72.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Nores M, Barnett WS. Benefits of early childhood interventions across the world:(under) investing in the very young. Econ Educ Rev. 2010;29:271–82.

    Article  Google Scholar 

  5. Panter-Brick C, Burgess A, Eggerman M, McAllister F, Pruett K, Leckman JF. Practitioner review: engaging fathers-recommendations for a game change in parenting interventions based on a systematic review of the global evidence. J Child Psychol Psychiatry. 2014;55:1187–212.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Gordon DM, Oliveros A, Hawes SW, Iwamoto DK, Rayford BS. Engaging fathers in child protection services: a review of factors and strategies across ecological systems. Child Youth Serv Rev. 2012;34:1399–417.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Maxwell N, Scourfield J, Featherstone B, Holland S, Tolman R. Engaging fathers in child welfare services: a narrative review of recent research evidence. Child Fam Soc Work. 2012;17:160–9.

    Article  Google Scholar 

  8. Zanoni L, Warburton W, Bussey K, McMaugh A. Fathers as 'core business' in child welfare practice and research: an interdisciplinary review. Child Youth Serv Rev. 2012;35:1055–70.

    Article  Google Scholar 

  9. Phares V, Lopez E, Fields S, Kamboukos D, Duhig AM. Are fathers involved in pediatric psychology research and treatment? J Pediatr Psychol. 2005;30:631–43.

    Article  PubMed  Google Scholar 

  10. Davison KK, Charles JN, Khandpur N, Nelson TJ. Fathers’ perceived reasons for their underrepresentation in child health research and strategies to increase their involvement. Matern Child Health J. 2017;21:1–8.

    Article  Google Scholar 

  11. Flippin M, Crais ER. The need for more effective father involvement in early autism intervention a systematic review and recommendations. J Early Intervention. 2011;33:24–50.

    Article  Google Scholar 

  12. Tiano JD, McNeil CB. The inclusion of fathers in behavioral parent training: a critical evaluation. Child Fam Behav Ther. 2005;27:1–28.

    Article  Google Scholar 

  13. Fabiano GA. Father participation in behavioral parent training for ADHD: review and recommendations for increasing inclusion and engagement. J Fam Psychol. 2007;21:683–93.

    Article  PubMed  Google Scholar 

  14. Bögels S, Phares V. Fathers' role in the etiology, prevention and treatment of child anxiety: a review and new model. Clin Psychol Rev. 2008;28:539–58.

    Article  PubMed  Google Scholar 

  15. Lundahl BW, Tollefson D, Risser H, Lovejoy MC. A meta-analysis of father involvement in parent training. Res Social Work Prac. 2008;18:97–106.

    Article  Google Scholar 

  16. Comer JS, Chow C, Chan PT, Cooper-Vince C, Wilson LA. Psychosocial treatment efficacy for disruptive behavior problems in very young children: a meta-analytic examination. J Am Acad Child Adolesc Psychiatry. 2013;52:26–36.

    Article  PubMed  Google Scholar 

  17. Sandler I, Schoenfelder E, Wolchik S, MacKinnon D. Long-term impact of prevention programs to promote effective parenting: lasting effects but uncertain processes. Annu Rev Psychol. 2011;62:299–329.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Fletcher R, Freeman E, Matthey S. The impact of behavioural parent training on fathers' parenting: a meta-analysis of the triple P-positive parenting program. Fathering: J Theory Res Pract About Men Fathers. 2011;9:291–312.

    Article  Google Scholar 

  19. Tiano JD, McNeil M. The inclusion of fathers in behavioral parent training: a critical evaluation. Child Fam Behav Ther. 2008;27:1–28.

    Article  Google Scholar 

  20. Budd KS, O'Brien TP. Father involvement in behavioral parent training: an area in need of research. Behav Ther. 1082;5:85–9.

    Google Scholar 

  21. Lindsay G, Strand S, Cullen MA, Band S, Davis H, Conlon G, et al. Parenting early intervention program evaluation. In: Education Df. London, editor. Research report DFE-RR121 (a); 2011.

  22. Bagner DM, Eyberg SM. Father involvement in parent training: when does it matter? J Clin Child Adolesc Psychol. 2003;32:599–605.

    Article  PubMed  Google Scholar 

  23. Webster-Stratton C. The effects of father involvement in parent training for conduct problem children. J Child Psychol Psychiatry. 1985;26:801–10.

    Article  CAS  PubMed  Google Scholar 

  24. Rhoades KA. Children’s responses to interparental conflict: a meta-analysis of their associations with child adjustment. Child Dev. 2008;79:1942–56.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Sanders MR, Kirby JN, Tellegen CL, Day JJ. The triple P-positive parenting program: a systematic review and meta-analysis of a multi-level system of parenting support. Clin Psychol Rev. 2014;34:337–57.

    Article  PubMed  Google Scholar 

  26. Helfenbaum-Kun ED, Ortiz C. Parent-training groups for fathers of head start children: a pilot study of their feasibility and impact on child behavior and intra-familial relationships. Child Fam Behav Ther. 2007;29:47–64.

    Article  Google Scholar 

  27. Bayley J, Wallace LM, Choudhry K. Fathers and parenting programmes: barriers and best practice. Community Pract. 2009;82:28–31.

    PubMed  Google Scholar 

  28. Dolan A. I've learnt what a dad should Do': the interaction of masculine and fathering identities among men who attended a 'Dads Only' parenting programme. Sociology. 2014;48:812–28.

    Article  Google Scholar 

  29. Salinas A, Smith JC, Armstrong K. Engaging fathers in Behavioral parent training: listening to Fathers' voices. J Pediatr Nurs. 2011;26:304–11.

    Article  PubMed  Google Scholar 

  30. Duhig AM, Phares V, Birkeland RW. Involvement of fathers in therapy: a survey of clinicians. Prof Psychol Res Prac. 2002;33:389–95.

    Article  Google Scholar 

  31. Glynn L, Dale M. Engaging dads: enhancing support for fathers through parenting programmes. Aotearoa New Zealand Social Work. 2015;27:59–72.

    Article  Google Scholar 

  32. Lazar A, Sagi A, Fraser MW. Involving fathers in social services. Child Youth Serv Rev. 1991;13:287–300.

    Article  Google Scholar 

  33. Sanders MR, Dittman CK, Keown LJ, Farruggia SP, Rose D. What are the parenting experiences of fathers? The use of household survey data to inform decisions about the delivery of evidence-based parenting interventions to fathers. Child Psychiatry Hum Dev. 2010;41:562–81.

    Article  PubMed  Google Scholar 

  34. Frank TJ, Keown LJ, Dittman CK, Sanders MR. Using father preference data to increase father engagement in evidence-based parenting programs. J Child Fam Stud. 2015;24:937–47.

    Article  Google Scholar 

  35. Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015;56:345–65.

    Article  PubMed  Google Scholar 

  36. Mian ND, Godoy L, Eisenhower AS, Heberle AE, Carter AS. Prevention services for externalizing and anxiety symptoms in low-income children: the role of parent preferences in early childhood. Prev Sci. 2016;17:83–92.

    Article  PubMed  Google Scholar 

  37. Fabiano GA, Schatz NK, Jerome S. Parental preferences for early intervention programming examined using best–worst scaling methodology. Child Youth Care For. 2016;45:655–73.

    Article  Google Scholar 

  38. Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–6.

    Article  CAS  PubMed  Google Scholar 

  39. Goodman R. Scoring the Strengths & Difficulties Questionnaire. 2015. Retrieved from http://www.sdqinfo.com. Accessed 30 Mar 2016.

  40. Australian Bureau of Statistics. Census of population and housing, customised data report: male partners in couples and male lone parents in families containing at least one child aged 2–16 years. Canberra: Australian Bureau of Statistics; 2011.

  41. Dumas JE, Nissley-Tsiopinis J, Moreland AD. From intent to enrollment, attendance, and participation in preventive parenting groups. J Child Fam Stud. 2007;16:1–26.

    Article  Google Scholar 

  42. Heinrichs N, Bertram H, Kuschel A, Hahlweg K. Parent recruitment and retention in a universal prevention program for child behavior and emotional problems: barriers to research and program participation. Prev Sci. 2005;6:275–86.

    Article  PubMed  Google Scholar 

  43. Winslow EB, Bonds D, Wolchik S, Sandler I, Braver S. Predictors of enrollment and retention in a preventive parenting intervention for divorced families. J Prim Prev. 2009;30:151–72.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Lawrence D, Johnson S, Hafekost J, Boterhoven De Haan K, Sawyer M, Ainley J, et al. The mental health of children and adolescents. In: Report on the second Australian child and adolescent survey of mental health and wellbeing. Canberra: Department of Health; 2015.

  45. Reyno SM, McGrath PJ. Predictors of parent training efficacy for child externalizing behavior problems – a meta-analytic review. J Child Psychol Psychiatry. 2006;47:99–111.

    Article  PubMed  Google Scholar 

  46. Metzler CW, Sanders MR, Rusby JC, Crowley RN. Using consumer preference information to increase the reach and impact of media-based parenting interventions in a public health approach to parenting support. Behav Ther. 2012;43:257–70.

    Article  PubMed  Google Scholar 

  47. Nieuwboer CC, Fukkink RG, Hermanns JM. Online programs as tools to improve parenting: a meta-analytic review. Child Youth Serv Rev. 2013;35:1823–9.

    Article  Google Scholar 

  48. Tully LA, Hunt C. Brief parenting interventions for children at risk of externalizing behavior problems: a systematic review. J Child Fam Stud. 2015;25:705–19.

  49. Dempster R, Davis DW, Jones VF, Keating A, Wildman B. The role of stigma in parental help-seeking for perceived child behavior problems in urban, low-income African American parents. J Clin Psychol Med Settings. 2015;22:265–78.

    Article  PubMed  Google Scholar 

  50. Berlyn C, Wise S, Soriano G. Engaging fathers in child and family services: participation, perceptions and good practice. Fam Matters. 2008;80:37–42.

    Google Scholar 

  51. Tully LA, Collins DJ, Piotrowska PJ, Mairet K, Hawes DJ, Moul C, et al. Examining practitioners' competencies, organizational support and barriers in engaging fathers in parenting interventions. Child Psychiatry Hum Dev. In press

  52. Lechowicz ME, Tully LA, Collins DJ, Burn MT, Hawes D, Lenroot R, et al. Engaging fathers in parenting programs: best practice guidelines. Sydney: The University of Sydney; 2017.

Download references

Acknowledgements

We would like to express our gratitude to the fathers who participated in this study. We acknowledge the assistance of Hall & Partners Open Mind, Sydney, in coordinating the father survey.

Funding

This publication is an outcome of the Like Father Like Son project which is proudly funded by the Movember Foundation Australian Mental Health Initiative. The funding body had no role in the study design, interpretation, writing the manuscript, or the decision to submit the paper for publication.

Availability of data and materials

The data generated or analysed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

LAT, PJP and NB conducted analysis and interpretation of the data. LAT wrote the first and successive drafts of the manuscript. All authors contributed to conception and design of the study, and critically revised the manuscript for intellectual content. All authors have read and approved the final manuscript.

Competing interests

The authors declare they have no competing interests. The Movember Foundation, which funded this study, has no corporate funding that could pose a conflict of interest.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The Human Research Ethics Committee at the University of Sydney provided ethics approval for the study (2015/821). Participants read an online information statement and gave informed consent before commencing the survey. As the survey was online, participants did not provide written consent, but indicated their consent to participate by clicking a box acknowledging that they had read the information statement and they agreed to participate. A waiver of written consent was not granted by the Human Ethics Committee, as providing informed consent to participate online was considered equivalent to providing written consent.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lucy A. Tully.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tully, L.A., Piotrowska, P.J., Collins, D.A.J. et al. Optimising child outcomes from parenting interventions: fathers’ experiences, preferences and barriers to participation. BMC Public Health 17, 550 (2017). https://doi.org/10.1186/s12889-017-4426-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-017-4426-1

Keywords