Screening for psychosocial problems in 5–6-year olds: a randomised controlled trial of routine health assessments

https://doi.org/10.1016/j.pec.2004.11.013Get rights and content

Abstract

Objective

Children's psychosocial problems are often not identified accurately. The present study addresses the effect of training of Child Health Doctors (CHDs) in a structured method to identify psychosocial problems on the accuracy of this identification in children aged 5–6.

Method

The study was a randomised controlled trial (RCT) with a baseline and two follow-up measurements. A volunteer sample of 58 CHDs participated, randomly assigned to intervention or control condition. CHDs selected a population-based sample of 5–6-year-old children (n = 6375).

Results

The first follow-up showed that sensitivity had improved by 9% and specificity by 5% in the intervention condition, especially in children with severe problems (odds ratio = 3.7; 95% confidence interval: 1.2–11.8). The second follow-up showed a decrease in sensitivity and specificity in both conditions.

Conclusion

The training improves identification of psychosocial problems, especially severe ones, although the availability of time and resources also influences the accuracy with which psychosocial problems are identified.

Introduction

Psychosocial problems, i.e., behavioural and emotional problems, are highly prevalent among children. Various studies have reported that prevalence ranges between 13 and 27% [1], [2], [3], [4], [5], [6].

There is evidence that these problems may be reduced by secondary prevention programs and early treatment [7], [8], [9], [10], [11]. A review by Durlak et al. showed that both behavioural and cognitive–behavioural preventive interventions are effective treatments for children with psychosocial problems, for both internalizing and externalizing problems [7]. A review by Bryant et al. showed modest effects in parent-focused interventions, teacher-focused interventions, and child-focused interventions for preschoolers with aggressive and disruptive behaviour [8]. While early treatment is wholly dependent on the accurate identification of children with psychosocial problems, identification procedures are currently too inaccurate [3], [4], [5], [12], [13]. In a previous study, Dutch Child Health Professionals (CHPs; i.e., doctors and nurses working in Preventive Child Health Care) identified no psychosocial problems in 43% of children whose parents had reported serious problems during routine health assessments [4]. This means that a lot of children with psychosocial problems lack early treatment or adequate support from CHPs [4]. Clearly, there is room for CHPs to improve their screening performance. Although there are several screening instruments for identifying psychosocial problems, identification of psychosocial problems remains inaccurate [14], [15], [16], [17], [18]. One reason for this is that physicians use these tools infrequently when screening psychosocial problems in children [19]. Furthermore, most of these instruments are parent-completed questionnaires and although these questionnaires provide reliable information, they can support but not replace the interview with the physician, in which a number of sources (parent, child, observation) are used to identify problems. According to Wildman et al., one of the best predictors of identification of psychosocial problems is whether mothers disclose concerns about their child's psychosocial functioning to the physician [20]. Disclosure of these concerns can be enhanced if physicians master some communication skills, but also if physicians are able to systematically categorize signals from parents and child regarding psychosocial problems [21]. Training physicians in these skills might help them to improve the identification of psychosocial problems [21], [22].

While training might help them do so, there is no evidence on its effectiveness. Our study, therefore, set out to assess the effect of a structured method for systematically identifying psychosocial problems in children aged [5], [6]. The method was developed by the Preventive Child Health Care Service in Breda, a city in the southern Netherlands, in cooperation with the psychology department of the University of Utrecht. An earlier non-experimental study in the Breda region had indicated that training CHPs in this method improved the identification of behavioural and emotional problems in children by CHPs [23].

The aim of the present study is to address the effect of training of Child Health Doctors (CHDs) in this structured method, on the accuracy of identification of behavioural and emotional (furtheron: psychosocial) problems, overall and for moderate and severe problems. In The Netherlands, preventive child health care is an important low-threshold service for the early identification of psychosocial problems in children. Such care is provided on an unsolicited basis to all children living in The Netherlands, by CHPs working in the Preventive Child Health Care Services. As part of this system, more than 90% of all children undergo three to four assessments by a CHP during their school careers [4]. Because part of these assessments involves an interview on psychosocial problems, the Preventive Child Health Services are an ideal setting for the early identification of psychosocial problems and for improving this identification.

Section snippets

Method

The study was designed as a randomised controlled trial (RCT) with a baseline and two follow-up measurements. After a baseline measurement lasting three months, CHDs in the intervention condition received the initial training. Participants in the control condition initially received no additional training, but were trained three months later than participants in the intervention condition, between the first and second follow-up measurement. CHDs in the intervention condition received a

Sample and program attendance

Fig. 2 shows the participant flow and number of children in each measurement period. In all, 58 CHDs participated; on average, due to maternity-leave, change of job, illness, and other factors, they saw fewer children than planned. Table 1 shows the characteristics of participating CHDs. The high percentage of female CHDs is similar to all Dutch CHDs. No differences were found between CHDs in the intervention condition and control condition, except that CHDs in the control condition worked at

Discussion and conclusion

This is the first study to examine the effects of training Child Health Doctors (CHDs) to use a structured method for screening psychosocial problems in children aged 5 or 6. The results show that CHDs who took the training identified moderate and severe psychosocial problems more accurately than CHDs who did not. However, the accuracy of the detection of the entire range of problems, including the mild ones, did not improve with statistical significance in the trained group. A likely

Acknowledgements

This research received financial support from The Netherlands Organization for Health Research and Development (ZonMw) and the Foundation for Children's Welfare Stamps Netherlands.

References (37)

  • D. Bryant et al.

    A Review of interventions for preschoolers with aggressive and disruptive behavior

    Early Educ Dev

    (1999)
  • J. Elliot et al.

    Evaluation of a community intervention programme for preschool behaviour problems

    J Pediatr Child Health

    (2002)
  • M.R. Dadds et al.

    Practitioner review: psychological management of anxiety disorders in childhood

    J Child Psychol Psychiat

    (2001)
  • E.J. Costello et al.

    Psychopathology in pediatric primary care: the new hidden morbidity

    Pediatrics

    (1988)
  • J.V. Lavigne et al.

    Behavioral and emotional problems among preschool children in pediatric primary care: prevalence and pediatricians’ recognition

    Pediatrics

    (1993)
  • M.S. Jellinek et al.

    Use of the pediatric symptom checklist to screen for psychosocial problems in pediatric primary care: a national feasibility study

    Arch Pediatr Adolesc Med

    (1999)
  • S.A. Reijneveld et al.

    Early detection of psychosocial problems in adolescents: how useful is the Dutch short indicative questionnaire (KIVPA)

    Eur J Public Health

    (2003)
  • F.J. Wren et al.

    Pediatric mood and anxiety syndromes in primary care: who gets identified?

    Int J Psychiatry Med

    (2003)
  • Cited by (17)

    • Work experience and style explain variation among pediatricians in the detection of children with psychosocial problems

      2012, Academic Pediatrics
      Citation Excerpt :

      The acquisition of the underlying physician skills may be accelerated in several ways, for instance by on-the-job coaching for preventive pediatricians and by training preventive pediatricians in the use of guidelines. The latter has indeed been found to enhance the quality of problem identification,14 even though this effect extinguished rather rapidly. The latter shows that continuous efforts are needed to attain a lasting improvement in the identification of psychosocial problems, which should preferably be imbedded in the entire work process of the PCH.

    • Early detection of psychosocial problems in children aged 5 to 6 years by preventive child healthcare: Has it improved?

      2012, Journal of Pediatrics
      Citation Excerpt :

      At first sight, our findings contradict another previous study of the quality of diagnostic skills of CHPs.16 Wiefferink et al16 conducted an RCT on the effect of training CHPs to improve diagnostic competence and found an improvement on the first follow-up measurement, immediately after the training. At the second follow-up the quality of identification had fallen off again.

    • Early findings of preventive child healthcare professionals predict psychosocial problems in preadolescence: The TRAILS study

      2010, Journal of Pediatrics
      Citation Excerpt :

      PCH identifies children at risk for psychosocial problems to a certain degree, thus showing its added value, but effort is needed for further improvement. Previous research has shown that the use of validated questionnaires, training of PCH professionals in a structured method for identifying psychosocial problems, and providing more time for the assessment may improve the accuracy of this early identification.39,40 This study may add to the improvement of the quality of early identification in routine practice by indicating the predictors for behavioral problems that should be monitored.

    • Identification of children with psychosocial problems differed between preventive child health care professionals

      2008, Journal of Clinical Epidemiology
      Citation Excerpt :

      There are systematic differences between individual PCH professionals in the number of children they identify as having problems and these differences cannot be explained by problems—as indicated by a clinical TPS—among these children or other risk indicators. Clearly, PCH needs to improve the identification of problems among children they examine, especially as other studies have shown that such an improvement is possible [8,28–30]. The interindividual variability that we found shows that there are large opportunities to improve the identification of psychosocial problems among children.

    • Detection of child abuse by Dutch preventive child-healthcare doctors and nurses: Has it changed?

      2008, Child Abuse and Neglect
      Citation Excerpt :

      Risk groups for any suspected maltreatment comprised older children, boys, and children of low-educated fathers and of fathers whose educational level was unknown, and of mothers who were relatively young. Our data are based on professional assessments and as such they are subject to the biases present in any professional rating, in particular the differences in diagnostic skills and experience between them (Wiefferink et al., 2006). Detection of child maltreatment is notoriously difficult because the perpetrators try to hide their actions (Dubowitz & Bennett, 2007), thus undoubtedly increasing the interprofessional variability (Crume, DiGuiseppi, Byers, Sirotnak, & Garrett, 2002; Jenny & Isaac, 2006; May-Chahal & Cawson, 2005; Newton & Vandeven, 2005).

    View all citing articles on Scopus
    View full text