Top

Clinical Child and Family Psychology Review

Gepubliceerd in:

01-03-2013

Do Evidence-Based Interventions Work When Tested in the “Real World?” A Systematic Review and Meta-analysis of Parent Management Training for the Treatment of Child Disruptive Behavior

Auteurs: Daniel Michelson, Clare Davenport, Janine Dretzke, Jane Barlow, Crispin Day

Gepubliceerd in: Clinical Child and Family Psychology Review | Uitgave 1/2013

Abstract

Evidence-based interventions are often unavailable in everyday clinical settings. This may partly reflect practitioners’ assumptions that research evidence does not reflect “real-world” conditions. To examine this further, we systematically assessed the clinical effectiveness of parent management training (PMT) for the treatment of child disruptive behavior across different real-world practice contexts. We identified 28 relevant randomized controlled trials from a systematic search of electronic bibliographic databases and conducted a meta-analysis of child outcomes across trials. Planned subgroup analyses involved comparisons between studies grouped according to individual real-world practice criteria and total real-world practice criteria scores, reflecting the extent to which PMT was delivered by non-specialist therapists, to a clinic-referred population, in a routine setting, and as part of a routine service. Meta-analysis revealed a significant overall advantage for PMT compared with waitlist control conditions. Subgroup analyses did not demonstrate significant differences in effect size estimates according to the total number of real-world practice criteria met by studies. Moreover, no consistent relationships were found between specific practice criteria and effect size estimates. In conclusion, PMT appears to be an effective treatment for children with disruptive behavior problems. There was no clear evidence that conducting PMT in real-world practice contexts is a deterrent to achieving effective child behavior outcomes, although relative advantage to “usual care” was not directly examined and the power of the analysis was limited as a result of significant heterogeneity. More research is needed to investigate whether this finding is generalizable to other psychological interventions. Suggestions are also made for developing more differentiated criteria to assist with evaluating the specific applicability of research evidence to different care providers.

vorige artikel The Promotion of Self-Regulation Through Parenting Interventions

volgende artikel Revisiting Data Related to the Age of Onset and Developmental Course of Female Conduct Problems

Achenbach, T. (1991). Manual for the child behavior checklist/4-18 & 1991 profile. Burlington: University of Vermont.

Addis, M. E., Wade, W., & Hughes, C. (1999). Barriers to dissemination of evidence-based practices: addressing practitioners’ concerns about manual-based psychotherapies. Clinical Psychology: Science and Practice, 6, 430–441.CrossRef

American Academy of Child and Adolescent Psychiatry. (2007a). Practice parameter for the assessment and treatment of children and adolescents with oppositional defiant disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 126–141.CrossRef

American Academy of Child and Adolescent Psychiatry. (2007b). Practice parameter for the assessment and treatment of children and adolescents with anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 267–283.CrossRef

Axberg, U., & Broberg, A. G. (2012). Evaluation of “The Incredible Years” in Sweden: The transferability of an American parent-training program to Sweden. Scandinavian Journal of Psychology, 53, 224–232.PubMedCrossRef

Barkham, M., Stiles, W. B., Connell, J., Twigg, E., Leach, C., Lucock, M., et al. (2008). Effects of psychological therapies in randomized trials and practice-based studies. British Journal Clinical Psychology, 47, 397–415.CrossRef

Barkley, R. (1997). Defiant children. A clinician’s manual for assessment and PMT (2nd ed.). New York: The Guilford Press.

Behan, J., Fitzpatrick, C., Sharry, J., Carr, A., & Waldron, B. (2004). Evaluation of the parenting plus program. The Irish Journal of Psychology, 22, 238–256.

Bloomquist, M. L., & Schnell, S. V. (2002). Helping children with aggression and conduct problems. New York: The Guilford Press.

Bonell, C., Oakley, A., Hargreaves, J., Strange, V., & Rees, R. (2006). Assessment of generalisability in trials of health interventions: Suggested framework and systematic review. BMJ, 333, 346–349.PubMedCrossRef

Braet, C., Meerschaert, T., Merlevede, E., Bosmans, G., Van Leeuwen, K., & De Mey, W. (2009). Prevention of antisocial behaviour: Evaluation of an early intervention programme. European Journal of Developmental Psychology, 6, 223–240.CrossRef

Cahill, J., Barkham, M., & Stiles, W. B. (2010). Systematic review of practice-based research on psychological therapies in routine clinic settings. British Journal of Clinical Psychology, 49, 421–453.PubMedCrossRef

Chorpita, B. F. (2003). The frontier of evidence-based practice. In A. E. Kazdin & J. R. Weisz (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 42–59). New York: Guilford Press.

Connell, S., Sanders, M. R., & Markie-Dadds, C. (1997). Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behavior Modification, 21, 379–408.PubMedCrossRef

Connor-Smith, J. K., & Weisz, J. R. (2003). Applying treatment outcome research in clinical practice: Techniques for adapting interventions to the real world. Child and Adolescent Mental Health, 8, 3–10.CrossRef

Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, P. (2008). Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ, 337, 1655.CrossRef

Davis, H., Day, C., Cox, A., & Cutler, L. (2000). Child and adolescent mental health needs assessment and service implications in an inner city area. Clinical Child Psychology and Psychiatry, 5, 169–188.CrossRef

Dawe, S., Harnett, P. H., Rendalls, V., & Staiger, P. (2003). Improving family functioning and child outcome in methadone maintained families: The parents under pressure program. Drug and Alcohol Review, 22, 299–307.PubMedCrossRef

Day, C., Kowalenko, S., Ellis, M., Dawe, S., Harnett, P., & Scott, S. (2010). The helping families programme: A new parenting intervention for children with severe and persistent conduct problems. Child and Adolescent Mental Health, 16, 167–171.CrossRef

Day, C., Michelson, D., Thomson, S., Penney, C., & Draper, L. (2012). Evaluation of a peer led parenting intervention for disruptive behaviour problems in children: Community based randomised controlled trial. BMJ, 344, e1107.PubMedCrossRef

Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001). Statistical methods for examining heterogeneity and combining results from several studies in meta-analysis. In M. Egger, G. Davey Smith, & D. G. Altman (Eds.), Systematic reviews in health care: Meta-analysis in context (2nd ed., pp. 285–312). London: BMJ Books.CrossRef

Deeks, J. J., Higgins, J. P. T., & Altman, D. G. (2011). Analysing data and undertaking meta-analysis. In J. P. T. Higgins & S. Green (Eds.), The Cochrane handbook of systematic reviews of interventions, version 5.1.0. The Cochrane Collaboration.

DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177–188.PubMedCrossRef

Downs, S. H., & Black, N. (1998). The feasibility of creating a checklist for the assessment of the methodological quality both of randomized and non-randomized studies of health care interventions. Journal of Epidemiology Community Health, 52, 377–384.PubMedCrossRef

Dretzke, J., Davenport, C., Frew, E., Barlow, J., Stewart-Brown, S., Bayliss, S., Taylor, R., Sandercock, J., & Hyde, C. (2009). The clinical effectiveness of different parenting programs for children with conduct problems: A systematic review of randomized controlled trials. Child and Adolescent Psychiatry and Mental Health, 3(7).

Dretzke, J., Frew, E., Davenport, C., Barlow, J., Stewart-Brown, S., Sandercock, J., Bayliss, S., Raftery, J., Hyde, C., & Taylor R. (2005). The effectiveness and cost-effectiveness of PMT/education programs for the treatment of conduct disorder, including oppositional defiant disorder, in children. Health Technology Assessment, 9(50).

Dulcan, M. K. (2005). Practitioner perspectives on evidence-based practice. Child and Adolescent Psychiatric Clinics of North America, 14, 225–240.PubMedCrossRef

Eddy, J. M., Reid, J. B., & Fetrow, R. A. (2000). An elementary school-based prevention program targeting modifiable antecedent of youth delinquency and violence: Linking the interests of families and teachers (LIFT). Journal of Emotional and Behavioral Disorders, 8, 165–176.CrossRef

Enebrink, P., Högström, J., Forster, M., & Ghaderi, A. (2012). Internet-based parent management training: A randomized controlled study. Behaviour Research and Therapy, 50, 240–249.PubMedCrossRef

Eyberg, S. M. (1980). Eyberg child behavior inventory. Journal of Clinical Child Psychology, 9, 22–29.CrossRef

Feinfield, K. A., & Baker, B. L. (2004). Empirical support for a treatment program for families of young children with externalizing problems. Journal of Clinical Child and Adolescent Psychology, 33, 182–195.PubMedCrossRef

Forehand, R. L., Merchant, M. J., Parent, J., Long, N., Linnea, K., & Baer, J. (2011). An examination of a group curriculum for parents of young children with disruptive behavior. Behavior Modification, 35, 235–251.PubMedCrossRef

Gallart, S., & Matthey, S. (2005). The effectiveness of Group Triple P, and the impact of the four telephone contacts. Behaviour Change, 22, 71–80.CrossRef

Gardner, F., Burton, J., & Klimes, I. (2006). Randomized controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: Outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry, 47, 1123–1132.PubMedCrossRef

Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C. (2010). Methodological challenges of characterizing usual care psychotherapeutic practice. Administration and Policy in Mental Health and Mental Health Services, 37, 208–210.CrossRef

Gartlehner, G., Hansen, R. A., Nissman, D., Lohr, K. N., & Carey, T. S. (2006). A simple and valid tool distinguished efficacy from effectiveness studies. Journal of Clinical Epidemiology, 59, 1040–1048.PubMedCrossRef

Goodman, R. (1997a). Child and adolescent mental health services: Reasoned advice to commissioners and providers. In Maudsley Discussion Paper No. 4. London: South London and Maudsley NHS Foundation Trust.

Goodman, R. (1997b). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586.

Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Millbank Quarterly, 82, 581–629.CrossRef

Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients’ care. Lancet, 11, 1225–1230.CrossRef

Gross, D., Fogg, L., & Tucker, S. (1995). The efficacy of PMT for promoting positive parent-toddler relationships. Research in Nursing & Health, 18, 489–499.CrossRef

Hautmann, C., Eichelberger, I., Hanisch, C., Plück, J., Walter, D., & Döpfner, M. (2010). The severely impaired do profit most: Short-term and long-term predictors of therapeutic change for a parent management training under routine care conditions for children with externalizing problem behavior. European Child and Adolescent Psychiatry, 19, 419–430.PubMedCrossRef

Henggeler, S. W. (2004). Decreasing effect sizes for effectiveness studies—Implications for the transport of evidence-based treatments: Comment on Curtis, Ronan, and Borduin. Journal of Family Psychology, 18, 420–423.PubMedCrossRef

Hoagwood, K., Burns, B., Kiser, L., Ringeisen, H., & Schoenwald, S. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179–1189.PubMedCrossRef

Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38, 21–33.CrossRef

Hutchings, J., Gardner, F., Bywater, T., Daley, D., Whitaker, C., Jones, K., et al. (2007). Parenting intervention in sure start services for children at risk of developing conduct disorder: Pragmatic randomized controlled trial. BMJ, 334, 678–682.PubMedCrossRef

Joachim, S., Sanders, M. R., & Turner, K. M. T. (2010). Reducing preschoolers’ disruptive behavior in public with a brief parent discussion group. Child Psychiatry and Human Development, 41, 47–60.PubMedCrossRef

Kazdin, A. E. (2000). Developing a research agenda for child and adolescent psychotherapy. Archives of General Psychiatry, 57, 829–835.PubMedCrossRef

Kazdin, A. E. (2006). Treatment outcomes, common factors, and continued neglect of mechanisms of change. Clinical Psychology: Science and Practice, 12, 184–188.CrossRef

Kazdin, A. E., & Whitley, M. K. (2006a). Comorbidity, case complexity, and effects of evidence-based treatment for children referred for disruptive behavior. Journal of Consulting and Clinical Psychology, 74, 455–467.PubMedCrossRef

Kazdin, A. E., & Whitley, M. K. (2006b). Pretreatment social relations, therapeutic alliance, and improvements in parenting practices in parent management training. Journal of Consulting and Clinical Psychology, 74, 346–355.PubMedCrossRef

Kazdin, A. E., Whitley, M. K., & Marciano, P. L. (2006). Child-therapist and parent-therapist alliance and therapeutic change in the treatment of children referred for oppositional, aggressive, and antisocial behavior. Journal of Child Psychology and Psychiatry, 47, 436–445.PubMedCrossRef

Kennedy, E. (2009). Evaluating interventions in child mental health: The importance of care provider and contextual influences. Clinical Child Psychology and Psychiatry, 14, 163–165.PubMedCrossRef

Kling, A., Forster, M., Sundell, K., & Melin, L. (2010). A randomized controlled effectiveness trial of parent management training with varying degrees of therapist support. Behavior Therapy, 41, 530–542.PubMedCrossRef

Larsson, B., Fossum, S., Clifford, G., Drugli, M. B., Handegård, B. H., & Mørch, W. T. (2009). Treatment of oppositional defiant and conduct problems in young Norwegian children: Results of a randomized controlled trial. European Child and Adolescent Psychiatry, 18, 42–52.PubMedCrossRef

Lau, A. S., Fung, J., Ho, L., Liu, L., & Gudino, O. (2011). PMT with high-risk immigrant Chinese families: A pilot group randomized trial yielding practice-based evidence. Behavior Therapy, 42, 413–426.PubMedCrossRef

Leung, C., Sanders, M. R., Leung, S., Mak, R., & Lau, J. (2003). An outcome evaluation of the implementation of the Triple P-Positive Parenting Program in Hong Kong. Family Process, 42, 531–544.PubMedCrossRef

Loeber, R., & Farrington, D. P. (2000). Young children who commit crime: Epidemiology, developmental origins, risk factors, early interventions, and policy implications. Development and Psychopathology, 12, 737–762.PubMedCrossRef

Markie-Dadds, C., & Sanders, M. R. (2006). A controlled evaluation of an enhanced self-directed behavioral family intervention for parents of children with conduct problems in rural and remote areas. Behavior Change, 23, 55–72.CrossRef

McLeod, B. D. (2011). The relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31, 603–616.PubMedCrossRef

McLeod, B. D., & Weisz, J. R. (2004). Using dissertations to examine potential bias in child and adolescent clinical trials. Journal of Consulting and Clinical Psychology, 72, 235–251.PubMedCrossRef

Morawska, A., Haslam, D., Milne, D., & Sanders, M. R. (2011). Evaluation of a brief parenting discussion group for parents of young children. Journal of Developmental and Behavioral Pediatrics, 32, 136–145.PubMedCrossRef

NICE. (2005). Depression in children and young people: Identification and management in primary, community and secondary care. London: National Institute for Clinical Excellence.

NICE. (2006). Parent-training/education programs in the management of children with conduct disorders. London: National Institute for Clinical Excellence.

Nixon, R. D., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent-child interaction therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71, 251–260.PubMedCrossRef

Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317–329.CrossRef

Palinkas, L. A., Aarons, G. A., Chorpita, B. F., Hoagwood, K., Landsverk, J., & Weisz, J. R. (2009). Cultural exchange and the implementation of evidence-based practices: Two case studies. Research on Social Work Practice, 19, 602–612.CrossRef

Patterson, J., Barlow, J., Mockford, C., Klimes, I., Pyper, C., & Stewart-Brown, S. (2002). Improving mental health through parenting programs: Block randomized controlled trial. Archives of Disease in Childhood, 87, 472–477.PubMedCrossRef

Public Health Resource Unit. (2006). Critical appraisal skills program (casp): making sense of evidence. Oxford: Public Health Resource Unit.

Reyno, S. M., & McGrath, P. J. (2006). Predictors of PMT efficacy for child externalizing behavior problems: A meta-analytic review. Journal of Child Psychology and Psychiatry, 47, 99–111.PubMedCrossRef

Ross, G., & Brannigan, C. (2008). Are depressed adolescents routinely offered CBT? A brief review of current practice. Behavioral and Cognitive Psychotherapy, 36, 113–117.CrossRef

Sanders, M. R., Markie-Dadds, C., Tully, L., & Bor, W. (2000). The Triple P-Positive Parenting Program: A comparison of enhanced, standard, and self directed behavioural family intervention for parents of children with early conduct problems. Journal of Consulting and Clinical Psychology, 69, 624–640.CrossRef

Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1179–1189.PubMedCrossRef

Schuhmann, E. M., Foote, R. C., Eyberg, S. M., Boggs, S. R., & Algina, J. (1998). Efficacy of parent-child interaction therapy: Interim report of a randomized trial with short-term maintenance. Journal of Clinical Child Psychology, 27, 34–45.PubMedCrossRef

Schulz, K. F., Altman, D. G., Moher, D., & CONSORT Group. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, 332.CrossRef

Serketich, W. J., & Dumas, J. E. (1996). The effectiveness of behavioral PMT to modify antisocial behavior in children: A meta-analysis. Behavior Therapy, 27, 171–186.CrossRef

Smelt, A. F., van der Weele, G. M., Blom, J. W., Gussekloo, J., & Assendelft, W. J. (2010). How usual is usual care in pragmatic intervention studies in primary care? An overview of recent trials. British Journal of General Practice, 60, 305–318.CrossRef

Spielmans, G. I., Gatlin, E. T., & McFall, J. P. (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychother Research, 20, 234–246.CrossRef

Sterne, J. A. C., Sutton, A., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., et al. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 342, d4002.CrossRef

Straus, S. E., Richardson, W. S., Glasziou, P., & Haynes, R. B. (2010). Evidence-based medicine: How to practice and teach EBM (4th ed.). Edinburgh: Churchill Livingstone.

Taylor, T. K., Schmidt, F., Pepler, D., & Hodgins, C. (1998). A comparison of eclectic treatment with Webster-Stratton’s parents and children series in a children’s mental health center: A randomized controlled trial. Behavior Therapy, 29, 221–240.CrossRef

Turner, K. M., & Sanders, M. R. (2006). Help when it’s needed first: A controlled evaluation of brief, preventive behavioral family intervention in a primary care setting. Behavior Therapy, 37, 131–142.

Webster-Stratton, C. (1990). Enhancing the effectiveness of self-administered videotape PMT for families with conduct-problem children. Journal of Abnormal Child Psychology, 18, 479–492.PubMedCrossRef

Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: A comparison of child and PMT interventions. Journal of Consulting and Clinical Psychology, 65, 93–109.PubMedCrossRef

Weersing, V. R., & Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70, 299–310.PubMedCrossRef

Weersing, V. R., Weisz, J. R., & Donenberg, G. R. (2002). Development of the therapy procedures checklist: A measure for assessing the technique use of child and adolescent therapists. Journal of Clinical Child Psychology, 31, 168–180.

Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688–701.PubMedCrossRef

Weisz, J. R., Doss, A. J., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671–689.PubMedCrossRef

Weisz, J. R., Hawley, K. M., & Jensen-Doss, A. (2004). Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child and Adolescent Psychiatric Clinics of North America, 13, 729–815.PubMedCrossRef

Weisz, J. R., Huey, S. J., & Weersing, V. R. (1998). Psychotherapy with children and adolescents: The state of the art. Advances in Clinical Child Psychology, 20, 49–91.

Weisz, J. R., & Jensen, P. S. (1999). Efficacy and effectiveness of child and adolescent psychotherapy and pharmacotherapy. Mental Health Services Research, 1, 125–157.PubMedCrossRef

Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337–363.PubMedCrossRef

Wiggins, T. L., Sofronoff, K., & Sanders, M. R. (2009). Pathways Triple P-Positive Parenting Program: Effects on parent-child relationships and child behavior problems. Family Process, 48, 517–530.PubMedCrossRef

Titel: Do Evidence-Based Interventions Work When Tested in the “Real World?” A Systematic Review and Meta-analysis of Parent Management Training for the Treatment of Child Disruptive Behavior
Auteurs: Daniel Michelson
Clare Davenport
Janine Dretzke
Jane Barlow
Crispin Day
Publicatiedatum: 01-03-2013
Uitgeverij: Springer US
Gepubliceerd in: Clinical Child and Family Psychology Review / Uitgave 1/2013
Print ISSN: 1096-4037
Elektronisch ISSN: 1573-2827
DOI: https://doi.org/10.1007/s10567-013-0128-0

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 1/2013

Revisiting Data Related to the Age of Onset and Developmental Course of Female Conduct Problems

The Promotion of Self-Regulation Through Parenting Interventions

Multisystemic Therapy for Child Non-Externalizing Psychological and Health Problems: A Preliminary Review

Dialectical Behavior Therapy for Adolescents: Theory, Treatment Adaptations, and Empirical Outcomes