Skip to main content
Top

09-01-2025 | Research

Expert Rater Agreement for Symptoms and Diagnosis of Bipolar Disorder in Youth

Auteurs: Jarrod M. Leffler, Daniel Azzopardi, Peter S. Jensen, Paul E. Croarkin, Kathryn R. Cullen, Anne Duffy, Bonnie Klimes-Dougan, Robert M. Post, Jennifer L. Vande Voort, Karen Dineen Wagner, Dwight V. Wolf, Cathryn A. Galanter

Gepubliceerd in: Child Psychiatry & Human Development

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The diagnosis of bipolar disorder (BD) in young children has been a topic of debate, in part owing to varied interpretation of manic-like symptoms. We examined how expert academic clinicians participating in the pediatric bipolar biobank varied in their interpretation and application of Diagnostic and Statistical Manual of Mental Disorders (DSM) criteria and diagnoses. Study co-investigators reviewed 12 standardized narratives and for each marked a visual analog scale with their confidence in the presence of manic episodes and criteria. We analyzed raters’ confidence and inter-rater agreement using interclass correlation (ICC). Symptoms with good ICC ranging from 0.60 to 0.74 included inflated self-esteem/grandiosity and decreased need for sleep. Diagnoses and episodes with poor ICCs (< 0.4) included Hypomania and Bipolar Not Elsewhere Classified/Not Otherwise Specified. Despite efforts made to refine BD criteria with DSM-5, there was substantive variation in diagnostic interpretation among investigators working with children presenting with manic-like symptoms.
Literatuur
1.
go back to reference Blader JC, Carlson GA (2007) Increased rates of bipolar disorder diagnoses among U.S. child, adolescent and adult inpatients, 1996–2004. Biol Psychiatry 62(2):107–114CrossRefPubMedPubMedCentral Blader JC, Carlson GA (2007) Increased rates of bipolar disorder diagnoses among U.S. child, adolescent and adult inpatients, 1996–2004. Biol Psychiatry 62(2):107–114CrossRefPubMedPubMedCentral
2.
go back to reference Moreno C, Laje G, Blanco C, Jiang H, Schmidt AB, Olfson M (2007) National trends in the outpatient diagnosis and treatment of bipolar disorder in youth. Arch Gen Psychiatry 64(9):1032–1039CrossRefPubMed Moreno C, Laje G, Blanco C, Jiang H, Schmidt AB, Olfson M (2007) National trends in the outpatient diagnosis and treatment of bipolar disorder in youth. Arch Gen Psychiatry 64(9):1032–1039CrossRefPubMed
3.
go back to reference James A, Hoang U, Seagroatt V, Clacey J, Goldacre M, Leibenluft E (2014) A comparison of American and English hospital discharge rates for pediatric bipolar disorder, 2000 to 2010. J Am Acad Child Adolesc Psychiatry 53(6):614–624CrossRefPubMedPubMedCentral James A, Hoang U, Seagroatt V, Clacey J, Goldacre M, Leibenluft E (2014) A comparison of American and English hospital discharge rates for pediatric bipolar disorder, 2000 to 2010. J Am Acad Child Adolesc Psychiatry 53(6):614–624CrossRefPubMedPubMedCentral
4.
go back to reference Clacey J, Goldacre M, James A (2015) Paediatric bipolar disorder: international comparisons of hospital discharge rates 2000–2010. BJPsych Open 1(2):166–171CrossRefPubMedPubMedCentral Clacey J, Goldacre M, James A (2015) Paediatric bipolar disorder: international comparisons of hospital discharge rates 2000–2010. BJPsych Open 1(2):166–171CrossRefPubMedPubMedCentral
5.
go back to reference Sherwood SN, Greenway J, Freeman AJ (2020) Decreasing rate of inpatient pediatric bipolar disorder diagnosis between 2005 and 2015. J Affect Disord 274:859–863CrossRefPubMed Sherwood SN, Greenway J, Freeman AJ (2020) Decreasing rate of inpatient pediatric bipolar disorder diagnosis between 2005 and 2015. J Affect Disord 274:859–863CrossRefPubMed
6.
go back to reference Galanter CA, Patel VL (2005) Medical decision making: a selective review for child psychiatrists and psychologists. J Child Psychol Psychiatry Allied Discip 46(7):675–689CrossRef Galanter CA, Patel VL (2005) Medical decision making: a selective review for child psychiatrists and psychologists. J Child Psychol Psychiatry Allied Discip 46(7):675–689CrossRef
7.
go back to reference National Academies of Sciences, Engineering, and Medicine (2015) Improving diagnosis in health care. National Academies, Washington, DC National Academies of Sciences, Engineering, and Medicine (2015) Improving diagnosis in health care. National Academies, Washington, DC
8.
go back to reference Dubicka B, Carlson GA, Vail A, Harrington R (2008) Prepubertal mania: diagnostic differences between US and UK clinicians. Eur Child Adolesc Psychiatry 17(3):153–161CrossRefPubMed Dubicka B, Carlson GA, Vail A, Harrington R (2008) Prepubertal mania: diagnostic differences between US and UK clinicians. Eur Child Adolesc Psychiatry 17(3):153–161CrossRefPubMed
9.
go back to reference Mulsant BH, Kastango KB, Rosen J, Stone RA, Mazumdar S, Pollock BG (2002) Interrater reliability in clinical trials of depressive disorders. Am J Psychiatry 159(9):1598–1600CrossRefPubMed Mulsant BH, Kastango KB, Rosen J, Stone RA, Mazumdar S, Pollock BG (2002) Interrater reliability in clinical trials of depressive disorders. Am J Psychiatry 159(9):1598–1600CrossRefPubMed
10.
go back to reference Piacentini J, Shaffer D, Fisher P, Schwab-Stone M, Davies M, Gioia P (1993) The diagnostic interview schedule for children-revised version (DISC-R): III. concurrent criterion validity. J Am Acad Child Adolesc Psychiatry 32(3):658–665CrossRefPubMed Piacentini J, Shaffer D, Fisher P, Schwab-Stone M, Davies M, Gioia P (1993) The diagnostic interview schedule for children-revised version (DISC-R): III. concurrent criterion validity. J Am Acad Child Adolesc Psychiatry 32(3):658–665CrossRefPubMed
11.
go back to reference Galanter CA, Pagar DL, Oberg PP, Wong C, Davies M, Jensen PS (2009) Symptoms leading to a bipolar diagnosis: a phone survey of child and adolescent psychiatrists. J Child Adolesc Psychopharmacol 19(6):641–647CrossRefPubMedPubMedCentral Galanter CA, Pagar DL, Oberg PP, Wong C, Davies M, Jensen PS (2009) Symptoms leading to a bipolar diagnosis: a phone survey of child and adolescent psychiatrists. J Child Adolesc Psychopharmacol 19(6):641–647CrossRefPubMedPubMedCentral
12.
go back to reference Galanter CA, Hundt SR, Goyal P, Le J, Fisher PW (2012) Variability among research diagnostic interview instruments in the application of DSM-IV-TR criteria for pediatric bipolar disorder. J Am Acad Child Adolesc Psychiatry 51(6):605–621CrossRefPubMed Galanter CA, Hundt SR, Goyal P, Le J, Fisher PW (2012) Variability among research diagnostic interview instruments in the application of DSM-IV-TR criteria for pediatric bipolar disorder. J Am Acad Child Adolesc Psychiatry 51(6):605–621CrossRefPubMed
13.
go back to reference Youngstrom EA, Genzlinger JE, Egerton GA, Van Meter AR (2015) Multivariate meta-analysis of the discriminative validity of caregiver, youth, and teacher rating scales for pediatric bipolar disorder: mother knows best about mania. Archives Sci Psychol 3(1):112–137 Youngstrom EA, Genzlinger JE, Egerton GA, Van Meter AR (2015) Multivariate meta-analysis of the discriminative validity of caregiver, youth, and teacher rating scales for pediatric bipolar disorder: mother knows best about mania. Archives Sci Psychol 3(1):112–137
14.
go back to reference Duffy A, Carlson G, Dubicka B, Hillegers MHJ (2020) Pre-pubertal bipolar disorder: origins and current status of the controversy. Int J Bipolar Disorders 8(1):18CrossRef Duffy A, Carlson G, Dubicka B, Hillegers MHJ (2020) Pre-pubertal bipolar disorder: origins and current status of the controversy. Int J Bipolar Disorders 8(1):18CrossRef
15.
go back to reference Mesman E, Nolen WA, Reichart CG, Wals M, Hillegers MH (2013) The Dutch bipolar offspring study: 12-year follow-up. Am J Psychiatry 170(5):542–549CrossRefPubMed Mesman E, Nolen WA, Reichart CG, Wals M, Hillegers MH (2013) The Dutch bipolar offspring study: 12-year follow-up. Am J Psychiatry 170(5):542–549CrossRefPubMed
16.
go back to reference Youngstrom EA, Birmaher B, Findling RL (2008) Pediatric bipolar disorder: validity, phenomenology, and recommendations for diagnosis. Bipolar Disorder 10:194–214CrossRef Youngstrom EA, Birmaher B, Findling RL (2008) Pediatric bipolar disorder: validity, phenomenology, and recommendations for diagnosis. Bipolar Disorder 10:194–214CrossRef
17.
go back to reference Tijssen MJ, van Os J, Wittchen HU, Lieb R, Beesdo K, Mengelers R, Krabbendam L, Wichers M (2010) Evidence that bipolar disorder is the poor outcome fraction of a common developmental phenotype: an 8-year cohort study in young people. Psychol Med 40(2):289–299CrossRefPubMed Tijssen MJ, van Os J, Wittchen HU, Lieb R, Beesdo K, Mengelers R, Krabbendam L, Wichers M (2010) Evidence that bipolar disorder is the poor outcome fraction of a common developmental phenotype: an 8-year cohort study in young people. Psychol Med 40(2):289–299CrossRefPubMed
18.
go back to reference Stringaris A, Baroni A, Haimm C, Brotman M, Lowe CH, Myers F, Leibenluft E (2010) Pediatric bipolar disorder versus severe mood dysregulation: risk for manic episodes on follow-up. J Am Acad Child Adolesc Psychiatry 49(4):397–405PubMedPubMedCentral Stringaris A, Baroni A, Haimm C, Brotman M, Lowe CH, Myers F, Leibenluft E (2010) Pediatric bipolar disorder versus severe mood dysregulation: risk for manic episodes on follow-up. J Am Acad Child Adolesc Psychiatry 49(4):397–405PubMedPubMedCentral
19.
go back to reference Carlson GA, Klein DN (2014) How to understand divergent views on bipolar disorder in youth. Ann Rev Clin Psychol 10:529–551CrossRef Carlson GA, Klein DN (2014) How to understand divergent views on bipolar disorder in youth. Ann Rev Clin Psychol 10:529–551CrossRef
20.
go back to reference American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA
21.
go back to reference McIntyre JS, Yager J, Everett A, Galanter CA, Lyness JM, Nininger J, Reus VI, Vergare M (2021) The DSM-5 clinical and public health committee (CPHC): operations, mechanics, controversies and recommendations. Psychol Med 51(14):2493–2500CrossRefPubMed McIntyre JS, Yager J, Everett A, Galanter CA, Lyness JM, Nininger J, Reus VI, Vergare M (2021) The DSM-5 clinical and public health committee (CPHC): operations, mechanics, controversies and recommendations. Psychol Med 51(14):2493–2500CrossRefPubMed
22.
go back to reference Axelson D, Findling RL, Fristad MA, Kowatch RA, Youngstrom EA, Horwitz SM, Arnold LE, Frazier TW, Ryan N, Demeter C, Gill MK, Hauser-Harrington JC, Depew J, Kennedy SM, Gron BA, Rowles BM, Birmaher B (2012) Examining the proposed disruptive mood dysregulation disorder diagnosis in children in the longitudinal assessment of manic symptoms study. J Clin Psychiatry 73(10):1342–1350CrossRefPubMedPubMedCentral Axelson D, Findling RL, Fristad MA, Kowatch RA, Youngstrom EA, Horwitz SM, Arnold LE, Frazier TW, Ryan N, Demeter C, Gill MK, Hauser-Harrington JC, Depew J, Kennedy SM, Gron BA, Rowles BM, Birmaher B (2012) Examining the proposed disruptive mood dysregulation disorder diagnosis in children in the longitudinal assessment of manic symptoms study. J Clin Psychiatry 73(10):1342–1350CrossRefPubMedPubMedCentral
23.
go back to reference Kaufman J, Birmaher B, Brent B, Rao U, Ryan ND (1996) Kiddie-Sads-Present and Lifetime Version (K-SADS-PL), Version 1.0 of October 1996 Kaufman J, Birmaher B, Brent B, Rao U, Ryan ND (1996) Kiddie-Sads-Present and Lifetime Version (K-SADS-PL), Version 1.0 of October 1996
24.
go back to reference Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S (1983) A children’s global assessment scale (CGAS). Arch Gen Psychiatry 40(11):1228–1231CrossRefPubMed Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S (1983) A children’s global assessment scale (CGAS). Arch Gen Psychiatry 40(11):1228–1231CrossRefPubMed
25.
go back to reference Yeung AWK, Wong NSM (2019) The historical roots of visual analog scale in psychology as revealed by reference publication year spectroscopy. Front Hum Neurosci 13:86CrossRefPubMedPubMedCentral Yeung AWK, Wong NSM (2019) The historical roots of visual analog scale in psychology as revealed by reference publication year spectroscopy. Front Hum Neurosci 13:86CrossRefPubMedPubMedCentral
26.
go back to reference Rajakannan T, Safer DJ, Burcu M, Zito JM (2016) National trends in psychiatric not otherwise specified (NOS) diagnosis and medication use among adults in outpatient treatment. Psychiatric Serv 67(3):289–95CrossRef Rajakannan T, Safer DJ, Burcu M, Zito JM (2016) National trends in psychiatric not otherwise specified (NOS) diagnosis and medication use among adults in outpatient treatment. Psychiatric Serv 67(3):289–95CrossRef
27.
go back to reference Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6(4):284–290CrossRef Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6(4):284–290CrossRef
28.
go back to reference Shavelson RJ, Webb NM, Rowley GL (1992) Generalizability theory. In: Kazdin AE (ed) Methodological issues and strategies in clinical research. American Psychological Association, Washington, DC, pp 233–256CrossRef Shavelson RJ, Webb NM, Rowley GL (1992) Generalizability theory. In: Kazdin AE (ed) Methodological issues and strategies in clinical research. American Psychological Association, Washington, DC, pp 233–256CrossRef
29.
go back to reference Cohen JA (1960) Coefficient of agreement for nominal scales. Educ Psychol Meas 20:37–46CrossRef Cohen JA (1960) Coefficient of agreement for nominal scales. Educ Psychol Meas 20:37–46CrossRef
30.
31.
go back to reference de Vet HCW, Terwee CB, Knol DL, Bouter LM (2006) When to use agreement versus reliability measures. J Clin Epidemiol 59:1033–1039CrossRefPubMed de Vet HCW, Terwee CB, Knol DL, Bouter LM (2006) When to use agreement versus reliability measures. J Clin Epidemiol 59:1033–1039CrossRefPubMed
32.
go back to reference McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1(1):30–46CrossRef McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1(1):30–46CrossRef
33.
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159–174CrossRefPubMed
34.
go back to reference Leffler JM, Riebel J, Hughes HM (2015) A review of child and adolescent diagnostic interviews for clinical practitioners. Assessment 22(6):690–703CrossRefPubMed Leffler JM, Riebel J, Hughes HM (2015) A review of child and adolescent diagnostic interviews for clinical practitioners. Assessment 22(6):690–703CrossRefPubMed
35.
go back to reference Hughes CW, Rintelmann J, Mayes T, Emslie GJ, Pearson G, Rush AJ (2000) Structured inter- view and uniform assessment improves diagnostic reliability. J Child Adolesc Psychopharmacol 10:119–131CrossRefPubMed Hughes CW, Rintelmann J, Mayes T, Emslie GJ, Pearson G, Rush AJ (2000) Structured inter- view and uniform assessment improves diagnostic reliability. J Child Adolesc Psychopharmacol 10:119–131CrossRefPubMed
36.
go back to reference Prisciandaro JJ, Tolliver BK (2015) Evidence for the continuous latent structure of mania and depression in out-patients with bipolar disorder: results from the systematic treatment enhancement program for bipolar disorder (STEP-BD). Psychol Med 45(12):2595–2603CrossRefPubMedPubMedCentral Prisciandaro JJ, Tolliver BK (2015) Evidence for the continuous latent structure of mania and depression in out-patients with bipolar disorder: results from the systematic treatment enhancement program for bipolar disorder (STEP-BD). Psychol Med 45(12):2595–2603CrossRefPubMedPubMedCentral
37.
go back to reference Jenkins MM, Youngstrom EA (2016) A randomized controlled trial of cognitive debiasing improves assessment and treatment selection for pediatric bipolar disorder. J Consult Clin Psychol 84(4):323–333CrossRefPubMedPubMedCentral Jenkins MM, Youngstrom EA (2016) A randomized controlled trial of cognitive debiasing improves assessment and treatment selection for pediatric bipolar disorder. J Consult Clin Psychol 84(4):323–333CrossRefPubMedPubMedCentral
Metagegevens
Titel
Expert Rater Agreement for Symptoms and Diagnosis of Bipolar Disorder in Youth
Auteurs
Jarrod M. Leffler
Daniel Azzopardi
Peter S. Jensen
Paul E. Croarkin
Kathryn R. Cullen
Anne Duffy
Bonnie Klimes-Dougan
Robert M. Post
Jennifer L. Vande Voort
Karen Dineen Wagner
Dwight V. Wolf
Cathryn A. Galanter
Publicatiedatum
09-01-2025
Uitgeverij
Springer US
Gepubliceerd in
Child Psychiatry & Human Development
Print ISSN: 0009-398X
Elektronisch ISSN: 1573-3327
DOI
https://doi.org/10.1007/s10578-024-01797-w