Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 3/2013

01-09-2013

A Measurement Framework to Determine the Construct Validity of ADHD/ODD Rating Scales: Additional Evaluations of the Child and Adolescent Disruptive Behavior Inventory

Auteurs: Girwan Khadka, G. Leonard Burns

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 3/2013

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

A multiple group confirmatory factor analysis was used to test the invariance of an attention-deficit/hyperactivity disorder-inattention, attention-deficit/hyperactivity disorder-hyperactivity/impulsivity, oppositional defiant disorder toward adults, academic and social competence five-factor model across of independent groups of Thai adolescents with the Child and Adolescent Disruptive Behavior Inventory (CADBI). Mothers and fathers’ ratings on 872 adolescents were compared to mothers and fathers’ ratings on a different group of 983 adolescents. The design allowed four invariance analyses (i.e., mothers’ ratings of the first group compared to mothers’ ratings of the second group; fathers’ ratings of first group compared to fathers’ ratings of the second group; mothers’ ratings of first group compared to fathers’ ratings of the second group; and fathers’ ratings of first group compared to mothers’ ratings of second group). Support was found for the invariance of like-symptom loadings and symptom intercepts as well as like-factor variances, covariances, and factor means across the four invariance analyses. The findings further expand the construct validity of the CADBI. The paper also introduces a multiple indicators by multiple traits by multiple methods by multiple sources by multiple occasions by multiple groups’ measurement matrix to guide the evaluation of the construct validity of ADHD/ODD rating scales.
Voetnoten
1
Although our focus is on the CADBI construct validity studies, it is important to note that careful consideration was given to content validity in the development of the rating scale (i.e., wording of the symptoms on the scale, the instructions to parents and teachers, the rating anchors used to quantify the occurrence of the symptoms, the rating time interval, the distinction between frequency of occurrence and impairment due to symptom occurrence and the importance of the assessment of academic and social competence independent of symptom occurrence). For example, the instructions for parents ask the parents to only consider the child’s behavior in the home and community and not to consider reports on the child’s behavior at school. With these instructions we are attempting to increase the likelihood that the parents’ ratings will be based on behaviors observed in the home and community. Shipp et al. (2010) describe in greater detail how these considerations were used to improve the content validity of the CADBI as well as how the CADBI differs from other ADHD/ODD scales.
 
2
Although the equality of like-item residuals across independent groups is considered an unrealistic expectation (Byrne 2012), we did constrain like-item residuals equal across the groups for the four analyses. For the mothers to mothers, fathers to fathers, mothers to fathers and fathers to mothers’ analyses it was necessary to release six, five, nine and four residuals, respectively. Three of the same residuals needed to be released in all four analyses (ADHD-IN symptoms 3 and 4 along with ADHD-HI symptom 9). In all cases the released residuals were significantly smaller for the second group.
 
Literatuur
go back to reference Barkley, R. A. (2012). Distinguishing sluggish cognitive tempo from ADHD in children and adolescents: executive functioning, impairment, and comorbidity. Journal of Clinical Child and Adolescent Psychology. doi:10.1080/15374416.2012.734259. Advance online publication. Barkley, R. A. (2012). Distinguishing sluggish cognitive tempo from ADHD in children and adolescents: executive functioning, impairment, and comorbidity. Journal of Clinical Child and Adolescent Psychology. doi:10.​1080/​15374416.​2012.​734259. Advance online publication.
go back to reference Bauermeister, J. J., Canino, G., Polanczyk, G., & Rohde, L. A. (2010). ADHD across cultures: Is there evidence for a bidimensional organization of symptoms? Journal of Clinical Child and Adolescent Psychology, 39, 362–372. Bauermeister, J. J., Canino, G., Polanczyk, G., & Rohde, L. A. (2010). ADHD across cultures: Is there evidence for a bidimensional organization of symptoms? Journal of Clinical Child and Adolescent Psychology, 39, 362–372.
go back to reference Burns, G. L., Boe, B., Walsh, J. A., Sommers-Flanagan, R., & Teegarden, L. A. (2001). A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: what is the best model for the organization of these symptoms? Journal of Abnormal Child Psychology, 29, 339–349.PubMedCrossRef Burns, G. L., Boe, B., Walsh, J. A., Sommers-Flanagan, R., & Teegarden, L. A. (2001). A confirmatory factor analysis on the DSM-IV ADHD and ODD symptoms: what is the best model for the organization of these symptoms? Journal of Abnormal Child Psychology, 29, 339–349.PubMedCrossRef
go back to reference Burns, G. L., Taylor, T., Rusby, J. (2001). Child and adolescent disruptive behavior inventory—Version 2.3 (Parent). Unpublished manuscript. Burns, G. L., Taylor, T., Rusby, J. (2001). Child and adolescent disruptive behavior inventory—Version 2.3 (Parent). Unpublished manuscript.
go back to reference Burns, G. L., Walsh, J. A., & Gomez, R. (2003). Convergent and discriminant validity of trait and source effects in ADHD-inattention and hyperactivity/impulsivity measures across a 3-month interval. Journal of Abnormal Child Psychology, 15, 529–541. Burns, G. L., Walsh, J. A., & Gomez, R. (2003). Convergent and discriminant validity of trait and source effects in ADHD-inattention and hyperactivity/impulsivity measures across a 3-month interval. Journal of Abnormal Child Psychology, 15, 529–541.
go back to reference Burns, G. L., Walsh, J. A., Gomez, R., & Hafetz, N. (2006). Measurement and structural invariance of parent ratings of ADHD and ODD symptoms across gender for American and Malaysian children. Psychological Assessment, 18, 452–457.PubMedCrossRef Burns, G. L., Walsh, J. A., Gomez, R., & Hafetz, N. (2006). Measurement and structural invariance of parent ratings of ADHD and ODD symptoms across gender for American and Malaysian children. Psychological Assessment, 18, 452–457.PubMedCrossRef
go back to reference Burns, G. L., Moura, M. A., Walsh, J. A., Desmul, C., Silpakit, C., & Sommers-Flanagan, J. (2008). Invariance and convergent and discriminant validity between mothers’ and fathers’ ratings of oppositional defiant disorder toward adults, ADHD-HI, ADHD-IN, and academic competence factors within Brazilian, Thai, and American children. Psychological Assessment, 20, 121–130.PubMedCrossRef Burns, G. L., Moura, M. A., Walsh, J. A., Desmul, C., Silpakit, C., & Sommers-Flanagan, J. (2008). Invariance and convergent and discriminant validity between mothers’ and fathers’ ratings of oppositional defiant disorder toward adults, ADHD-HI, ADHD-IN, and academic competence factors within Brazilian, Thai, and American children. Psychological Assessment, 20, 121–130.PubMedCrossRef
go back to reference Burns, G. L., Desmul, C., Walsh, J. A., Silpakit, C., & Ussahawanitchakit, P. (2009). A multitrait (ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence) by multisource (mothers and fathers) evaluation of the invariance and convergent/discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with Thai Adolescents. Psychological Assessment, 21, 635–641.PubMedCrossRef Burns, G. L., Desmul, C., Walsh, J. A., Silpakit, C., & Ussahawanitchakit, P. (2009). A multitrait (ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence) by multisource (mothers and fathers) evaluation of the invariance and convergent/discriminant validity of the Child and Adolescent Disruptive Behavior Inventory with Thai Adolescents. Psychological Assessment, 21, 635–641.PubMedCrossRef
go back to reference Burns, G. L., Walsh, J. A., Servera, M., Lorenzo-Seva, U., Cardo, E., & Rodríguez-Fornells, A. (2012). Construct validity of ADHD/ODD rating scales: recommendations for the evaluation of the forthcoming DSM-V ADHD/ODD scales. Journal of Abnormal Child Psychology. doi:10.1007/s10802=012=9660-5. Advance online publication. Burns, G. L., Walsh, J. A., Servera, M., Lorenzo-Seva, U., Cardo, E., & Rodríguez-Fornells, A. (2012). Construct validity of ADHD/ODD rating scales: recommendations for the evaluation of the forthcoming DSM-V ADHD/ODD scales. Journal of Abnormal Child Psychology. doi:10.​1007/​s10802=​012=​9660-5. Advance online publication.
go back to reference Byrne, B. M. (2012). Structural equation modeling with Mplus: basic concepts, applications, and programming. New York: Routledge. Byrne, B. M. (2012). Structural equation modeling with Mplus: basic concepts, applications, and programming. New York: Routledge.
go back to reference Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.PubMedCrossRef Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validity by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.PubMedCrossRef
go back to reference Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef
go back to reference Frick, P. J., & McMahon, R. J. (2008). Child and adolescent conduct problems. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 17–40). New York: Oxford Press. Frick, P. J., & McMahon, R. J. (2008). Child and adolescent conduct problems. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 17–40). New York: Oxford Press.
go back to reference Geiser, C., & Lockhart, G. (2012). A comparison of four approaches to method effects in latent state-trait analyses. Psychological Methods, 17, 255–283.PubMedCrossRef Geiser, C., & Lockhart, G. (2012). A comparison of four approaches to method effects in latent state-trait analyses. Psychological Methods, 17, 255–283.PubMedCrossRef
go back to reference Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Analyzing true change in longitudinal multitrait-multimethod studies: application of a multimethod change model to depression and anxiety in children. Developmental Psychology, 46, 29–45.PubMedCrossRef Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Analyzing true change in longitudinal multitrait-multimethod studies: application of a multimethod change model to depression and anxiety in children. Developmental Psychology, 46, 29–45.PubMedCrossRef
go back to reference Gomez, R., Burns, G. L., Walsh, J. A., & Moura, M. A. (2003). A multitrait-multisource factor analytic approach to the construct validity of ADHD rating scales. Psychological Assessment, 15, 3–16.PubMedCrossRef Gomez, R., Burns, G. L., Walsh, J. A., & Moura, M. A. (2003). A multitrait-multisource factor analytic approach to the construct validity of ADHD rating scales. Psychological Assessment, 15, 3–16.PubMedCrossRef
go back to reference Johnston, C., & Mah, J. W. T. (2008). Child attention-deficit/hyperactivity disorder. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 41–66). New York: Oxford Press. Johnston, C., & Mah, J. W. T. (2008). Child attention-deficit/hyperactivity disorder. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 41–66). New York: Oxford Press.
go back to reference Moura, M. A., & Burns, G. L. (2010). Oppositional defiant behavior toward adults and oppositional defiant behavior toward other children: Evidence for two separate constructs with mothers' and fathers' ratings of Brazilian children. Journal of Child Psychology and Psychiatry, 51, 23–30. Moura, M. A., & Burns, G. L. (2010). Oppositional defiant behavior toward adults and oppositional defiant behavior toward other children: Evidence for two separate constructs with mothers' and fathers' ratings of Brazilian children. Journal of Child Psychology and Psychiatry, 51, 23–30.
go back to reference Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus User’s Guide (6th ed.). Los Angeles, CA: Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus User’s Guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
go back to reference Servera, M., Lorenzo-Seva, U., Cardo, E., Rodriguez-Fornells, A., & Burns, G. L. (2010). Understanding trait and source effects in attention-deficit/hyperactivity disorder and oppositional defiant disorder rating scales: Mothers, fathers and teachers' ratings of children from the Balearic Islands. Journal of Clinical Child and Adolescent Psychology, 39, 1–11. Servera, M., Lorenzo-Seva, U., Cardo, E., Rodriguez-Fornells, A., & Burns, G. L. (2010). Understanding trait and source effects in attention-deficit/hyperactivity disorder and oppositional defiant disorder rating scales: Mothers, fathers and teachers' ratings of children from the Balearic Islands. Journal of Clinical Child and Adolescent Psychology, 39, 1–11.
go back to reference Shipp, F., Burns, G. L., & Desmul, C. (2010). Construct validity of ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence dimensions in teacher ratings of Thai adolescents: additional validity for the child and adolescent disruptive behavior inventory. Journal of Psychopathology and Behavioral Assessment, 32, 557–564.CrossRef Shipp, F., Burns, G. L., & Desmul, C. (2010). Construct validity of ADHD-IN, ADHD-HI, ODD toward adults, academic and social competence dimensions in teacher ratings of Thai adolescents: additional validity for the child and adolescent disruptive behavior inventory. Journal of Psychopathology and Behavioral Assessment, 32, 557–564.CrossRef
go back to reference Taylor, T. K., Burns, G. L., Rusby, J. C., & Foster, E. M. (2006). Oppositional defiant disorder toward peers: initial evidence for two separate constructs. Psychological Assessment, 18, 439–443.PubMedCrossRef Taylor, T. K., Burns, G. L., Rusby, J. C., & Foster, E. M. (2006). Oppositional defiant disorder toward peers: initial evidence for two separate constructs. Psychological Assessment, 18, 439–443.PubMedCrossRef
go back to reference Toplak, M. E., Sorge, G. B., Flora, D. B., Chen, W., Banaschewski, T., Buitelaar, J., & Farone, S. V. (2012). The hierarchical factor model of ADHD: invariant across age and national groupings? Journal of Child Psychology and Psychiatry, 53, 292–303.PubMedCrossRef Toplak, M. E., Sorge, G. B., Flora, D. B., Chen, W., Banaschewski, T., Buitelaar, J., & Farone, S. V. (2012). The hierarchical factor model of ADHD: invariant across age and national groupings? Journal of Child Psychology and Psychiatry, 53, 292–303.PubMedCrossRef
go back to reference Willcut, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., & Lahey, B. B. (2012). Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology. doi:10.1037/a0027347. Advance online publication. Willcut, E. G., Nigg, J. T., Pennington, B. F., Solanto, M. V., Rohde, L. A., Tannock, R., & Lahey, B. B. (2012). Validity of DSM-IV attention-deficit/hyperactivity disorder symptom dimensions and subtypes. Journal of Abnormal Psychology. doi:10.​1037/​a0027347. Advance online publication.
Metagegevens
Titel
A Measurement Framework to Determine the Construct Validity of ADHD/ODD Rating Scales: Additional Evaluations of the Child and Adolescent Disruptive Behavior Inventory
Auteurs
Girwan Khadka
G. Leonard Burns
Publicatiedatum
01-09-2013
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 3/2013
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-012-9336-z

Andere artikelen Uitgave 3/2013

Journal of Psychopathology and Behavioral Assessment 3/2013 Naar de uitgave