Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 2/2018

27-11-2017

Test-Retest Measurement Invariance of Clinic Referred Children’s ADHD Symptoms

Auteurs: Rapson Gomez, Alasdair Vance, Vasileios Stavropoulos

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 2/2018

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

This study examined the test-retest measurement invariance of ratings of the ADHD symptoms. Mothers of a group of 217 clinic-referred children (boys = 169, girls = 49; age range = 7 to 17 years) completed ratings of the ADHD symptoms presented in a modified version of the Strengths and Weaknesses of ADHD-Symptoms and Normal Behavior Scale (SWAN-M) twice, 12 months apart. Confirmatory factor analysis (CFA) of their ratings at both time points provided more support for the bifactor model of ADHD [orthogonal general and specific factors for inattention (IA) and hyperactivity/impulsivity (HI) symptoms] over the 2-factor oblique model (factors for inattention IA and HI symptoms). For the bifactor model, measurement invariance testing using multiple-group CFA indicated support for configural and full scalar test-retest invariance when the chi-square difference test was applied. For metric invariance, all but one symptom showed invariance. When the differences in approximate fit indices were applied, there was support for full measurement invariance (configural, metric and scalar). The findings indicate that observed scores (based on maternal ratings of the SWAM-M), twelve months apart, are comparable as they have the same measurement properties. Several practical, theoretical, research and clinical implications of the findings are discussed.
Literatuur
go back to reference Achenbach T. M., Rescorla L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth and Families Achenbach T. M., Rescorla L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth and Families
go back to reference Aman, M. G., & Pearson, D. A. (1999). Monitoring, measuring drug effects. II. Behavioral, emotional, and cognitive effects. In J. S. Werry & M. G. Aman (Eds.), Practitioner's guide to psychoactive drugs for children and adolescents. 2 nd (pp. 99–164). New York: Plenum Press.CrossRef Aman, M. G., & Pearson, D. A. (1999). Monitoring, measuring drug effects. II. Behavioral, emotional, and cognitive effects. In J. S. Werry & M. G. Aman (Eds.), Practitioner's guide to psychoactive drugs for children and adolescents. 2 nd (pp. 99–164). New York: Plenum Press.CrossRef
go back to reference American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, & Psychological Testing (US). (2014). Standards for educational and psychological testing. Washington: American Educational Research Association. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, & Psychological Testing (US). (2014). Standards for educational and psychological testing. Washington: American Educational Research Association.
go back to reference American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington: Author. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington: Author.
go back to reference American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders DSM-IV TR (text revision). Washington: Author.CrossRef American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders DSM-IV TR (text revision). Washington: Author.CrossRef
go back to reference American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington: Author.CrossRef American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington: Author.CrossRef
go back to reference Arias, V. B., Ponce, F. P., Martínez-Molina, A., Arias, B., & Núñez, D. (2016a). General and specific attention-deficit/hyperactivity disorder factors of children 4 to 6 years of age: An exploratory structural equation modeling approach to assessing symptom multidimensionality. Journal of Abnormal Psychology, 125, 125–137.CrossRefPubMed Arias, V. B., Ponce, F. P., Martínez-Molina, A., Arias, B., & Núñez, D. (2016a). General and specific attention-deficit/hyperactivity disorder factors of children 4 to 6 years of age: An exploratory structural equation modeling approach to assessing symptom multidimensionality. Journal of Abnormal Psychology, 125, 125–137.CrossRefPubMed
go back to reference Asparouhov, T., & Muthén, B. (2006). Robust chi square difference testing with mean and variance adjusted test statistics. Mplus web notes: No. 10. May 26, 2006. Asparouhov, T., & Muthén, B. (2006). Robust chi square difference testing with mean and variance adjusted test statistics. Mplus web notes: No. 10. May 26, 2006.
go back to reference Australian Bureau of Statistics. (2002). 2002 year book Australia. Canberra: ABS. Australian Bureau of Statistics. (2002). 2002 year book Australia. Canberra: ABS.
go back to reference Biederman, J., Mick, E., & Faraone, S. V. (2000). Age-dependent decline of symptoms of attention deficit hyperactivity disorder: Impact of remission definition and symptom type. American Journal of Psychiatry, 157, 816–818.CrossRefPubMed Biederman, J., Mick, E., & Faraone, S. V. (2000). Age-dependent decline of symptoms of attention deficit hyperactivity disorder: Impact of remission definition and symptom type. American Journal of Psychiatry, 157, 816–818.CrossRefPubMed
go back to reference Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press.
go back to reference Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.CrossRef
go back to reference Cheung, G. W. (2008). Testing equivalency in the structure, means, and variances of higher-order constructs with structural equation modelling. Organizational Research Methods, 11, 593–613.CrossRef Cheung, G. W. (2008). Testing equivalency in the structure, means, and variances of higher-order constructs with structural equation modelling. Organizational Research Methods, 11, 593–613.CrossRef
go back to reference Conners, C. K. (2008). Conners (3rd ed.). North Tonawanda: Multi-Health Systems. Conners, C. K. (2008). Conners (3rd ed.). North Tonawanda: Multi-Health Systems.
go back to reference Daley, D. (2006). Attention deficit hyperactivity disorder: A review of the essential facts. Child: Care, Health and Development, 32, 193–204. Daley, D. (2006). Attention deficit hyperactivity disorder: A review of the essential facts. Child: Care, Health and Development, 32, 193–204.
go back to reference Drasgow, F., & Kanfer, R. (1985). Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 70, 662–680.CrossRefPubMed Drasgow, F., & Kanfer, R. (1985). Equivalence of psychological measurement in heterogeneous populations. Journal of Applied Psychology, 70, 662–680.CrossRefPubMed
go back to reference DuPaul, G. J., Power, T. P., Anastopoulos, A. D., & Reid, R. (1998). ADHD rating scale-IV. New York: Guilford Press. DuPaul, G. J., Power, T. P., Anastopoulos, A. D., & Reid, R. (1998). ADHD rating scale-IV. New York: Guilford Press.
go back to reference DuPaul, G. J., Power, T. P., Anastopoulos, A. D., & Reid, R. (2016). ADHD rating Scale-5. New York: Guilford Press. DuPaul, G. J., Power, T. P., Anastopoulos, A. D., & Reid, R. (2016). ADHD rating Scale-5. New York: Guilford Press.
go back to reference Gau, S. S. F., Lin, Y. J., Cheng, A. T. A., Chiu, Y. N., Tsai, W. C., & Soong, W. T. (2010). Psychopathology and symptom remission at adolescence among children with attention deficit–hyperactivity disorder. Australian and New Zealand Journal of Psychiatry, 44, 323–332.CrossRefPubMed Gau, S. S. F., Lin, Y. J., Cheng, A. T. A., Chiu, Y. N., Tsai, W. C., & Soong, W. T. (2010). Psychopathology and symptom remission at adolescence among children with attention deficit–hyperactivity disorder. Australian and New Zealand Journal of Psychiatry, 44, 323–332.CrossRefPubMed
go back to reference Gaub, M., & Carlson, C. L. (1997). Behavioral characteristics of DSM-IV ADHD subtypes in a school-based population. Journal of Abnormal Child Psychology, 25, 103–111.CrossRefPubMed Gaub, M., & Carlson, C. L. (1997). Behavioral characteristics of DSM-IV ADHD subtypes in a school-based population. Journal of Abnormal Child Psychology, 25, 103–111.CrossRefPubMed
go back to reference Gomez, R., Harvey, J., Quick, C., Scharer, I., & Harris, G. (1999). DSM-IV AD/HD: Confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. Journal of Child Psychology and Psychiatry, 40, 265–274.CrossRefPubMed Gomez, R., Harvey, J., Quick, C., Scharer, I., & Harris, G. (1999). DSM-IV AD/HD: Confirmatory factor models, prevalence, and gender and age differences based on parent and teacher ratings of Australian primary school children. Journal of Child Psychology and Psychiatry, 40, 265–274.CrossRefPubMed
go back to reference Gomez, R., Burns, G. L., Walsh, J. A., & Moura, M. A. (2003). Trait, source and error variance in ADHD symptoms: A multitrait-multisource analysis with Australian and Brazilian children. Psychological Assessment, 15, 3–16.CrossRefPubMed Gomez, R., Burns, G. L., Walsh, J. A., & Moura, M. A. (2003). Trait, source and error variance in ADHD symptoms: A multitrait-multisource analysis with Australian and Brazilian children. Psychological Assessment, 15, 3–16.CrossRefPubMed
go back to reference Hart, E. L., Lahey, B. B., Loeber, R., Applegate, B., & Frick, P. J. (1995). Developmental change in attention-deficit hyperactivity disorder in boys: A four-year longitudinal study. Journal of Abnormal Child Psychology, 23, 729–749.CrossRefPubMed Hart, E. L., Lahey, B. B., Loeber, R., Applegate, B., & Frick, P. J. (1995). Developmental change in attention-deficit hyperactivity disorder in boys: A four-year longitudinal study. Journal of Abnormal Child Psychology, 23, 729–749.CrossRefPubMed
go back to reference Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRef Hu, L. T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRef
go back to reference Kuntsi, J., Rijsdijk, F., Ronald, A., Asherson, P., & Plomin, R. (2005). Genetic influences on the stability of attention-deficit/hyperactivity disorder symptoms from early to middlechildhood. Biological Psychiatry, 57, 647–654.CrossRefPubMed Kuntsi, J., Rijsdijk, F., Ronald, A., Asherson, P., & Plomin, R. (2005). Genetic influences on the stability of attention-deficit/hyperactivity disorder symptoms from early to middlechildhood. Biological Psychiatry, 57, 647–654.CrossRefPubMed
go back to reference Lahey, B. B., Pelham, W. E., Loney, J., Kipp, H., Ehrhardt, A., Lee, S. S., et al. (2004). Three-year predictive validity of DSM-iv attention deficit hyperactivity disorder in children diagnosed at 4-6 years of age. The American Journal of Psychiatry, 161, 2014–2020.CrossRefPubMed Lahey, B. B., Pelham, W. E., Loney, J., Kipp, H., Ehrhardt, A., Lee, S. S., et al. (2004). Three-year predictive validity of DSM-iv attention deficit hyperactivity disorder in children diagnosed at 4-6 years of age. The American Journal of Psychiatry, 161, 2014–2020.CrossRefPubMed
go back to reference Lahey, B. B., Pelham, W. E., Loney, J., Lee, S. S., & Willcutt, E. (2005). Instability of the DSM-IV subtypes of ADHD from preschool through elementary school. Archives of General Psychiatry, 62, 896–902.CrossRefPubMed Lahey, B. B., Pelham, W. E., Loney, J., Lee, S. S., & Willcutt, E. (2005). Instability of the DSM-IV subtypes of ADHD from preschool through elementary school. Archives of General Psychiatry, 62, 896–902.CrossRefPubMed
go back to reference Magnússon, P., Smári, J., Sigurðardóttir, D., Baldursson, G., Sigmundsson, J., et al. (2006). Validity of self-report and informant rating scales of adult ADHD symptoms in comparison with a semistructured diagnostic interview. Journal of Attention Disorders, 9, 494–503.CrossRefPubMed Magnússon, P., Smári, J., Sigurðardóttir, D., Baldursson, G., Sigmundsson, J., et al. (2006). Validity of self-report and informant rating scales of adult ADHD symptoms in comparison with a semistructured diagnostic interview. Journal of Attention Disorders, 9, 494–503.CrossRefPubMed
go back to reference Meredith, W. (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58, 525–542.CrossRef Meredith, W. (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58, 525–542.CrossRef
go back to reference Mitsis, E. M., McKay, K. E., Schulz, K. P., Newcorn, J. H., & Halperin, J. M. (2000). Parent–teacher concordance for DSM-IV attention-deficit/hyperactivity disorder in a clinic-referred sample. Journal of the American Academy of Child and Adolescent Psychiatry, 39(3), 308–313. https://doi.org/10.1097/00004583-200003000-00012 Mitsis, E. M., McKay, K. E., Schulz, K. P., Newcorn, J. H., & Halperin, J. M. (2000). Parent–teacher concordance for DSM-IV attention-deficit/hyperactivity disorder in a clinic-referred sample. Journal of the American Academy of Child and Adolescent Psychiatry, 39(3), 308–313. https://​doi.​org/​10.​1097/​00004583-200003000-00012
go back to reference Muthen, L. K., & Muthen, B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles: Muthen & Muthen. Muthen, L. K., & Muthen, B. O. (2010). Mplus user’s guide (6th ed.). Los Angeles: Muthen & Muthen.
go back to reference Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (Seventh ed.). Los Angeles: Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (2012). Mplus user’s guide (Seventh ed.). Los Angeles: Muthén & Muthén.
go back to reference Normand, S., Flora, D. B., Toplak, M. E., & Tannock, R. (2012). Evidence for a general ADHD factor from a longitudinal general school population study. Journal of Abnormal Child Psychology, 40, 555–567.CrossRefPubMed Normand, S., Flora, D. B., Toplak, M. E., & Tannock, R. (2012). Evidence for a general ADHD factor from a longitudinal general school population study. Journal of Abnormal Child Psychology, 40, 555–567.CrossRefPubMed
go back to reference Power, T. J., Doherty, B. J., Panichelli-Mindel, S. M., Karustis, J. L., Eiraldi, R. B., Anastopoulos, A. D., & DuPaul, G. J. (1998). The predictive validity of parent and teacher reports of ADHD symptoms. Journal of Psychopathology and Behavioral Assessment, 20, 57–81.CrossRef Power, T. J., Doherty, B. J., Panichelli-Mindel, S. M., Karustis, J. L., Eiraldi, R. B., Anastopoulos, A. D., & DuPaul, G. J. (1998). The predictive validity of parent and teacher reports of ADHD symptoms. Journal of Psychopathology and Behavioral Assessment, 20, 57–81.CrossRef
go back to reference Silverman, W. K., & Albano, A. M. (1996). The anxiety disorders interview schedule for DSM-IV: Child interview schedule. San Antonio: Psychological Corporation. Silverman, W. K., & Albano, A. M. (1996). The anxiety disorders interview schedule for DSM-IV: Child interview schedule. San Antonio: Psychological Corporation.
go back to reference Silverman, W. K., Saavedra, L. M., & Pina, A. A. (2001). Test-retest reliability of anxiety symptoms and diagnoses with anxiety disorders interview schedule for DSM-IV : Child and parent versions. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 937–944.CrossRefPubMed Silverman, W. K., Saavedra, L. M., & Pina, A. A. (2001). Test-retest reliability of anxiety symptoms and diagnoses with anxiety disorders interview schedule for DSM-IV : Child and parent versions. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 937–944.CrossRefPubMed
go back to reference Sprafkin, J., Gadow, K. D., Salisbury, H., Schneider, J., & Loney, J. (2002). Further evidence of reliability and validity of the child symptom Inventory-4: Parent checklist in clinically referred boys. Journal of Clinical Child and Adolescent Psychology, 31, 513–524.CrossRefPubMed Sprafkin, J., Gadow, K. D., Salisbury, H., Schneider, J., & Loney, J. (2002). Further evidence of reliability and validity of the child symptom Inventory-4: Parent checklist in clinically referred boys. Journal of Clinical Child and Adolescent Psychology, 31, 513–524.CrossRefPubMed
go back to reference Swanson, J., Schuck, S., Mann, M., Carlson, C., Hartman, K., Sergeant, J., Clevenger, W., Wasdell, M., & McCleary, R. (2006). Categorical and dimensional definitions and evaluations of symptoms of ADHD: The SNAP and SWAN rating scales. Irvine: University of California. Swanson, J., Schuck, S., Mann, M., Carlson, C., Hartman, K., Sergeant, J., Clevenger, W., Wasdell, M., & McCleary, R. (2006). Categorical and dimensional definitions and evaluations of symptoms of ADHD: The SNAP and SWAN rating scales. Irvine: University of California.
go back to reference Taylor, E., Chadwick, O., Heptinstall, E., & Danckaerts, M. (1996). Hyperactivity and conduct problems as risk factors for adolescent development. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1213–1226.CrossRefPubMed Taylor, E., Chadwick, O., Heptinstall, E., & Danckaerts, M. (1996). Hyperactivity and conduct problems as risk factors for adolescent development. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1213–1226.CrossRefPubMed
go back to reference Teegarden, L. A., & Burns, G. L. (1999). 12-month stability of ADHD, opposition defiant disorder, and conduct disorder symptoms in kindergarten through fifth grade children based on a single information source: Usefulness of teacher ratings for the creation and study of the ADHD subtypes. Child and Family Behavior Therapy, 21, 53–70.CrossRef Teegarden, L. A., & Burns, G. L. (1999). 12-month stability of ADHD, opposition defiant disorder, and conduct disorder symptoms in kindergarten through fifth grade children based on a single information source: Usefulness of teacher ratings for the creation and study of the ADHD subtypes. Child and Family Behavior Therapy, 21, 53–70.CrossRef
go back to reference Watkins, M. W. (2013). Omega [computer software]. Phoenix: Ed & Psych Associates. Watkins, M. W. (2013). Omega [computer software]. Phoenix: Ed & Psych Associates.
go back to reference Willcutt, E. G., & Carlson, C. L. (2005). The diagnostic validity of attention-deficit/hyperactivity disorder. Clinical Neuroscience Research, 5, 219–232.CrossRef Willcutt, E. G., & Carlson, C. L. (2005). The diagnostic validity of attention-deficit/hyperactivity disorder. Clinical Neuroscience Research, 5, 219–232.CrossRef
go back to reference Willcutt, E. G., Hartung, C. M., Lahey, B. B., Pelham, W. E., & Loney, J. (1999). Utility of behavior ratings made by examiners during assessments of children with attention-deficit/hyperactivity disorder. Journal of Abnormal Child Psychology, 27, 463–472.CrossRefPubMed Willcutt, E. G., Hartung, C. M., Lahey, B. B., Pelham, W. E., & Loney, J. (1999). Utility of behavior ratings made by examiners during assessments of children with attention-deficit/hyperactivity disorder. Journal of Abnormal Child Psychology, 27, 463–472.CrossRefPubMed
go back to reference Wolraich, M. L., Lambert, W., Doffing, M. A., Bickman, L., Simmons, T., & Worley, K. (2003). Psychometric properties of the Vanderbilt ADHD diagnostic parent rating scale in a referred population. Journal of Pediatric Psychology, 28, 559–567.CrossRefPubMed Wolraich, M. L., Lambert, W., Doffing, M. A., Bickman, L., Simmons, T., & Worley, K. (2003). Psychometric properties of the Vanderbilt ADHD diagnostic parent rating scale in a referred population.​ Journal of Pediatric Psychology, 28, 559–567.CrossRefPubMed
go back to reference Wu, A. D., Liu, Y., Gadermann, A. M., & Zumbo, B. D. (2010). Multiple-indicator multilevel growth model: A solution to multiple methodological challenges in longitudinal studies. Social Indicators Research, 97, 123–142.CrossRef Wu, A. D., Liu, Y., Gadermann, A. M., & Zumbo, B. D. (2010). Multiple-indicator multilevel growth model: A solution to multiple methodological challenges in longitudinal studies. Social Indicators Research, 97, 123–142.CrossRef
Metagegevens
Titel
Test-Retest Measurement Invariance of Clinic Referred Children’s ADHD Symptoms
Auteurs
Rapson Gomez
Alasdair Vance
Vasileios Stavropoulos
Publicatiedatum
27-11-2017
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 2/2018
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-017-9636-4

Andere artikelen Uitgave 2/2018

Journal of Psychopathology and Behavioral Assessment 2/2018 Naar de uitgave