Skip to main content
Top
Gepubliceerd in:

01-09-2010 | Original Paper

Constructs Assessed by the GARS-2: Factor Analysis of Data from the Standardization Sample

Auteurs: Vincent Pandolfi, Caroline I. Magyar, Charles A. Dill

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 9/2010

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The GARS-2 (Gilliam 2006) is widely used for autism screening; however, the validity of its three conceptually-derived subscales has not been evaluated. In this study, exploratory (EFA) and confirmatory (CFA) factor analyses of data from matched subgroups of the standardization sample did not support the GARS-2 subscale structure. EFAs identified four factors in the model development subgroup (n = 496): stereotyped/repetitive behavior, stereotyped/idiosyncratic language, word use problems, and social impairment. CFAs supported this model in the replication subgroup (n = 494). Findings suggest that the GARS-2 subscales have limited clinical utility and that the Autism Index should be interpreted with caution. Although more research is needed, the clinical utility of the four empirically-derived scales may be limited by factors related to item content and test development procedures.
Voetnoten
1
Throughout this paper “autism” refers to DSM-IV-TR Autistic Disorder.
 
2
Level 1 screening discriminates those at risk for a developmental disorder from typically developing children. Level 2 screening discriminates those at risk for autism from those with other developmental disorders.
 
3
The Communication subscale is not administered to nonverbal individuals. The Autism Index is based on the Stereotyped Behavior and Social Interaction subscale standard scores.
 
4
Including all subjects would essentially result in a pairwise deletion of missing data in the analyses, and item correlations for factor analyses would be based on unequal sample sizes. Problems with this approach are discussed in Brown (2006).
 
5
The different sample size was an artifact of the random assignment procedure. An odd number of participants comprised some age-level groupings, and random assignment more often placed a final subject in the EFA group.
 
6
A total of 34 zero frequency cells were observed in the EFA dataset and 39 in the CFA dataset. This represented 0.25 and 0.28% of all cells in the EFA and CFA datasets, respectively. Since this was unlikely to significantly affect results, it was not necessary to delete items or collapse Likert categories.
 
7
These results are available upon request from the first author.
 
8
Factor pattern coefficients not presented to conserve space but are available upon request from the first author.
 
9
All test items are from the Gilliam Autism Rating Scale- Second Edition, by J.E. Gilliam, 2006, Austin, TX: PRO-ED, Inc. Copyright 1995, 2006 by PRO-ED, Inc. Used with permission.
 
10
Post-hoc invariance tests did not support tau equivalence for items within any factor. This means that items within the same scale measure different amounts of true score variance in their latent factor. Thus a congeneric model was accepted.
 
Literatuur
go back to reference Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families.
go back to reference American Academy of Pediatrics. (2007). Identification and evaluation of children with autism spectrum disorders. Pediatrics, 120, 1183–1215.CrossRef American Academy of Pediatrics. (2007). Identification and evaluation of children with autism spectrum disorders. Pediatrics, 120, 1183–1215.CrossRef
go back to reference American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders—Fourth edition: Text revision. Washington, DC: American Psychiatric Association.CrossRef American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders—Fourth edition: Text revision. Washington, DC: American Psychiatric Association.CrossRef
go back to reference Autism Spectrum Disorders Screening, Chap. 335, L.2008 (S.6527-B). Autism Spectrum Disorders Screening, Chap. 335, L.2008 (S.6527-B).
go back to reference Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.CrossRefPubMed Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.CrossRefPubMed
go back to reference Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606.CrossRef Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606.CrossRef
go back to reference Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press. Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York: Guilford Press.
go back to reference Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.CrossRef Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7(3), 309–319.CrossRef
go back to reference Coonrod, E. E., & Stone, W. L. (2005). Screening for autism in young children. In Paul. Volkmar & Cohen. Klin (Eds.), Handbook of autism and pervasive developmental disorders: Assessment, intervention, and policy (2nd ed., Vol. 2, pp. 707–729). Hoboken, NJ: John Wiley. Coonrod, E. E., & Stone, W. L. (2005). Screening for autism in young children. In Paul. Volkmar & Cohen. Klin (Eds.), Handbook of autism and pervasive developmental disorders: Assessment, intervention, and policy (2nd ed., Vol. 2, pp. 707–729). Hoboken, NJ: John Wiley.
go back to reference Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16–29.CrossRef Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16–29.CrossRef
go back to reference Dumont-Mathieu, T., & Fein, D. (2005). Screening for autism in young children: The Modified Checklist for Autism in Toddlers (M-CHAT) and other measures. Mental Retardation Developmental Disabilities Research Review, 11, 253–262.CrossRef Dumont-Mathieu, T., & Fein, D. (2005). Screening for autism in young children: The Modified Checklist for Autism in Toddlers (M-CHAT) and other measures. Mental Retardation Developmental Disabilities Research Review, 11, 253–262.CrossRef
go back to reference Eaves, R. C., Woods-Groves, S., Williams, T. O., & Fall, A. (2006). Reliability and validity of the Pervasive Developmental Disorders Rating Scale and the Gilliam Autism Rating Scale. Education and Training in Developmental Disabilities, 41(3), 300–309. Eaves, R. C., Woods-Groves, S., Williams, T. O., & Fall, A. (2006). Reliability and validity of the Pervasive Developmental Disorders Rating Scale and the Gilliam Autism Rating Scale. Education and Training in Developmental Disabilities, 41(3), 300–309.
go back to reference Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299.CrossRef Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7(3), 286–299.CrossRef
go back to reference Georgiades, S., Szatmari, P., Zwaigenbaum, L., Duku, E., Bryson, S., Roberts, W., et al. (2007). Structure of the autism symptom phenotype: A proposed multi-dimensional model. Journal of the American Academy of Child and Adolescent Psychiatry, 46(2), 188–196.CrossRefPubMed Georgiades, S., Szatmari, P., Zwaigenbaum, L., Duku, E., Bryson, S., Roberts, W., et al. (2007). Structure of the autism symptom phenotype: A proposed multi-dimensional model. Journal of the American Academy of Child and Adolescent Psychiatry, 46(2), 188–196.CrossRefPubMed
go back to reference Gilliam, J. E. (1995). Gilliam autism rating scale. Austin, TX: PRO-ED. Gilliam, J. E. (1995). Gilliam autism rating scale. Austin, TX: PRO-ED.
go back to reference Gilliam, J. E. (2006). Gilliam autism rating scale (2nd ed.). Austin, TX: PRO-ED. Gilliam, J. E. (2006). Gilliam autism rating scale (2nd ed.). Austin, TX: PRO-ED.
go back to reference Green, S. B., & Yang, Y. (2009). Commentary on coefficient alpha: A cautionary tale. Psychometrika, 74(1), 121–135.CrossRef Green, S. B., & Yang, Y. (2009). Commentary on coefficient alpha: A cautionary tale. Psychometrika, 74(1), 121–135.CrossRef
go back to reference Hu, L., & Bentler, P. M. (1999). Cutoff criterion for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef Hu, L., & Bentler, P. M. (1999). Cutoff criterion for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRef
go back to reference Joreskog, K., & Sorbom, D. (2006). LISREL 8.80. Lincolnwood, IL: Scientific Software International. Joreskog, K., & Sorbom, D. (2006). LISREL 8.80. Lincolnwood, IL: Scientific Software International.
go back to reference Krug, D. A., Arick, J. R., & Almond, P. J. (1993). Autism screening instrument for educational planning (2nd ed.). Austin, TX: Pro-Ed. Krug, D. A., Arick, J. R., & Almond, P. J. (1993). Autism screening instrument for educational planning (2nd ed.). Austin, TX: Pro-Ed.
go back to reference Lecavalier, L. (2005). An evaluation of the Gilliam Autism Rating Scale. Journal of Autism and Developmental Disorders, 35(6), 795–805.CrossRefPubMed Lecavalier, L. (2005). An evaluation of the Gilliam Autism Rating Scale. Journal of Autism and Developmental Disorders, 35(6), 795–805.CrossRefPubMed
go back to reference Lord, F. M., & Novick, M. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley. Lord, F. M., & Novick, M. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
go back to reference Lord, C., Rutter, M., DiLavore, P., & Risi, S. (2002). Autism diagnostic observation schedule: Manual. Los Angeles: Western Psychological Services. Lord, C., Rutter, M., DiLavore, P., & Risi, S. (2002). Autism diagnostic observation schedule: Manual. Los Angeles: Western Psychological Services.
go back to reference MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.CrossRef MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.CrossRef
go back to reference Mazefsky, C. A., & Oswald, D. P. (2006). The discriminative ability and diagnostic utility of the ADOS-G, ADI-R, and GARS for children in a clinical setting. Autism, 10(6), 533–549.CrossRefPubMed Mazefsky, C. A., & Oswald, D. P. (2006). The discriminative ability and diagnostic utility of the ADOS-G, ADI-R, and GARS for children in a clinical setting. Autism, 10(6), 533–549.CrossRefPubMed
go back to reference McGovern, C. W., & Sigman, M. (2005). Continuity and change from early childhood to adolescence in autism. Journal of Child Psychology and Psychiatry, 46(4), 401–408.CrossRefPubMed McGovern, C. W., & Sigman, M. (2005). Continuity and change from early childhood to adolescence in autism. Journal of Child Psychology and Psychiatry, 46(4), 401–408.CrossRefPubMed
go back to reference Mesibov, G. B., Schopler, E., Schaffer, B., & Michal, N. (1989). Use of the Childhood Autism Rating Scale (CARS) with autistic adolescents and adults. Journal of the American Academy of Child and Adolescent Psychiatry, 28, 538–541.CrossRefPubMed Mesibov, G. B., Schopler, E., Schaffer, B., & Michal, N. (1989). Use of the Childhood Autism Rating Scale (CARS) with autistic adolescents and adults. Journal of the American Academy of Child and Adolescent Psychiatry, 28, 538–541.CrossRefPubMed
go back to reference National Research Council. (2001). Educating children with autism. Washington, DC: National Academy Press. National Research Council. (2001). Educating children with autism. Washington, DC: National Academy Press.
go back to reference Netemeyer, R. G., Bearden, W. O., & Sharma, S. (2003). Scaling procedures: Issues and applications. Thousand Oaks, CA: Sage. Netemeyer, R. G., Bearden, W. O., & Sharma, S. (2003). Scaling procedures: Issues and applications. Thousand Oaks, CA: Sage.
go back to reference Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173–184.CrossRef Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21(2), 173–184.CrossRef
go back to reference Raykov, T. (2001). Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology, 54, 315–323.CrossRefPubMed Raykov, T. (2001). Estimation of congeneric scale reliability using covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology, 54, 315–323.CrossRefPubMed
go back to reference Rutter, M., LeCouteur, A. L., & Lord, C. (2003). Autism diagnostic interview—Revised. Los Angeles: Western Psychological Services. Rutter, M., LeCouteur, A. L., & Lord, C. (2003). Autism diagnostic interview—Revised. Los Angeles: Western Psychological Services.
go back to reference Salvia, J., & Ysseldyke, J. E. (2004). Assessment in special and inclusive education (9th ed.). Boston: Houghton Mifflin Company. Salvia, J., & Ysseldyke, J. E. (2004). Assessment in special and inclusive education (9th ed.). Boston: Houghton Mifflin Company.
go back to reference Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variable analysis: Applications to developmental research (pp. 399–419). Thousand Oaks, CA: Sage. Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variable analysis: Applications to developmental research (pp. 399–419). Thousand Oaks, CA: Sage.
go back to reference Schopler, E., Reichler, R. J., DeVellis, R. F., & Daly, K. (1980). Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS). Journal of Autism and Developmental Disorders, 10, 91–103.CrossRefPubMed Schopler, E., Reichler, R. J., DeVellis, R. F., & Daly, K. (1980). Toward objective classification of childhood autism: Childhood Autism Rating Scale (CARS). Journal of Autism and Developmental Disorders, 10, 91–103.CrossRefPubMed
go back to reference Schopler, E., Reichler, R. J., & Renner, B. R. (1988). The Childhood Autism Rating Scale (CARS). Los Angeles: Western Psychological Services. Schopler, E., Reichler, R. J., & Renner, B. R. (1988). The Childhood Autism Rating Scale (CARS). Los Angeles: Western Psychological Services.
go back to reference Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120.CrossRefPubMed Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74(1), 107–120.CrossRefPubMed
go back to reference Sikora, D. M., Hall, T. A., Hartley, S. L., Gerrard-Morris, A. E., & Cagle, S. (2008). Does parent report of behavior differ across ADOS-G classifications: Analysis of scores from the CBCL and GARS. Journal of Autism and Developmental Disorders, 38, 440–448.CrossRefPubMed Sikora, D. M., Hall, T. A., Hartley, S. L., Gerrard-Morris, A. E., & Cagle, S. (2008). Does parent report of behavior differ across ADOS-G classifications: Analysis of scores from the CBCL and GARS. Journal of Autism and Developmental Disorders, 38, 440–448.CrossRefPubMed
go back to reference Smith, G. T., & McCarthy, D. M. (1995). Methodological considerations in the refinement of clinical assessment instruments. Psychological Assessment, 7(3), 300–308.CrossRef Smith, G. T., & McCarthy, D. M. (1995). Methodological considerations in the refinement of clinical assessment instruments. Psychological Assessment, 7(3), 300–308.CrossRef
go back to reference South, M., Williams, B. J., McMahon, W. M., Owley, T., Filipek, P. A., Shernoff, E., et al. (2002). Utility of the Gilliam Autism Rating Scale in research and clinical populations. Journal of Autism and Developmental Disorders, 32(6), 593–599.CrossRefPubMed South, M., Williams, B. J., McMahon, W. M., Owley, T., Filipek, P. A., Shernoff, E., et al. (2002). Utility of the Gilliam Autism Rating Scale in research and clinical populations. Journal of Autism and Developmental Disorders, 32(6), 593–599.CrossRefPubMed
go back to reference Steiger, J. H., & Lind, J. M. (1980). Statistically based tests for the number of common factors. Paper presented at the meeting of the Psychometric Society, Iowa City, IA. Steiger, J. H., & Lind, J. M. (1980). Statistically based tests for the number of common factors. Paper presented at the meeting of the Psychometric Society, Iowa City, IA.
go back to reference Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Pearson Education. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Pearson Education.
go back to reference Volkmar, F. R. (2005). International perspectives. In F. R. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and pervasive developmental disorders: Assessment, interventions, and policy (2nd ed., Vol. 2, pp. 1193–1252). Hoboken, NJ: John Wiley. Volkmar, F. R. (2005). International perspectives. In F. R. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and pervasive developmental disorders: Assessment, interventions, and policy (2nd ed., Vol. 2, pp. 1193–1252). Hoboken, NJ: John Wiley.
go back to reference Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58–79.CrossRefPubMed Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12(1), 58–79.CrossRefPubMed
Metagegevens
Titel
Constructs Assessed by the GARS-2: Factor Analysis of Data from the Standardization Sample
Auteurs
Vincent Pandolfi
Caroline I. Magyar
Charles A. Dill
Publicatiedatum
01-09-2010
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 9/2010
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-010-0967-1

Andere artikelen Uitgave 9/2010

Journal of Autism and Developmental Disorders 9/2010 Naar de uitgave