Hostname: page-component-8448b6f56d-jr42d Total loading time: 0 Render date: 2024-04-18T12:31:28.994Z Has data issue: false hasContentIssue false
  • English
  • Français

Transdiagnostic validity of the MATRICS Consensus Cognitive Battery across the autism-schizophrenia spectrum

Published online by Cambridge University Press:  12 July 2019

Susan S. Kuo Open the ORCID record for Susan S. Kuo [Opens in a new window] ,
Jessica A. Wojtalik ,
Raquelle I. Mesholam-Gately ,
Matcheri S. Keshavan  and
Shaun M. Eack
Susan S. Kuo*
Affiliation:
Department of Psychology, University of Pittsburgh, Pittsburgh, PA, USA
Jessica A. Wojtalik
Affiliation:
School of Social Work, University of Pittsburgh, Pittsburgh, PA, USA
Raquelle I. Mesholam-Gately
Affiliation:
Massachusetts Mental Health Center Public Psychiatry Division, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
Matcheri S. Keshavan
Affiliation:
Massachusetts Mental Health Center Public Psychiatry Division, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
Shaun M. Eack
Affiliation:
School of Social Work, University of Pittsburgh, Pittsburgh, PA, USA Department of Psychiatry, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA
*
Author for correspondence: Susan S. Kuo, E-mail: susan.kuo@pitt.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Background

Autism Spectrum Disorder (ASD) and schizophrenia are neurodevelopmental disorders which share substantial overlap in cognitive deficits during adulthood. However, treatment evaluation in ASD and treatment comparisons across ASD and schizophrenia are limited by a dearth of empirical work establishing the validity of a standard cognitive battery across ASD and schizophrenia. Promisingly, the MATRICS Consensus Cognitive Battery (MCCB) has been validated in schizophrenia and encompasses cognitive domains that are impacted in ASD. Thus, this study aimed to establish MCCB's generalizability from schizophrenia to ASD.

Methods

Community-residing adults with schizophrenia (N = 100) and ASD (N = 113) underwent MCCB assessment. Using multigroup confirmatory factor analysis, MCCB's transdiagnostic validity was evaluated by examining whether schizophrenia and ASD demonstrate the same configuration, magnitude, and directionality of relationships within and among measures and their underlying cognitive domains.

Results

Across schizophrenia and ASD, the same subsets of MCCB measures inform three cognitive domains: processing speed, attention/working memory, and learning. Except for group means in category fluency, continuous performance, and spatial span, both groups show vastly comparable factor structures and characteristics.

Conclusions

To our knowledge, this study is the first to establish the validity of a standard cognitive battery in adults with ASD and furthermore the first to establish a cognitive battery's comparability across ASD and schizophrenia. Cognitive domain scores can be compared across new samples using weighted sums of MCCB scores resulting from this study. These findings highlight MCCB's applicability to ASD and support its utility for standardizing treatment evaluation of cognitive outcomes across the autism-schizophrenia spectrum.

Keywords

Attentioncognitive domaingeneral cognitionlatent variablelearningneurocognitionneurodevelopmental disorderprocessing speedworking memory
Type
Original Articles
Information
Psychological Medicine , Volume 50 , Issue 10 , July 2020 , pp. 1623 - 1632
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Altgassen, M, Koban, N and Kliegel, M (2012) Do adults with autism spectrum disorders compensate in naturalistic prospective memory tasks? Journal of Autism and Developmental Disorders 42, 2141–2151.CrossRefGoogle ScholarPubMed
Ambery, FZ, Russell, AJ, Perry, K, Morris, R and Murphy, DG (2006) Neuropsychological functioning in adults with Asperger syndrome. Autism 10, 551–564.CrossRefGoogle ScholarPubMed
Ammons, RB and Ammons, CH (1962) Quick test (QT): provisional manual. Psychological Reports 11, 111–161.CrossRefGoogle Scholar
Bölte, S, Rudolf, L and Poustka, F (2002) The cognitive structure of higher functioning autism and schizophrenia: a comparative study. Comprehensive Psychiatry 43, 325–330.CrossRefGoogle ScholarPubMed
Bramham, J, Ambery, F, Young, S, Morris, R, Russell, A, Xenitidis, K, Asherson, P and Murphy, D (2009) Executive functioning differences between adults with attention deficit hyperactivity disorder and autistic spectrum disorder in initiation, planning and strategy formation. Autism 13, 245–264.CrossRefGoogle ScholarPubMed
Burton, CZ, Vella, L, Harvey, PD, Patterson, TL, Heaton, RK and Twamley, EW (2013) Factor structure of the MATRICS consensus cognitive battery (MCCB) in schizophrenia. Schizophrenia Research 146, 244–248.CrossRefGoogle Scholar
Byrne, BM, Shavelson, RJ and Muthén, B (1989) Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychological Bulletin 105, 456.CrossRefGoogle Scholar
Charman, T, Jones, CRG, Pickles, A, Simonoff, E, Baird, G and Happé, F (2011) Defining the cognitive phenotype of autism. Brain Research 1380, 10–21.CrossRefGoogle ScholarPubMed
Chen, FF (2008) What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology 95, 1005–1018.CrossRefGoogle ScholarPubMed
Cheung, GW and Rensvold, RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling 9, 233–255.CrossRefGoogle Scholar
Cohen, D and Volkmar, F (1997) Autism and pervasive developmental disorders. Child and Adolescent Psychiatry 10, 282–285.Google Scholar
Couture, SM, Penn, DL, Losh, M, Adolphs, R, Hurley, R and Piven, J (2010) Comparison of social cognitive functioning in schizophrenia and high functioning autism: more convergence than divergence. Psychological Medicine 40, 569–579.CrossRefGoogle ScholarPubMed
David, N, Gawronski, A, Santos, NS, Huff, W, Lehnhardt, FG, Newen, A and Vogeley, K (2008) Dissociation between key processes of social cognition in autism: impaired mentalizing but intact sense of agency. Journal of Autism and Developmental Disorders 38, 593–605.CrossRefGoogle ScholarPubMed
de Boer, M, Spek, AA and Lobbestael, J (2014) Comparing cognitive functioning in schizophrenia and autism using WAIS-III. Research in Autism Spectrum Disorders 8, 737–745.CrossRefGoogle Scholar
Dickinson, D, Ragland, JD, Gold, JM and Gur, RC (2008) General and specific cognitive deficits in schizophrenia: goliath defeats David? Biological Psychiatry 64, 823–827.CrossRefGoogle ScholarPubMed
Dimitrov, DM (2010) Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development 43, 121–149.CrossRefGoogle Scholar
Eack, SM, Bahorik, AL, McKnight, SA, Hogarty, SS, Greenwald, DP, Newhill, CE, Phillips, ML, Keshavan, MS and Minshew, NJ (2013 a) Commonalities in social and non-social cognitive impairments in adults with autism spectrum disorder and schizophrenia. Schizophrenia Research 148, 24–28.CrossRefGoogle Scholar
Eack, SM, Greenwald, DP, Hogarty, SS, Bahorik, AL, Litschge, MY, Mazefsky, CA and Minshew, NJ (2013 b) Cognitive enhancement therapy for adults with autism spectrum disorder: results of an 18-month feasibility study. Journal of Autism and Developmental Disorders 43, 2866–2877.CrossRefGoogle ScholarPubMed
Fett, AK, Viechtbauer, W, Dominguez, MD, Penn, DL, van Os, J and Krabbendam, L (2011) The relationship between neurocognition and social cognition with functional outcomes in schizophrenia: a meta-analysis. Neuroscience and Biobehavioral Reviews 35, 573–588.CrossRefGoogle ScholarPubMed
Fett, AK, Shergill, SS and Krabbendam, L (2015) Social neuroscience in psychiatry: unravelling the neural mechanisms of social dysfunction. Psychological Medicine 45, 1145–1165.CrossRefGoogle ScholarPubMed
First, MB, Spitzer, RL, Gibbon, M and Williams, JB (1995) Structured Clinical Interview for DSM-IV Axis I Disorders. New York: New York State Psychiatric Institute.Google Scholar
Fried, R, Joshi, G, Bhide, P, Pope, A, Galdo, M, Koster, A, Chan, J, Faraone, SV and Biederman, J (2016) A study of the neuropsychological correlates in adults with high functioning autism spectrum disorders. Acta Neuropsychiatry 28, 286–295.CrossRefGoogle ScholarPubMed
Goldstein, G, Minshew, NJ, Allen, DN and Seaton, BE (2002) High-functioning autism and schizophrenia: a comparison of an early and late onset neurodevelopmental disorder. Archives of Clinical Neuropsychology 17, 461–475.CrossRefGoogle ScholarPubMed
Harvey, PD, Raykov, T, Twamley, EW, Vella, L, Heaton, RK and Patterson, TL (2013) Factor structure of neurocognition and functional capacity in schizophrenia: a multidimensional examination of temporal stability. Journal of the International Neuropsychological Society 19, 656–663.CrossRefGoogle ScholarPubMed
Hogarty, GE, Flesher, S, Ulrich, R, Carter, M, Greenwald, D, Pogue-Geile, M, Kechavan, M, Cooley, S, DiBarry, AL, Garrett, A, Parepally, H and Zoretich, R (2004) Cognitive enhancement therapy for schizophrenia: effects of a 2-year randomized trial on cognition and behavior. Archives of General Psychiatry 61, 866–876.CrossRefGoogle ScholarPubMed
Holdnack, J, Goldstein, G and Drozdick, L (2011) Social perception and WAIS-IV performance in adolescents and adults diagnosed with Asperger's syndrome and autism. Assessment 18, 192–200.CrossRefGoogle ScholarPubMed
Hu, L and Bentler, PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 6, 1–55.CrossRefGoogle Scholar
Insel, T, Cuthbert, B, Garvey, M, Heinssen, R, Pine, DS, Quinn, K, Sanislow, C and Wang, P (2010) Research Domain Criteria (RDoC): Toward a new classification framework for research on mental disorders. American Journal of Psychiatry 167, 751–758.CrossRefGoogle Scholar
Keefe, RSE, Davis, VG, Harvey, PD, Atkins, AS, Haig, GM, Hagino, O, Marder, S, Hilt, DC and Umbricht, D (2017) Placebo response and practice effects in schizophrenia cognition trials. JAMA Psychiatry 74, 807–814.CrossRefGoogle ScholarPubMed
Kline, RB (2015) Principles and Practice of Structural Equation Modeling. 4th ed. New York, NY: Guilford Publications.Google Scholar
Kraper, CK, Kenworthy, L, Popal, H, Martin, A and Wallace, GL (2017) The gap between adaptive behavior and intelligence in autism persists into young adulthood and is linked to psychiatric co-morbidities. Journal of Autism and Developmental Disorders 47, 3007–3017.CrossRefGoogle ScholarPubMed
Lo, SB, Szuhany, KL, Kredlow, MA, Wolfe, R, Mueser, KT and McGurk, SR (2016) A confirmatory factor analysis of the MATRICS consensus cognitive battery in severe mental illness. Schizophrenia Research 175, 79–84.CrossRefGoogle ScholarPubMed
Lord, C, Rutter, M and Le Couteur, A (1994) Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders 24, 659–685.CrossRefGoogle ScholarPubMed
Lord, C, Risi, S, Lambrecht, L, Cook, E Jr, Leventhal, B, DiLavore, P, Pickles, A and Rutter, M (2000) The Autism Diagnostic Observation Schedule–Generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders 30, 205–223.CrossRefGoogle ScholarPubMed
Magiati, I, Tay, XW and Howlin, P (2014) Cognitive, language, social and behavioural outcomes in adults with autism spectrum disorders: a systematic review of longitudinal follow-up studies in adulthood. Clinical Psychology Review 34, 73–86.CrossRefGoogle ScholarPubMed
Mançe Çalişir, Ö, Atbaşoğlu, EC, Devrımcı Özgüven, H and Ölmez, Ş (2018) Cognitive features of high-functioning adults with autism and schizophrenia spectrum disorders. Türk Psikiyatri Dergisi 29, 1–10.Google ScholarPubMed
Marinopoulou, M, Lugnegård, T, Hallerbäck, MU, Gillberg, C and Billstedt, E (2016) Asperger syndrome and schizophrenia: a comparative neuropsychological study. Journal of Autism and Developmental Disorders 46, 2292–2304.CrossRefGoogle ScholarPubMed
Meredith, W (1993) Measurement invariance, factor analysis and factorial invariance. Psychometrika 58, 525–543.CrossRefGoogle Scholar
Mesholam-Gately, RI, Giuliano, AJ, Goff, KP, Faraone, SV and Seidman, LJ (2009) Neurocognition in first-episode schizophrenia: a meta-analytic review. Neuropsychology 23, 315–336.CrossRefGoogle ScholarPubMed
Milfont, TL and Fischer, R (2010) Testing measurement invariance across groups: applications in crosscultural research. International Journal of Psychological Research 3, 111–130.CrossRefGoogle Scholar
Minshew, NJ and Goldstein, G (1998) Autism as a disorder of complex information processing. Mental Retardation and Developmental Disabilities Research Reviews 4, 129–136.3.0.CO;2-X>CrossRefGoogle Scholar
Miyajima, M, Omiya, H, Yamashita, K, Miyata, T, Yambe, K, Matsui, M and Denda, K (2016) The effects of cognitive remediation therapy using the frontal/executive program for autism spectrum disorder. International Journal of Psychiatry in Medicine 51, 223–235.CrossRefGoogle ScholarPubMed
Mohn, C, Lystad, JU, Ueland, T, Falkum, E and Rund, BR (2017) Factor analyzing the Norwegian MATRICS consensus cognitive battery. Psychiatry and Clinical Neurosciences 71, 336–345.CrossRefGoogle ScholarPubMed
Murphy, D (2003) Admission and cognitive details of male patients diagnosed with Asperger's syndrome detained in a special hospital: comparison with a schizophrenia and personality disorder sample. Journal of Forensic Psychiatry & Psychology 14, 506–524.CrossRefGoogle Scholar
Muthén, LK and Muthén, BO (2010) Mplus: Statistical Analysis with Latent Variables: User's Guide. Los Angeles: Muthén & Muthén.Google Scholar
Noh, J, Kim, JH, Hong, KS, Kim, N, Nam, HJ, Lee, D and Yoon, SC (2010) Factor structure of the neurocognitive tests: an application of the confirmative factor analysis in stabilized schizophrenia patients. Journal of Korean Medical Science 25, 276–282.CrossRefGoogle ScholarPubMed
Nuechterlein, KH, Green, MF, Kern, RS, Baade, LE, Barch, DM, Cohen, JD, Essock, S, Fenton, WS, Frese, FJ III, Gold, JM, Goldberg, T, Heaton, RK, Keefe, RS, Kraemer, H, Mesholam-Gately, R, Seidman, LJ, Stover, E, Weinberger, DR, Young, AS, Zalcman, S and Marder, SR (2008) The MATRICS consensus cognitive battery, part 1: test selection, reliability, and validity. American Journal of Psychiatry 165, 203–213.CrossRefGoogle ScholarPubMed
Okuda, T, Asano, K, Numata, N, Hirano, Y, Yamamoto, T, Tanaka, M, Matsuzawa, D, Shimizu, E, Iyo, M and Nakazato, M (2017) Feasibility of cognitive remediation therapy for adults with autism spectrum disorders: a single-group pilot study. Neuropsychiatric Disease and Treatment 13, 2185–2191.CrossRefGoogle ScholarPubMed
Otsuka, S, Uono, S, Yoshimura, S, Zhao, S and Toichi, M (2017) Emotion perception mediates the predictive relationship between verbal ability and functional outcome in high-functioning adults with autism spectrum disorder. Journal of Autism and Developmental Disorders 47, 1166–1182.CrossRefGoogle ScholarPubMed
Rapoport, JL, Addington, AM and Frangou, S (2005) The neurodevelopmental model of schizophrenia: update 2005. Molecular Psychiatry 10, 434–449.CrossRefGoogle ScholarPubMed
Sumiyoshi, C, Kawakubo, Y, Suga, M, Sumiyoshi, T and Kasai, K (2011) Impaired ability to organize information in individuals with autism spectrum disorders and their siblings. Neuroscience Research 69, 252–257.CrossRefGoogle ScholarPubMed
Torralva, T, Gleichgerrcht, E, Roca, M, Ibanez, A, Marenco, V, Rattazzi, A and Manes, F (2013) Impaired theory of mind but intact decision-making in asperger syndrome: implications for the relationship between these cognitive domains. Psychiatry Research 205, 282–284.CrossRefGoogle ScholarPubMed
Van de Schoot, R, Lugtig, P and Hox, J (2012) A checklist for testing measurement invariance. European Journal of Developmental Psychology 9, 486–492.CrossRefGoogle Scholar
Wechsler, D (1997) Administration and Scoring Manual: Wechsler Adult Intelligence Scale-Third Edition. San Antonio, TX: Psychological Corporation.Google Scholar
Wechsler, D (1999) Wechsler Abbreviated Scale of Intelligence (WASI). San Antonio, TX: The Psychological Corporation.Google Scholar
Wechsler, D (2011) Wechsler Abbreviated Scale of Intelligence- Second Edition (WASI-II). San Antonio, TX: NCS Pearson.Google Scholar
West, SG, Finch, JF and Curran, PJ (1995) Structural equation models with nonnormal variables: problems and remedies. In Hoyle, RH (ed.), Structural Equation Modeling: Concepts, Issues, and Applications. Thousand Oaks, CA: Sage Publications, pp. 56–75.Google Scholar
Wilson, CE, Happe, F, Wheelwright, SJ, Ecker, C, Lombardo, MV, Johnston, P, Daly, E, Murphy, CM, Spain, D, Lai, MC, Chakrabarti, B, Sauter, DA, Consortium, MA, Baron-Cohen, S and Murphy, DG (2014) The neuropsychology of male adults with high-functioning autism or Asperger syndrome. Autism Research 7, 568–581.CrossRefGoogle ScholarPubMed
Wykes, T, Huddy, V, Cellard, C, McGurk, SR and Czobor, P (2011) A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. American Journal of Psychiatry 168, 472–485.CrossRefGoogle ScholarPubMed
Supplementary material: File

Kuo et al. supplementary material

Kuo et al. supplementary material 1

Download Kuo et al. supplementary material(File)
File 31.4 KB