Top

Journal of Psychopathology and Behavioral Assessment

Gepubliceerd in:

12-06-2023

Two Times the Charm: Repeat Administration of the CPT-II Improves Its Classification Accuracy as a Performance Validity Index

Auteurs: Anthony Robinson, Matthew Calamia, Nathanael Penner, Noor Assaf, Parveen Razvi, Robert M Roth, Laszlo A Erdodi

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 3/2023

Abstract

The Conners’ Continuous Performance Test – Second Edition (CPT-II) has demonstrated utility as a performance validity test (PVT). Early research also identified several benefits of repeat administration. This study was designed to evaluate the potential of repeat administrations of the CPT-II to enhance its clinical utility in detecting ADHD or non-credible responding. Data were collected from a consecutive case sequence of 100 patients (M_Age = 41.5; M_Education = 13.8) referred for neuropsychological assessment. Performance validity was psychometrically defined using a combination of free-standing and embedded PVTs. The CPT-II was administered twice to all patients: once in the morning and once at the end of the testing appointment. Data supported previously identified validity cutoffs for the CPT-II, with the notable exception of Commission errors. Patients with ADHD were less likely to fail validity cutoffs than those without ADHD, suggesting that ADHD alone does not explain failure on PVTs. At Time 1, the CPT-II was insensitive to a clinical diagnosis of ADHD; at Time 2, only one significant contrast emerged. Self-report measures more effectively differentiated between patients with and without ADHD. Test-retest reliability was generally higher in patients with valid performance (0.33-0.83) compared to those with invalid performance (0.38-0.77), with notable variation across scales. Two sets of CPT-II scores increased confidence in the ADHD diagnosis and the remainder of the neurocognitive profile. The CPT-II is self-administered and automatically scored, making routine double administration more practical than might first be thought.

volgende artikel Development and Psychometric Properties of the Youth Emotions Scale

Abeare, C., Messa, I., Whitfield, C., Zuccato, B., Casey, J., & Erdodi, L. (2019). Performance validity in collegiate football athletes at baseline neurocognitive testing. Journal of Head Trauma Rehabilitation, 34(4), 20–31. https://doi.org/10.1097/HTR.0000000000000451CrossRef

Abeare, K., Romero, K., Cutler, L., Sirianni, C. D., & Erdodi, L. A. (2021). Flipping the script: Measuring both performance validity and cognitive ability with the forced choice Recognition Trial of the RCFT. Perceptual and Motor Skills, 128(4), 1373–1408. https://doi.org/10.1177/00315125211019704CrossRefPubMedPubMedCentral

Armistead-Jehle, P., Cooper, D. B., & Vanderploeg, R. D. (2016). The role of performance validity tests in the assessment of cognitive functioning after military concussion: A replication and extension. Applied Neuropsychology: Adult, 23(4), 264–273. https://doi.org/10.1080/23279095.2015.1055564CrossRefPubMed

Arnold, G., Boone, K. B., Lu, P., Dean, A., Wen, J., Nitch, S., & McPherson, S. (2005). Sensitivity and specificity of finger tapping test scores for the detection of suspect effort. The Clinical Neuropsychologist, 19(1), 105–120. https://doi.org/10.1080/13854040490888567CrossRefPubMed

Ashendorf, L. (2019). Rey Auditory Verbal Learning Test and Rey-Osterrieth Complex figure test performance validity indices in a VA Polytrauma sample. The Clinical neuropsychologist, 33(8), 1388–1402. https://doi.org/10.1080/13854046.2018.1543454CrossRefPubMed

Ashendorf, L., Clark, E. L., & Humphreys, C. T. (2021). The Rey 15-Item memory test in US veterans. Journal of Clinical and Experimental Neuropsychology, 43(3), 324–331. https://doi.org/10.1080/13803395.2021.1932761CrossRefPubMed

Ashendorf, L., Clark, E. L., & Sugarman, M. A. (2017). Performance validity and processing speed in a VA Polytrauma sample. The Clinical Neuropsychologist, 31(5), 857–866. https://doi.org/10.1080/13854046.2017.1285961CrossRefPubMed

Axelrod, B. N., Fichtenberg, N. L., Millis, S. R., & Wertheimer, J. C. (2006). Detecting incomplete effort with Digit Span from the Wechsler Adult Intelligence Scale-Third Edition. The Clinical Neuropsychologist, 20(3), 513–523. https://doi.org/10.1080/13854040590967117CrossRefPubMed

Axelrod, B. N., Meyers, J. E., & Davis, J. J. (2014). Finger tapping test performance as a measure of performance validity. The Clinical neuropsychologist, 28(5), 876–888. https://doi.org/10.1080/13854046.2014.907583CrossRefPubMed

Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145–159. https://doi.org/10.1080/13854040590947362CrossRefPubMed

Baggio, S., Hasler, R., Giacomini, V., El-Masri, H., Weibel, S., Perroud, N., & Deiber, M. P. (2020). Does the continuous performance test predict ADHD symptoms severity and ADHD presentation in adults? Journal of Attention Disorders, 24(6), 840–848. https://doi.org/10.1177/1087054718822060CrossRefPubMed

Balint, S., Czobor, P., Komlosi, S., Meszaros, A., Simon, V., & Bitter, I. (2009). Attention deficit hyperactivity disorder (ADHD): Gender- and age-related differences in neurocogntion. Psychological Medicine, 39, 1337–1345.CrossRefPubMed

Beck, A. T., & Steer, R. A. (1993). Beck anxiety Inventory Manual. San Antonio, TX: Psychological Corporation.

Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory – Second Edition. San Antonio, TX: Psychological Corporation.

Berger, C., Lev, A., Braw, Y., Elbaum, T., Wagner, M., & Rassovsky, Y. (2021). Detection of feigned ADHD using the MOXO-d-CPT. Journal of Attention Disorders, 25(7), 1032–1047. https://doi.org/10.1177/1087054719864656CrossRefPubMed

Berger, I., Slobodin, O., & Cassuto, H. (2017). Usefulness and validity of continuous performance tests in the diagnosis of attention-deficit hyperactivity disorder children. Archives of Clinical Neuropsychology, 32(1), 81–93. https://doi.org/10.1093/arclin/acw101CrossRefPubMed

Bigler, E. D. (2014). Effort, symptom validity testing, performance validity testing and traumatic brain injury. Brain Injury, 28(13–14), 1623–1638. https://doi.org/10.3109/02699052.2014.947627CrossRefPubMedPubMedCentral

Bigler, E. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444. https://doi.org/10.1007/s11682-015-9409-1CrossRefPubMed

Blaskewitz, N., Merten, T., & Brockhaus, R. (2009). Detection of suboptimal effort with the Rey Complex figure test and Recognition Trial. Applied Neuropsychology, 16(1), 54–61. https://doi.org/10.1080/09084280802644227CrossRefPubMed

Bluschke, A., Zink, N., Mückschel, M., Roessner, V., & Beste, C. (2021). A novel approach to intra-individual performance variability in ADHD. European Child & Adolescent Psychiatry, 30(5), 733–745. https://doi.org/10.1007/s00787-020-01555-yCrossRef

Boone, K. B. (2009). The need for continuous and comprehensive sampling of effort/response bias during neuropsychological examination. The Clinical Neuropsychologist, 23(4), 729–741. https://doi.org/10.1080/13854040802427803CrossRefPubMed

Boone, K. B. (2013). Clinical practice of forensic neuropsychology. New York, NY: Guilford.

Boonstra, A. M., Oosterlaan, J., Sergeant, J. A., & Buitelaar, J. K. (2005). Executive functioning in adult ADHD: A meta-analytic review. Psychological Medicine, 35(8), 1097–1108. https://doi.org/10.1017/s003329170500499xCrossRefPubMed

Bordoff, B. (2017). The challenges and limitations of diagnosing and pharmacologically treating ADHD in university students. Psychological Injury and Law, 10(2), 114–120.CrossRef

Bortnik, K. E., & Dean, A. C. (2021). Performance validity testing in patients with dementia. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 481–503). The Guilford Press.

Boucher, C., May, N., Shahein, A., Roth, R. M., & Erdodi, L. A. (2023). Examining the effect of repeat administration, alternate versions and performance validity on letter fluency tests in a mixed clinical sample. Psychology and neuroscience. Advance online publication.

Busse, M., & Whiteside, D. (2012). Detecting suboptimal cognitive effort: Classification accuracy of the Conner’s continuous performance Test-II, brief test of attention, and trail making test. The Clinical Neuropsychologist, 26(4), 675–687. https://doi.org/10.1080/13854046.2012.679623CrossRefPubMed

Castellanos, F. X., Sonuga-Barke, E. J., Milham, M. P., & Tannock, R. (2006). Characterizing cognition in ADHD: Beyond executive dysfunction. Trends in Cognitive Sciences, 10(3), 117–123.CrossRefPubMed

Chafetz, M. D. (2022). Deception is different: Negative validity test findings do not provide “evidence” for “good effort. The Clinical Neuropsychologist, 36(6), 1244–1264. https://doi.org/10.1080/13854046.2020.1840633CrossRefPubMed

Conners, C. K. (2004). Conners’ continuous performance test II. Toronto, Canada: Multi-Health Systems, Inc.

Conners, C. K. (2014). Conners’ continuous performance test – 3rd Edition (CPT-3) manual. Toronto, ON: Multi-Health Systems.

Crişan, I., Sava, F. A., Maricuţoiu, L. P., Ciumăgeanu, M. D., Axinia, O., Gîrniceanu, L., & Ciotlăuş, L. (2021). Evaluation of various detection strategies in the assessment of noncredible memory performance: Results of two experimental studies. Assessment. Advance online publication. https://doi.org/10.1177/10731911211040105

Curtis, K. L., Greve, K. W., Bianchini, K. J., & Brennan, A. (2006). California Verbal Learning Test indicators of Malingered Neurocognitive Dysfunction: Sensitivity and specificity in traumatic brain injury. Assessment, 13(1), 46–61. https://doi.org/10.1177/1073191105285210CrossRefPubMed

Dandachi-FitzGerald, B., Duits, A. A., Leentjens, A. F. G., Verhey, F. R. J., & Ponds, R. W. H. M. (2020a). Performance and symptom validity assessment in patients with apathy and cognitive impairment. Journal of the International Neuropsychological Society, 26, 314–321. https://doi.org/10.1017/S1355617719001139CrossRefPubMed

Dandachi-FitzGerald, B., Merckelbach, H., Boskovic, I., & Jelicic, M. (2020b). Do you know people who feign? Proxy respondents about feigned symptoms. Psychological Injury and Law, 13, 225–234. https://doi.org/10.1007/s12207-020-09387-6CrossRef

Davis, J. J. (2014). Further consideration of Advanced Clinical Solutions Word choice: Comparison to the Recognition Memory Test-words and classification accuracy in a clinical sample. The Clinical Neuropsychologist, 28(8), 1278–1294. https://doi.org/10.1080/13854046.2014.975844CrossRefPubMed

Dean, A. C., Victor, T. L., Boone, K. B., Philpott, L. M., & Hess, R. A. (2009). Dementia and effort test performance. The Clinical Neuropsychologist, 23(1), 133–152. https://doi.org/10.1080/13854040701819050CrossRefPubMed

Delis, D. C., Kaplan, E., & Kramer, J. (2001). Delis-Kaplan executive function system. San Antonio, TX: Psychological Corporation.

Delis, D. C., Kramer, J. H., Kaplan, E., & Ober, B. A. (2000). California Verbal Learning Test (2nd ed.). San Antonio, TX: Psychological Corporation.

Eglit, G., Jurick, S. M., Delis, D. C., Filoteo, J. V., Bondi, M. W., & Jak, A. J. (2020). Utility of the D-KEFS Color Word Interference Test as an embedded measure of performance validity. The Clinical Neuropsychologist, 34(2), 332–352. https://doi.org/10.1080/13854046.2019.1643923CrossRefPubMed

Erdodi, L. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. Neurorehabilitation, 49(2), 179–213. https://doi.org/10.3233/NRE-218020CrossRefPubMed

Erdodi, L. A. (2022). Multivariate Models of Performance Validity: The Erdodi Index captures the dual nature of non-credible responding (continuous and categorical). Assessment, 10731911221101910, https://doi.org/10.1177/10731911221101910. Advance online publication.

Erdodi, L. A., & Abeare, C. A. (2020). Stronger together: The Wechsler Adult Intelligence Scale-Fourth Edition as a Multivariate Performance Validity Test in patients with traumatic brain Injury. Archives of clinical Neuropsychology, 35(2), 188–204. https://doi.org/10.1093/arclin/acz032CrossRefPubMed

Erdodi, L. A., Abeare, C. A., Lichtenstein, J. D., Tyson, B. T., Kucharski, B., Zuccato, B. G., & Roth, R. M. (2017a). Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV) processing speed scores as measures of noncredible responding: The third generation of embedded performance validity indicators. Psychological Assessment, 29(2), 148–157. 10.1037/pas0000319.CrossRefPubMed

Erdodi, L. A., Kirsch, N. L., Lajiness-O’Neill, R., Vingilis, E., & Medoff, B. (2014a). Comparing the Recognition Memory Test and the Word Choice Test in a Mixed Clinical Sample: Are They Equivalent?. Psychological Injury. and Law 7, 255–263 (2014a). https://doi.org/10.1007/s12207-014-9197-8

Erdodi, L. A., & Lajiness-O’Neill, R. (2014). Time-related changes in Conners’ CPT-II scores: A replication study. Applied neuropsychology Adult, 21(1), 43–50. https://doi.org/10.1080/09084282.2012.724036CrossRefPubMed

Erdodi, L. A., Lajiness-O’Neill, R., & Saules, K. K. (2010). Order of Conners’ CPT-II administration within a cognitive test battery influences ADHD indices. Journal of attention disorders, 14(1), 43–51. https://doi.org/10.1177/1087054709347199CrossRefPubMed

Erdodi, L. A., & Lichtenstein, J. D. (2017). Invalid before impaired: An emerging paradox of embedded validity indicators. The Clinical Neuropsychologist, 31(6–7), 1029–1046. https://doi.org/10.1080/13854046.2017.1323119CrossRefPubMed

Erdodi, L. A., & Lichtenstein, J. D. (2021). Information processing speed tests as performance validity tests. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (pp. 218–247). The Guilford Press.

Erdodi, L. A., Pelletier, C. L., & Roth, R. M. (2018a). Elevations on select Conners’ CPT-II scales indicate noncredible responding in adults with traumatic brain injury. Applied Neuropsychology: Adult, 25(1), 19–28. 10.1080/23279095.2016.1232262.CrossRefPubMed

Erdodi, L. A., Roth, R. M., Kirsch, N. L., Lajiness-O’Neill, R., & Medoff, B. (2014b). Aggregating validity indicators embedded in conners‘ CPT-II outperforms individual cutoffs at separating valid from invalid performance in adults with traumatic brain injury. Archives of Clinical Neuropsychology, 29(5), 456–466. 10.1093/arclin/acu02.CrossRefPubMed

Erdodi, L. A., Sabelli, A. G., An, K. Y., Hastings, M., McCoy, C., & Abeare, C. A. (2020). Introducing a Five-Variable Psychiatric Screener based on the Visual Analog Scale (V-5). Psychology & Neuroscience, 13(2), 219–239. https://doi.org/10.1037/pne0000201CrossRef

Erdodi, L. A., Sagar, S., Seke, K., Zuccato, B. G., Schwartz, E. S., & Roth, R. M. (2018b). The Stroop test as a measure of performance validity in adults clinically referred for neuropsychological assessment. Psychological Assessment, 30(6), 755–766. https://doi.org/10.1037/pas0000525CrossRefPubMed

Erdodi, L. A., Taylor, B., Sabelli, A., Malleck, M., Kirsch, N. L., & Abeare, C. A. (2019). Demographically adjusted validity cutoffs in the finger tapping test are superior to raw score cutoffs. Psychological Injury and Law, 12(2), 113–126. https://doi.org/10.1007/s12207-019-09352-yCrossRef

Erdodi, L. A., Tyson, B. T., Shahein, A. G., Lichtenstein, J. D., Abeare, C. A., Pelletier, C. L., Zuccato, B. G., Kucharski, B., & Roth, R. M. (2017b). The power of timing: Adding a time-to-completion cutoff to the Word Choice Test and Recognition Memory Test improves classification accuracy. Journal of Clinical and Experimental Neuropsychology, 39(4), 369–383. https://doi.org/10.1080/13803395.2016.1230181CrossRefPubMed

Etherton, J. L., Bianchini, K. J., Heinly, M. T., & Greve, K. W. (2006). Pain, malingering, and performance on the WAIS-III Processing Speed Index. Journal of Clinical and Experimental Neuropsychology, 28, 1218–1237. https://doi.org/10.1080/13803390500346595CrossRefPubMed

Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18(3), 543–555. https://doi.org/10.1037/0894-4105.18.3.543CrossRefPubMed

Gervais, R. O., Russell, A. S., Green, P., Allen, L. M., Ferrari, R., & Pieschl, S. D. (2001). Effort testing in patients with fibromyalgia and disability incentives. The Journal of Rheumatology, 28(8), 1892–1899.PubMed

Giromini, L., Young, G., & Sellbom, M. (2022). Assessing negative response bias using self-report measures: New articles, new issues. Psychological Injury and Law, 15(1), 1–21. https://doi.org/10.1007/s12207-022-09444-2CrossRef

Gonzalez-Gadea, M. L., Baez, S., Torralva, T., Castellanos, F. X., Rattazzi, A., Bein, V., & Ibanez, A. (2013). Cognitive variability in adults with ADHD and AS: Disentangling the roles of executive functions and social cognition. Research in Developmental Disabilities, 34(2), 817–830.CrossRefPubMed

Green, P., Rohling, M., Lees-Haley, L., P. P., & Allen, L. M. (2001). Effort has a greater effect on test scores than severe brain injury in compensation claimants. Brain Injury, 15(12), 1045–1060.CrossRefPubMed

Greve, K. W., Heinly, M. T., Bianchini, K. J., & Love, J. M. (2009a). Malingering detection with the Wisconsin Card sorting test in mild traumatic brain injury. The Clinical Neuropsychologist, 23(2), 343–362. https://doi.org/10.1080/13854040802054169CrossRefPubMed

Greve, K. W., Ord, J. S., Bianchini, K. J., & Curtis, K. L. (2009b). Prevalence of malingering in patients with chronic pain referred for psychologic evaluation in a medico-legal context. Archives of Physical Medicine and Rehabilitation, 90(7), 1117–1126. https://doi.org/10.1016/j.apmr.2009b.01.018CrossRefPubMed

Guilmette, T. J., Sweet, J. J., Hebben, N., Koltai, D., Mahone, E. M., Spiegler, B. J., Stucky, K., & Westerveld, M. (2020). & Conference Participants American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34(3), 437–453. https://doi.org/10.1080/13854046.2020.1722244

Harrison, A. G. (2017). Clinical, ethical and forensic implications of a flexible threshold for LD and ADHD in postsecondary settings. Psychological Injury and Law, 10, 138–150.CrossRef

Harrison, A. G., & Armstrong, I. (2022). Accommodation decision-making for postsecondary students with ADHD: Treating the able as disabled. Psychological Injury and Law. Advance online publication. https://doi.org/10.1007/s12207-022-09461-1

Harrison, A. G., & Edwards, M. J. (2010). Symptom exaggeration in post-secondary students: Preliminary base rates in a canadian sample. Applied Neuropsychology, 17(2), 135–143. https://doi.org/10.1080/09084281003715642CrossRefPubMed

Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtis, G. (1993). Wisconsin Card sorting test (WCST) manual revised and expanded. Odessa, FL: Psychological Assessment Resources.

Heinly, M. T., Greve, K. W., Bianchini, K. J., Love, J. M., & Brennan, A. (2005). WAIS digit span-based indicators of malingered neurocognitive dysfunction: Classification accuracy in traumatic brain injury. Assessment, 12(4), 429–444. https://doi.org/10.1177/1073191105281099CrossRefPubMed

Hervey, A. S., Epstein, J. N., & Curry, J. F. (2004). Neuropsychology of adults with attention-deficit/hyperactivity disorder: A meta-analytic review. Neuropsychology, 18, 485–503.CrossRefPubMed

Holcomb, M. J., Roth, R. M., Tyson, B. T., & Erdodi, L. A. (2022b). Critical item (CR) analysis expands the classification accuracy of performance validity tests based on the forced choice paradigm—Replicating previously introduced CR cutoffs within the Word Choice Test. Neuropsychology Advance online publication. https://doi.org/10.1037/neu0000834

Holcomb, M., Pyne, S., Cutler, L., Oikle, D. A., & Erdodi, L. A. (2022a). Take their word for it: The Inventory of Problems provides valuable information on both symptom and performance validity. Journal of Personality Assessment. Advance online publication. https://doi.org/10.1080/00223891.2022a.2114358

Hurtubise, J. L., Scavone, A., Sagar, S., & Erdodi, L. A. (2017). Psychometric markers of genuine and feigned neurodevelopmental disorders in the context of applying for academic accommodations. Psychological Injury and Law, 10(2), 121–137. https://doi.org/10.1007/s12207-017-9287-5CrossRef

Jodzio, K., & Biechowska, D. (2010). Wisconsin card sorting test as a measure of executive function impairments in stroke patients. Applied Neuropsychology, 17(4), 267–277. https://doi.org/10.1080/09084282.2010.525104CrossRefPubMed

Jones, E. F., Pritchard, A., Jacobson, L. A., Mahone, E. M., & Zabel, T. A. (2021). How much testing can a kid take? Feasibility of collecting pediatric patient experience ratings of neuropsychological and psychological assessment. Applied Neuropsychology: Child, 11(4), 610–617. https://doi.org/10.1080/21622965.2021.1917410CrossRefPubMed

Kim, M. S., Boone, K. B., Victor, T., Marion, S. D., Amano, S., Cottingham, M. E., Ziegler, E. A., & Zeller, M. A. (2010). The Warrington Recognition Memory Test for words as a measure of response bias: Total score and response time cutoffs developed on “real world” credible and noncredible subjects. Archives of Clinical Neuropsychology, 25(1), 60–70. https://doi.org/10.1093/arclin/acp088CrossRefPubMed

Klein, C., Wendling, K., Huettner, P., Ruder, H., & Peper, M. (2006). Intra-subject variability in attention-deficit hyperactivity disorder. Biological Psychiatry, 60(10), 1088–1097.CrossRefPubMed

Kosky, K. M., Lace, J. W., Austin, T. A., Seitz, D. J., & Clark, B. (2022). The utility of the Wisconsin card sorting test, 64-card version to detect noncredible attention-deficit/hyperactivity disorder. Applied Neuropsychology: Adult, 29(5), 1231–1241. https://doi.org/10.1080/23279095.2020.1864633CrossRefPubMed

Kura, K. (2013). Japanese north–south gradient in IQ predicts differences in stature, skin color, income, and homicide rate. Intelligence, 41(5), 512–516.CrossRef

Lange, R. T., Iverson, G. L., Brickell, T. A., Staver, T., Pancholi, S., Bhagwat, A., & French, L. M. (2013). Clinical utility of the Conners’ continuous performance Test-II to detect poor effort in U.S. Military personnel following traumatic brain injury. Psychological Assessment, 25(2), 339–352. https://doi.org/10.1037/a0030915CrossRefPubMed

Larrabee, G. J. (2003). Detection of malingering using atypical performance patterns on standard neuropsychological tests. The Clinical Neuropsychologist, 17(3), 410–425. https://doi.org/10.1076/clin.17.3.410.18089CrossRefPubMed

Larrabee, G. J. (2014). False-positive rates associated with the use of multiple performance and symptom validity tests. Archives of Clinical Neuropsychology, 29(4), 364–373. https://doi.org/10.1093/arclin/acu019CrossRefPubMed

Lee, A., Boone, K. B., Lesser, I., Wohl, M., Wilkins, S., & Parks, C. (2000). Performance of older depressed patients on two cognitive malingering tests: False positive rates for the Rey 15-item memorization and dot counting tests. The Clinical Neuropsychologist, 14(3), 303–308. https://doi.org/10.1076/1385-4046(200008)14:3;1-P;FT303CrossRefPubMed

Lichtenstein, J. D., Greenacre, M. K., Cutler, L., Abeare, K., Baker, S. D., Kent, K., Ali, J., S., & Erdodi, L. A. (2019). Geographic variation and instrumentation artifacts: in search of confounds in performance validity assessment in adults with mild TBI. Psychological Injury and Law, 12(2), 127–145. doi.10.1007/s12207-019-0935

Lin, H. Y., Hwang-Gu, S. L., & Gau, S. F. (2015). Intra‐individual reaction time variability based on ex‐gaussian distribution as a potential endophenotype for attention‐deficit/hyperactivity disorder. Acta Psychiatrica Scandinavica, 132(1), 39–50. https://doi.org/10.1111/acps.12393CrossRefPubMed

Lippa, S. M. (2018). Performance validity testing in neuropsychology: A clinical guide, critical review, and update on a rapidly evolving literature. The Clinical Neuropsychologist, 32(3), 391–421. https://doi.org/10.1080/13854046.2017.1406146. https://doi-org.libezp.lib.lsu.edu/CrossRefPubMed

Lovett, B. J., & Harrison, A. G. (2021). Assessing adult ADHD: New research and perspectives. Journal of Clinical and Experimental Neuropsychology, 43(4), 333–339. https://doi.org/10.1080/13803395.2021.1950640CrossRefPubMed

Lynn, R. (2010). In Italy, north–south differences in IQ predict differences in income, education, infant mortality, stature, and literacy. Intelligence, 38(1), 93–100.CrossRef

Marshall, P., Schroeder, R., O’Brien, J., Fischer, R., Ries, A., Blesi, B., & Barker, J. (2010). Effectiveness of symptom validity measures in identifying cognitive and behavioral symptom exaggeration in adult attention deficit hyperactivity disorder. The Clinical Neuropsychologist, 24, 1204–1237. https://doi.org/10.1080/13854046.2010.514290CrossRefPubMed

Martin, P. K., & Schroeder, R. W. (2020). Base rates of invalid test performance across clinical non-forensic contexts and settings. Archives of Clinical Neuropsychology, 35(6), 717–725. https://doi.org/10.1093/arclin/acaa017CrossRefPubMed

McDaniel, M. A. (2006). Estimating state IQ: Measurement challenges and preliminary correlates. Intelligence, 34(6), 607–619.CrossRef

Medici, R. (2013). The use of multiple performance validity tests. Journal of Forensic Psychology Practice, 13(1), 68–78. https://doi.org/10.1080/15228932.2013.746909CrossRef

Merten, T., Kaminski, A., & Pfeiffer, W. (2020). Prevalence of overreporting on symptom validity tests in a large sample of psychosomatic rehabilitation inpatients. The Clinical Neuropsychologist, 34(5), 1004–1024. https://doi.org/10.1080/13854046.2019.1694073CrossRefPubMed

Merten, T., & Rogers, R. (2017). An international perspective on feigned mental disabilities: Conceptual issues and continuing controversies. Behavioral Sciences and the Law, 35, 97–112. https://doi.org/10.1002/bsl.2274CrossRefPubMed

Messa, L., Holcomb, M., Lichtenstein, J. D., Tyson, B. T., Roth, R. M., & Erdodi, L. A. (2021). They are not destined to fail: A systematic examination of scores on embedded performance validity indicators in patients with intellectual disability. Australian Journal of Forensic Sciences. https://doi.org/10.1080/00450618.2020.1865457. Advance Online Publication.CrossRef

Mittenberg, W., Patton, C., Canyock, E. M., & Condit, D. C. (2002). Base rates of malingering and symptom exaggeration. Journal of Clinical and Experimental Neuropsychology, 24(8), 1094–1102.CrossRefPubMed

Munkvold, L. H., Manger, T., & Lundervold, A. J. (2014). Conners’ continuous performance test (CCPT-II) in children with ADHD, ODD, or a combined ADHD/ODD diagnosis. Child Neuropsychology, 20(1), 106–126. https://doi.org/10.1080/09297049.2012.753997CrossRefPubMed

Nikolas, M. A., Marshall, P., & Hoelzle, J. B. (2019). The role of neurocognitive tests in the assessment of adult attention-deficit/hyperactivity disorder. Psychological Assessment, 31(5), 685–698. https://doi.org/10.1037/pas0000688CrossRefPubMed

Odland, A. P., Lammy, A. B., Martin, P. K., Grote, C. L., & Mittenberg, W. (2015). Advanced administration and interpretation of multiple validity tests. Psychological Injury and Law, 8(1), 46–63. https://doi.org/10.1007/s12207-015-9216-4CrossRef

Olla, P., Rykulski, N., Hurtubise, J. L., Bartol, S., Foote, R., Cutler, L., Abeare, K., McVinnie, N., Sabelli, A. G., Hastings, M., & Erdodi, L. A. (2021). Short-term effects of cannabis consumption on cognitive performance in medical cannabis patients. Applied neuropsychology Adult, 28(6), 647–657. https://doi.org/10.1080/23279095.2019.1681424. https://doi-org.libezp.lib.lsu.edu/CrossRefPubMed

Ord, A. S., Miskey, H. M., Lad, S., Richter, B., Nagy, K., & Shura, R. D. (2021). Examining embedded validity indicators in Conners continuous performance test-3 (CPT-3). The Clinical Neuropsychologist, 35(8), 1426–1441. https://doi.org/10.1080/13854046.2020.1751301CrossRefPubMed

Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV – technical manual. San Antonio, TX: Author.

Persinger, V. C., Whiteside, D. M., Bobova, L., Saigal, S. D., Vannucci, M. J., & Basso, M. R. (2018). Using the California Verbal Learning Test, Second Edition as an embedded performance validity measure among individuals with TBI and individuals with psychiatric disorders. The Clinical Neuropsychologist, 32(6), 1039–1053. https://doi.org/10.1080/13854046.2017.1419507CrossRefPubMed

Pettersson, R., Söderström, S., & Nilsson, K. W. (2018). Diagnosing ADHD in adults: An examination of the discriminative validity of neuropsychological tests and diagnostic assessment instruments. Journal of Attention Disorders, 22(11), 1019–1031. https://doi.org/10.1177/1087054715618788CrossRefPubMed

Poynter, K., Boone, K. B., Ermshar, A., Miora, D., Cottingham, M., Victor, T. L., Ziegler, E., Zeller, M. A., & Wright, M. (2019). Wait, there’s a baby in this bath water! Update on quantitative and qualitative cut-offs for Rey 15-Item Recall and Recognition. Archives of Clinical Neuropsychology, 34(8), 1367–1380. https://doi.org/10.1093/arclin/acy087CrossRefPubMed

Proto, D. A., Pastorek, N. J., Miller, B. I., Romesser, J. M., Sim, A. H., & Linck, J. M. (2014). The dangers of failing one or more performance validity tests in individuals claiming mild traumatic brain injury-related postconcussive symptoms. Archives of Clinical Neuropsychology, 29, 614–624.CrossRefPubMedPubMedCentral

Rai, J. K., An, K. Y., Charles, J., Ali, S., & Erdodi, L. A. (2019). Introducing a forced choice recognition trial to the Rey Complex figure test. Psychology & Neuroscience, 12(4), 451–472. https://doi.org/10.1037/pne0000175CrossRef

Reedy, S. D., Boone, K. B., Cottingham, M. E., Glaser, D. F., Lu, P. H., Victor, T. L., Ziegler, E. A., Zeller, M. A., & Wright, M. J. (2013). Cross validation of the Lu and colleagues (2003) Rey-Osterrieth Complex Figure Test effort equation in a large known-group sample. Archives of Clinical Neuropsychology, 28(1), 30–37. https://doi.org/10.1093/arclin/acs106

Reitan, R. M. (1955). The relation of the trail making test to organic brain damage. Journal of Consulting Psychology, 19, 393–394.CrossRefPubMed

Reitan, R. M. (1969). Manual for administration of neuropsychological test batteries for adults and children. Indianapolis, IN.

Rey, A. (1941). L’examen psychologique dans les cas d’encephalopathie traumatique [The psychological examination in cases of traumatic encephalopathy]. Archives de Psychologie, 28, 215–285.

Riccio, C. A., & Reynolds, C. R. (2006). Continuous performance tests are sensitive to ADHD in adults but lack specificity. A review and critique for differential diagnosis. Annals of the New York Academy of Sciences, 931, 113–139. https://doi.org/10.1111/j.1749-6632.2001.tb05776.xCrossRef

Riccio, C. A., Reynolds, C. R., Lowe, P., & Moore, J. J. (2002). The continuous performance test: A window on the neural substrates for attention? Archives of Clinical Neuropsychology, 17(3), 235–272.CrossRefPubMed

Robinson, A., Miller, L. R., Herring, T. T., & Calamia, M. (2023). Utility of the D-KEFS color–word interference test as an embedded validity indicator in psychoeducational evaluations. Psychology & Neuroscience. https://doi.org/10.1037/pne0000301Advance online publication.CrossRef

Robinson, A., Reed, C., Davis, K., Divers, R., Miller, L., Erdodi, L., & Calamia, M. (2022). Settling the score: Can CPT-3 embedded validity indicators distinguish between credible and non-credible responders referred for ADHD and/or SLD? Journal of Attention Disorders, 27(1), 80–88. https://doi.org/10.1177/10870547221121781CrossRefPubMed

Roma, P., Giromini, L., Burla, F., Ferracuti, S., Viglione, D. J., & Mazza, C. (2020). Ecological validity of the inventory of Problems-29 (IOP-29): An italian study of court-ordered, psychological injury evaluations using the structured inventory of Malingered Symptomatology (SIMS) as criterion variable. Psychological Injury and Law, 13, 57–65. https://doi.org/10.1007/s12207-019-09368-4CrossRef

Roth, R. M., Isquith, P. K., & Gioia, G. A. (2005). Behavior rating inventory of executive function—adult version. Lutz, FL: Psychological Assessment Resources, Inc.

Roth, R. M., Lance, C. E., Isquith, P. K., Fischer, A. S., & Giancola, P. R. (2013). Confirmatory factor analysis of the Behavior rating inventory of executive function - adult version in healthy adults and application to attention-deficit/hyperactivity disorder. Archives of Clinical Neuropsychology, 28(5), 425–434. https://doi.org/10.1093/arclin/act031CrossRefPubMedPubMedCentral

Ruff, R. M., Klopfer, J., & Blank, J. (2016). Homogenous base rates for malingering in neuropsychological examination of litigants. Psychological Injury and Law, 9(2), 143–153.CrossRef

Samek, J., Spencer, R. J., Rice, S. C., & Waldstein, S. R. (2007). Reliability of the Conners’ continuous performance test in young adults. Archives of Clinical Neuropsychology, 22(7), 860–861.

Schoechlin, C., & Engel, R. R. (2005). Neuropsychological performance in adult attention-deficit hyperactivity disorder: Meta-analysis of empirical data. Archives of Clinical Neuropsychology, 20(6), 727–744. https://doi.org/10.1016/j.acn.2005.04.005CrossRefPubMed

Schroeder, R. W., Martin, P. K., Heinrichs, R. J., & Baade, L. E. (2019). Research methods in performance validity testing studies: Criterion grouping approach impacts study outcomes. The Clinical Neuropsychologist, 33(3), 466–477. https://doi.org/10.1080/13854046.2018.1484517CrossRefPubMed

Shaked, D., Faulkner, L., Tolle, K., Wendell, C. R., Waldstein, S. R., & Spencer, R. J. (2020). Reliability and validity of the Conners’ continuous performance test. Applied Neuropsychology Adult, 27(5), 478–487. https://doi.org/10.1080/23279095.2019.1570199CrossRefPubMed

Sharland, M. J., Waring, S. C., Johnson, B. P., Taran, A. M., Rusin, T. A., Pattock, A. M., & Palcher, J. A. (2018). Further examination of embedded performance validity indicators for the Conners’ continuous performance test and brief test of attention in a large outpatient clinical sample. The Clinical Neuropsychologist, 32(1), 98–108. https://doi.org/10.1080/13854046.2017.1332240CrossRefPubMed

Sherman, E., Slick, D. J., & Iverson, G. L. (2020). Multidimensional Malingering Criteria for Neuropsychological Assessment: A 20-Year update of the Malingered Neuropsychological Dysfunction Criteria. Archives of Clinical Neuropsychology, 35(6), 735–764. https://doi.org/10.1093/arclin/acaa019CrossRefPubMedPubMedCentral

Shura, R. D., Martindale, S. L., Taber, K. H., Higgins, A. M., & Rowland, J. A. (2020). Digit span embedded validity indicators in neurologically-intact veterans. The Clinical Neuropsychologist, 34(5), 1025–1037. https://doi.org/10.1080/13854046.2019.1635209CrossRefPubMed

Shura, R. D., Miskey, H. M., Rowland, J. A., Yoash-Gantz, R. E., & Denning, J. H. (2016). Embedded performance validity measures with post deployment veterans: Cross-validation and efficiency with multiple measures. Applied Neuropsychology: Adult, 23(2), 94–104. https://doi.org/10.1080/23279095.2015.1014556CrossRefPubMed

Sirianni, C. D., Abeare, C. A., Ali, S., Razvi, P., Kennedy, A., Pyne, S. R., & Erdodi, L. A. (2021). The V-5 provides quick and accurate measures of psychiatric symptoms for single and repeated in-person and online assessments and is valid in culturally diverse examinees. Psychiatry Research, 298, 11365.CrossRef

Slick, D. J., Iverson, G. L., & Green, P. (2000). California Verbal Learning Test indicators of suboptimal performance in a sample of head-injury litigants. Journal of Clinical and Experimental Neuropsychology, 22(5), 569–579. https://doi.org/10.1076/1380-3395(200010)22:5;1-9;FT569CrossRefPubMed

Slick, D. J., Tan, J. E., Strauss, E. H., & Hultsch, D. F. (2004). Detecting malingering: A survey of experts’ practices. Archives of Clinical Neuropsychology, 19(4), 465–473.CrossRefPubMed

Sollman, M. J., Ranseen, J. D., & Berry, D. T. R. (2010). Detection of feigned ADHD in college students. Psychological Assessment, 22(2), 325–335.CrossRefPubMed

Sugarman, M. A., Holcomb, E. M., Axelrod, B. N., Meyers, J. E., & Liethen, P. C. (2016). Embedded measures of performance validity in the Rey Complex figure test in a clinical sample of veterans. Applied Neuropsychology Adult, 23(2), 105–114. https://doi.org/10.1080/23279095.2015.1014557CrossRefPubMed

Suhr, J. A., & Berry, D. (2017). The importance of assessing for validity of symptom report and performance in attention deficit/hyperactivity disorder (ADHD): Introduction to the special section on noncredible presentation in ADHD. Psychological Assessment, 29(12), 1427–1428. https://doi.org/10.1037/pas0000535CrossRefPubMed

Suhr, J. A., Lee, G. J., & Harrison, A. G. (2022). Susceptibility of functional impairment ratings to noncredible reporting in postsecondary students undergoing screening for ADHD. The Clinical Neuropsychologist, 36(6), 1493–1505. https://doi.org/10.1080/13854046.2020.1817564CrossRefPubMed

Suhr, J. A., Sullivan, B. K., & Rodriguez, J. L. (2011). The relationship of noncredible performance to continuous performance test scores in adults referred for attention-deficit/hyperactivity disorder evaluation. Archives of Clinical Neuropsychology, 26(1), 1–7. https://doi.org/10.1093/arclin/acq094CrossRefPubMed

Sullivan, B. K., May, K., & Galbally, L. (2007). Symptom exaggeration by college adults in attention-deficit hyperactivity disorder and learning disorder assessments. Applied Neuropsychology, 14(3), 189–207. https://doi.org/10.1080/09084280701509083CrossRefPubMed

Sullivan, K., Lange, R. T., & Dawes, S. (2006). Methods of detecting malingering and estimated symptom exaggeration base rates in Australia. Journal of Forensic Neuropsychology, 4(4), 49–70.CrossRef

Sweet, J. J., Wolfe, P., Sattlberger, E., Numan, B., Rosenfeld, J. P., Clingerman, S., & Nies, K. J. (2000). Further investigation of traumatic brain injury versus insufficient effort with the California Verbal Learning Test. Archives of Clinical Neuropsychology, 15(2), 105–113.CrossRefPubMed

Trueblood, W. (1994). Qualitative and quantitative characteristics of malingered and other invalid WAIS-R and clinical memory data. Journal of Clinical and Experimental Neuropsychology, 16(4), 597–607. https://doi.org/10.1080/01688639408402671CrossRefPubMed

Tyson, B. T., Baker, S., Greenacre, M., Kent, K., Lichtenstein, J., Sabelli, J. D., A., & Erdodi, L. A. (2018). Differentiating epilepsy from psychogenic nonepileptic seizures using neuropsychological test data. Epilepsy & Behavior, 87, 39–45.CrossRef

Tyson, B. T., Pyne, S. R., Crisan, I., Calamia, M., Holcomb, M., Giromini, L., & Erdodi, L. A. (2023a). Logical memory, Visual Reproduction and Verbal Paired Associates are effective embedded validity indicators in patients with traumatic brain injury. Advance online publication. Applied Neuropsychology: Adult.

Tyson, B. T., Shahein, A., Abeare, C. A., Baker, S. D., Kent, K., Roth, R. M., & Erdodi, L. A. (2023b). Replicating a meta-analysis: The search for the optimal Word Choice Test cutoff continues. Assessment. Advance online publication.

Victor, T. L., & Boone, K. B. (2021). Identification of feigned intellectual disability. In K. B. Boone (Ed.), Assessment of feigned cognitive impairment: A neuropsychological perspective (2nd ed., pp. 453–480). The Guilford Press.

Victor, T. L., Boone, K. B., Serpa, J. G., Buehler, J., & Ziegler, E. A. (2009). Interpreting the meaning of multiple symptom validity test failure. The Clinical Neuropsychologist, 23(2), 297–313. https://doi.org/10.1080/13854040802232682CrossRefPubMed

Viglione, D. J., Giromini, L., & Landis, P. (2017). The development of the inventory of Problems–29: A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99(5), 534–544. https://doi.org/10.1080/00223891.2016.1233882CrossRefPubMed

Warrington, E. K. (1984). Recognition Memory Test manual. Berkshire, United Kingdom: NFERNelson.

Webber, T. A., Sullivan-Baca, E., Modiano, Y. A., Taiwo, Z., & Grabyan, J. M. (2022). Validity of informant report interpretations: Role of examinee performance and symptom invalidity. Psychological Assessment, 34(2), 125–139. https://doi.org/10.1037/pas0001074CrossRefPubMed

Weiss, B. A. (2011). Hotelling’s t test and Steiger’s z test calculator [Computer software]. Available from https://blogs.gwu.edu/weissba/teaching/calculators/hotellings-t-and-steigers-z-tests/

Whitney, K. A., Davis, J. J., Shepard, P. H., Bertram, D. M., & Adams, K. M. (2009). Digit span age scaled score in middle-aged military veterans: Is it more closely associated with TOMM failure than reliable digit span? Archives of Clinical Neuropsychology, 24(3), 263–272. https://doi.org/10.1093/arclin/acp034CrossRefPubMed

Wilkinson, G. S., & Robertson, G. J. (2006). Wide range achievement test – Fourth Edition. Lutz, FL: Psychological Assessment Resources, Inc.

Wolfe, P. L., Millis, S. R., Hanks, R., Fichtenberg, N., Larrabee, G. J., & Sweet, J. J. (2010). Effort indicators within the California Verbal Learning Test-II (CVLT-II). The Clinical Neuropsychologist, 24(1), 153–168. https://doi.org/10.1080/13854040903107791CrossRefPubMed

Young, G. (2015). Malingering in forensic disability-related assessments: Prevalence 15 ± 15%. Psychological Injury and Law, 8(3), 188–199. https://doi.org/10.1007/s12207-015-9232-4CrossRef

Young, G. (2020). Thirty complexities and controversies in mild traumatic brain injury and persistent post-concussion syndrome: A roadmap for research and practice. Psychological Injury and Law, 13(4), 427–451. https://doi.org/10.1007/s12207-020-09395-6CrossRef

Zuccato, B. G., Tyson, B. T., & Erdodi, L. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment, 30(11), 14911498. https://doi.org/10.1037/pas0000596CrossRef

Titel: Two Times the Charm: Repeat Administration of the CPT-II Improves Its Classification Accuracy as a Performance Validity Index
Auteurs: Anthony Robinson
Matthew Calamia
Nathanael Penner
Noor Assaf
Parveen Razvi
Robert M Roth
Laszlo A Erdodi
Publicatiedatum: 12-06-2023
Uitgeverij: Springer US
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment / Uitgave 3/2023
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI: https://doi.org/10.1007/s10862-023-10055-7

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 3/2023

Development and Psychometric Properties of the Youth Emotions Scale

Psychometric Characteristics of the Romanian Adaptation of the GAD-7

Norms for the Dutch Version of the Young Schema Questionnaire – Adolescent in a Clinical Population

Association of Fear of Negative Evaluation with Performance Anxiety: Mediation by Negative Self-Statements and Moderation by Positive Self-Statements During Performance in Adults

Rumination in Response to a Social Interaction: Psychometric Properties of the Socially Anxious Rumination Questionnaire (SARQ) in Social Anxiety Disorder

Examining the Cross Cultural Validity and Measurement Invariance of the Emotion Beliefs Questionnaire (EBQ) in Iran and the USA