Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 1/2019

29-10-2018

Reliability and Validity of the Thinking Skills Inventory, a Screening Tool for Cross-Diagnostic Skill Deficits Underlying Youth Behavioral Challenges

Auteurs: Lu Wang, Alisha R. Pollastri, Pieter J. Vuijk, Erin N. Hill, Brenda A. Lee, Anna Samkavitz, Ellen B. Braaten, J. Stuart Ablon, Alysa E. Doyle

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 1/2019

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Deficits in a range of skill domains (including executive functioning, emotion regulation, social cognition and language/communication) are associated with disrupted youth behavior and functioning across mental health diagnoses. The identification of skill deficits are important for effective treatment planning, particularly for personalized interventions. While there are multiple ways to assess these skills, parent/caregiver reports represent an important information source. To date, no single, brief measure has been developed that gathers parent/caregiver ratings across this range of constructs. We have developed a short caregiver-report questionnaire (the Thinking Skills Inventory; TSI), to screen for skill deficits. Here, we examine the reliability and validity of this rating scale in 384 youth who were consecutively referred for neuropsychiatric evaluation. A primary caregiver completed the TSI as well as other established measures. Exploratory and confirmatory factor analyses support five subscales on the TSI: Attention and Working Memory, Language and Communication, Emotion Regulation, Cognitive Flexibility, and Social Thinking Skills. The subscales showed moderate to high internal consistency (Cronbach’s alphas range from 0.84 to 0.91). Correlations with established caregiver-report measures confirm their convergent and discriminant validity, and associations with multiple clinical diagnoses and cross-diagnostic aggressive behavior further support the utility of the scale for our intended purpose. In sum, this free, brief measure is a valid and reliable way to identify variation in skill domains relevant to a range of psychopathology. The TSI may be useful in youth mental health settings to assist with treatment planning and to inform referral for further evaluation.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Voetnoten
1
Modifications include: error correlations between Items 10 & 11 on expressive language; Items 24 & 25 on non-verbal social cues; error correlations between Item 20 & 21 on ability to handle deviations from expectations or routines error; added path between Item 9, Item 14 and Social Thinking skills; and added path between Item 7 and Cognitive Flexibility.
 
Literatuur
go back to reference Achenbach, T. M. (2009). ASEBA: Development, findings, theory and applications. Burlington, VT: University of Vermont Research Center for Children, Youth and Families. Achenbach, T. M. (2009). ASEBA: Development, findings, theory and applications. Burlington, VT: University of Vermont Research Center for Children, Youth and Families.
go back to reference Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families ISBN 0-938565-73-7. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, and Families ISBN 0-938565-73-7.
go back to reference Allen, M. J., & Yen, W. M. (2002). Introduction to measurement theory. Long Grove: Waveland Press. Allen, M. J., & Yen, W. M. (2002). Introduction to measurement theory. Long Grove: Waveland Press.
go back to reference American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC: Author. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., Text Revision). Washington, DC: Author.
go back to reference American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
go back to reference Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & S. L. Long (Eds.), Testing structural equation models (pp. 136–162). London: Sage Publications. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & S. L. Long (Eds.), Testing structural equation models (pp. 136–162). London: Sage Publications.
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Routledge. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Routledge.
go back to reference Dodge, K. A., Lansford, J. E., Burks, V. S., Bates, J. E., Pettit, G. S., Fontaine, R., & Price, J. M. (2003). Peer rejection and social information-processing factors in the development of aggressive behavior problems in children. Child Development, 74(2), 374–393.PubMedPubMedCentralCrossRef Dodge, K. A., Lansford, J. E., Burks, V. S., Bates, J. E., Pettit, G. S., Fontaine, R., & Price, J. M. (2003). Peer rejection and social information-processing factors in the development of aggressive behavior problems in children. Child Development, 74(2), 374–393.PubMedPubMedCentralCrossRef
go back to reference Dolan, C. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology, 47(2), 309–326.CrossRef Dolan, C. (1994). Factor analysis of variables with 2, 3, 5, and 7 response categories: A comparison of categorical variable estimators using simulated data. British Journal of Mathematical and Statistical Psychology, 47(2), 309–326.CrossRef
go back to reference Doyle, A. E., Vuijk, P. J., Doty, N. D., McGrath, L. M., Willoughby, B. L., O’Donnell, E. H., et al. (2017). Cross-disorder cognitive impairments in youth referred for neuropsychiatric evaluation. Journal of the International Neuropsychological Society, 1–13. Doyle, A. E., Vuijk, P. J., Doty, N. D., McGrath, L. M., Willoughby, B. L., O’Donnell, E. H., et al. (2017). Cross-disorder cognitive impairments in youth referred for neuropsychiatric evaluation. Journal of the International Neuropsychological Society, 1–13.
go back to reference Gioia, G. A. (2000). BRIEF: Behavior rating inventory of executive function: Professional manual. Odessa: Psychological Assessment Resources. Gioia, G. A. (2000). BRIEF: Behavior rating inventory of executive function: Professional manual. Odessa: Psychological Assessment Resources.
go back to reference Gioia, G., Isquith, P. K., Guy, S. C., Kenworthy, L., & Reviewed by Baron, I.S. (2000). Test review: Behavior rating inventory of executive function. Child Neuropsychology, 6(3), 235–238.CrossRef Gioia, G., Isquith, P. K., Guy, S. C., Kenworthy, L., & Reviewed by Baron, I.S. (2000). Test review: Behavior rating inventory of executive function. Child Neuropsychology, 6(3), 235–238.CrossRef
go back to reference Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). Behavior rating inventory of executive functions-2. Lutz: PAR. Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2015). Behavior rating inventory of executive functions-2. Lutz: PAR.
go back to reference Greene, R. W. (1998). The explosive child: A new approach for understanding and parenting easily frustrated, chronically inflexible children. New York: Harper Collins. Greene, R. W. (1998). The explosive child: A new approach for understanding and parenting easily frustrated, chronically inflexible children. New York: Harper Collins.
go back to reference Greene, R. W., & Ablon, J. S. (2005). Treating explosive kids: The collaborative problem-solving approach. New York: Guilford Press. Greene, R. W., & Ablon, J. S. (2005). Treating explosive kids: The collaborative problem-solving approach. New York: Guilford Press.
go back to reference Harrison, P.L. & Oakland, T. (2003). Adaptive Behavior Assessment System – Second Edition, San Antonio: The Psychological Corporation. Harrison, P.L. & Oakland, T. (2003). Adaptive Behavior Assessment System – Second Edition, San Antonio: The Psychological Corporation.
go back to reference Hill, A. L., Degnan, K. A., Calkins, S. D., & Keane, S. P. (2006). Profiles of externalizing behavior problems for boys and girls across preschool: The roles of emotion regulation and inattention. Developmental Psychology, 42(5), 913–928.PubMedCrossRef Hill, A. L., Degnan, K. A., Calkins, S. D., & Keane, S. P. (2006). Profiles of externalizing behavior problems for boys and girls across preschool: The roles of emotion regulation and inattention. Developmental Psychology, 42(5), 913–928.PubMedCrossRef
go back to reference Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modeling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53–60. Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modeling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53–60.
go back to reference Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453.CrossRef Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453.CrossRef
go back to reference Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.CrossRef Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.CrossRef
go back to reference Kline, P. (2013). Handbook of psychological testing. London, England. Routledge. Kline, P. (2013). Handbook of psychological testing. London, England. Routledge.
go back to reference Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. The R Journal, 6(2), 151–162.CrossRef Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. The R Journal, 6(2), 151–162.CrossRef
go back to reference Kotov, R., Ruggero, C. J., Krueger, R. F., Watson, D., Yuan, Q., & Zimmerman, M. (2011). New dimensions in the quantitative classification of mental illness. Archives of General Psychiatry, 68, 1003–1011.PubMedCrossRef Kotov, R., Ruggero, C. J., Krueger, R. F., Watson, D., Yuan, Q., & Zimmerman, M. (2011). New dimensions in the quantitative classification of mental illness. Archives of General Psychiatry, 68, 1003–1011.PubMedCrossRef
go back to reference MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149.CrossRef MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149.CrossRef
go back to reference Matthys, W., Cuperus, J. M., & Engeland, H. V. (1999). Deficient social problem-solving in boys with ODD/CD, with ADHD, and with both disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 38(3), 311–321.CrossRef Matthys, W., Cuperus, J. M., & Engeland, H. V. (1999). Deficient social problem-solving in boys with ODD/CD, with ADHD, and with both disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 38(3), 311–321.CrossRef
go back to reference Morris, S. E., & Cuthbert, B. N. (2012). Research domain criteria: Cognitive systems, neural circuits, and dimensions of behavior. Dialogues in Clinical Neuroscience, 14(1), 29–37.PubMedPubMedCentral Morris, S. E., & Cuthbert, B. N. (2012). Research domain criteria: Cognitive systems, neural circuits, and dimensions of behavior. Dialogues in Clinical Neuroscience, 14(1), 29–37.PubMedPubMedCentral
go back to reference Nordhausen, K., & Oja, H. (2011). Multivariate L1 methods: The package MNM. Journal of Statistical Software, 43, 1–28.CrossRef Nordhausen, K., & Oja, H. (2011). Multivariate L1 methods: The package MNM. Journal of Statistical Software, 43, 1–28.CrossRef
go back to reference Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill. Nunnally, J. C. (1978). Psychometric theory. New York: McGraw-Hill.
go back to reference Pollastri, A. R., Epstein, L. D., Heath, G. H., & Ablon, J. S. (2013). The collaborative problem solving approach: Outcomes across settings. Harvard Review of Psychiatry, 21(4), 188–199.PubMed Pollastri, A. R., Epstein, L. D., Heath, G. H., & Ablon, J. S. (2013). The collaborative problem solving approach: Outcomes across settings. Harvard Review of Psychiatry, 21(4), 188–199.PubMed
go back to reference Renna, M. E., Quintero, J. M., Fresco, D. M., & Mennin, D. S. (2017). Emotion regulation therapy: A mechanism-targeted treatment for disorders of distress. Frontiers in Psychology, 8, 1–14.CrossRef Renna, M. E., Quintero, J. M., Fresco, D. M., & Mennin, D. S. (2017). Emotion regulation therapy: A mechanism-targeted treatment for disorders of distress. Frontiers in Psychology, 8, 1–14.CrossRef
go back to reference Röll, J., Koglin, U., & Petermann, F. (2012). Emotion regulation and childhood aggression: Longitudinal associations. Child Psychiatry & Human Development, 43(6), 909–923.CrossRef Röll, J., Koglin, U., & Petermann, F. (2012). Emotion regulation and childhood aggression: Longitudinal associations. Child Psychiatry & Human Development, 43(6), 909–923.CrossRef
go back to reference Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.CrossRef Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.CrossRef
go back to reference Rushton, J., Bruckman, D., & Kelleher, K. (2002). Primary care referral of children with psychosocial problems. Archives of Pediatrics & Adolescent Medicine, 156(6), 592–598.CrossRef Rushton, J., Bruckman, D., & Kelleher, K. (2002). Primary care referral of children with psychosocial problems. Archives of Pediatrics & Adolescent Medicine, 156(6), 592–598.CrossRef
go back to reference Russell, D. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in personality and social psychology bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646. Russell, D. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in personality and social psychology bulletin. Personality and Social Psychology Bulletin, 28(12), 1629–1646.
go back to reference Steiger, J. H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42(5), 893–898.CrossRef Steiger, J. H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42(5), 893–898.CrossRef
go back to reference Stieben, J., Lewis, M. D., Granic, I., Zelazo, P. D., Segalowitz, S., & Pepler, D. (2007). Neurophysiological mechanisms of emotion regulation for subtypes of externalizing children. Development and Psychopathology, 19(2), 455–480.PubMedCrossRef Stieben, J., Lewis, M. D., Granic, I., Zelazo, P. D., Segalowitz, S., & Pepler, D. (2007). Neurophysiological mechanisms of emotion regulation for subtypes of externalizing children. Development and Psychopathology, 19(2), 455–480.PubMedCrossRef
go back to reference Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Allyn & Bacon/Pearson Education. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston: Allyn & Bacon/Pearson Education.
go back to reference Van Goozen, S. H., Cohen-Kettenis, P. T., Snoek, H., Matthys, W., Swaab-Barneveld, H., & Van Engeland, H. (2004). Executive functioning in children: A comparison of hospitalized ODD and ODD/ADHD children and normal controls. Journal of Child Psychology and Psychiatry, 45(2), 284–292.PubMedCrossRef Van Goozen, S. H., Cohen-Kettenis, P. T., Snoek, H., Matthys, W., Swaab-Barneveld, H., & Van Engeland, H. (2004). Executive functioning in children: A comparison of hospitalized ODD and ODD/ADHD children and normal controls. Journal of Child Psychology and Psychiatry, 45(2), 284–292.PubMedCrossRef
go back to reference Zadeh, Z. Y., Im-Bolter, N., & Cohen, N. J. (2007). Social cognition and externalizing psychopathology: An investigation of the mediating role of language. Journal of Abnormal Child Psychology, 35(2), 141–152.PubMedCrossRef Zadeh, Z. Y., Im-Bolter, N., & Cohen, N. J. (2007). Social cognition and externalizing psychopathology: An investigation of the mediating role of language. Journal of Abnormal Child Psychology, 35(2), 141–152.PubMedCrossRef
Metagegevens
Titel
Reliability and Validity of the Thinking Skills Inventory, a Screening Tool for Cross-Diagnostic Skill Deficits Underlying Youth Behavioral Challenges
Auteurs
Lu Wang
Alisha R. Pollastri
Pieter J. Vuijk
Erin N. Hill
Brenda A. Lee
Anna Samkavitz
Ellen B. Braaten
J. Stuart Ablon
Alysa E. Doyle
Publicatiedatum
29-10-2018
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 1/2019
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-018-9703-5

Andere artikelen Uitgave 1/2019

Journal of Psychopathology and Behavioral Assessment 1/2019 Naar de uitgave