Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 1/2020

02-01-2020

Comparison of Discriminant Validity Indices of Parent, Teacher, and Multi-Informant Reports of Behavioral Problems in Elementary Schoolers

Auteurs: Mélanie Lapalme, Vincent Bégin, Yann Le Corff, Michèle Déry

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 1/2020

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The clinical relevance of using a multi-informant approach to assess behavioral problems in youths is well established. However, empirical studies have consistently shown weak agreement across informants (parents, teachers, youths). Moreover, there is no consensus regarding the most valid strategy for combining informant reports to assess these problems. The aim of this study was to compare the discriminant validity of different strategies for combining parent and teacher reports (mean score, highest score, independent assessments) by testing their sensitivity and specificity in assessing different constructs of behavioral problems (conduct, oppositional and attention/hyperactivity) in youths referred and non-referred to school-based services for these problems. The strategies were tested in terms of their capacity to discriminate between a sample of children (n = 370, 6–9 years old, 40% girls) with emotional or behavioral problems referred for special school services and another sample of children (n = 183, 6–9 years old, 52% girls) never referred for such services. All the children were recruited in the same school boards across the province of Quebec, Canada. High specificity rates were obtained across informants and combination strategies. Low sensitivity rates were obtained for parents, teachers and mean scores, but the use of the highest score yielded higher sensitivity without lowering specificity rates and optimized classification rates across constructs and cutoffs (98th, 93rd percentiles) among both boys and girls. This combination strategy therefore appeared to optimize balance between specificity and sensitivity. These results suggest that, when available, use of parent/teacher highest score should be preferred over use of a single informant score or of a parent-teacher mean score in assessing behavioral problems in youths.
Literatuur
go back to reference Achenbach, T. M. (2011). Commentary: Definitely more than measurement error: But how should we understand and deal with informant discrepancies? Journal of Clinical Child and Adolescent Psychology, 40(1), 80–86.CrossRef Achenbach, T. M. (2011). Commentary: Definitely more than measurement error: But how should we understand and deal with informant discrepancies? Journal of Clinical Child and Adolescent Psychology, 40(1), 80–86.CrossRef
go back to reference Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the Achenbach system of empirically based assessment (ASEBA) school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth & Families. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the Achenbach system of empirically based assessment (ASEBA) school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth & Families.
go back to reference Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232.CrossRef Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232.CrossRef
go back to reference Achenbach, T. M., Ivanova, M. Y., & Rescorla, L. A. (2017). Empirically based assessment and taxonomy of psychopathology for ages 1½–90+ years: Developmental, multi-informant, and multicultural findings. Comprehensive Psychiatry, 79, 4–18.CrossRef Achenbach, T. M., Ivanova, M. Y., & Rescorla, L. A. (2017). Empirically based assessment and taxonomy of psychopathology for ages 1½–90+ years: Developmental, multi-informant, and multicultural findings. Comprehensive Psychiatry, 79, 4–18.CrossRef
go back to reference Archer, J., & Côté, S. (2005). Sex differences in aggressive behavior: A developmental and evolutionary perspective. In R. E. Tremblay, W. W. Hartup, & J. Archer (Eds.), Developmental origins of aggression (pp. 425–443). New York: Guilford Press. Archer, J., & Côté, S. (2005). Sex differences in aggressive behavior: A developmental and evolutionary perspective. In R. E. Tremblay, W. W. Hartup, & J. Archer (Eds.), Developmental origins of aggression (pp. 425–443). New York: Guilford Press.
go back to reference Barry, C. T., Golmaryami, F. N., Rivera-Hudson, N., & Frick, P. J. (2013). Evidence-based assessment of conduct disorder: Current considerations and preparation for DSM-5. Professional Psychology: Research and Practice, 44(1), 56–63.CrossRef Barry, C. T., Golmaryami, F. N., Rivera-Hudson, N., & Frick, P. J. (2013). Evidence-based assessment of conduct disorder: Current considerations and preparation for DSM-5. Professional Psychology: Research and Practice, 44(1), 56–63.CrossRef
go back to reference Bouchard, C., & Fréchette, N. (2010). Le développement global en contextes éducatifs [Global development in educational contexts]. Québec: Presses de l’Université du Québec. Bouchard, C., & Fréchette, N. (2010). Le développement global en contextes éducatifs [Global development in educational contexts]. Québec: Presses de l’Université du Québec.
go back to reference Bradshaw, C. P., Schaeffer, C. M., Petras, H., & Ialongo, N. (2010). Predicting negative life outcomes from early aggressive-disruptive behavior trajectories: Gender differences in maladaptation across life domains. Journal of Youth and Adolescence, 39(8), 953–966.CrossRef Bradshaw, C. P., Schaeffer, C. M., Petras, H., & Ialongo, N. (2010). Predicting negative life outcomes from early aggressive-disruptive behavior trajectories: Gender differences in maladaptation across life domains. Journal of Youth and Adolescence, 39(8), 953–966.CrossRef
go back to reference Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.CrossRef Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105.CrossRef
go back to reference Conners, C. K. (2001). Conners’ rating scales—Revised: Instruments for use with children and adolescents. Toronto: Multi-Health System. Conners, C. K. (2001). Conners’ rating scales—Revised: Instruments for use with children and adolescents. Toronto: Multi-Health System.
go back to reference Costello, E. J., He, J.-P., Sampson, A. A., Kessler, R. C., & Merikangas, K. R. (2014). Services for adolescents with psychiatric disorders: 12-month data from the National Comorbidity Survey-Adolescent. Psychiatric Services, 65(3), 359–366.CrossRef Costello, E. J., He, J.-P., Sampson, A. A., Kessler, R. C., & Merikangas, K. R. (2014). Services for adolescents with psychiatric disorders: 12-month data from the National Comorbidity Survey-Adolescent. Psychiatric Services, 65(3), 359–366.CrossRef
go back to reference Coutinho, M. J., Oswald, D. P., Best, A. M., & Forness, S. R. (2002). Gender and sociodemographic factors and the disproportionate identification of culturally and linguistically diverse students with emotional disturbance. Behavioral Disorders, 27(2), 109–125.CrossRef Coutinho, M. J., Oswald, D. P., Best, A. M., & Forness, S. R. (2002). Gender and sociodemographic factors and the disproportionate identification of culturally and linguistically diverse students with emotional disturbance. Behavioral Disorders, 27(2), 109–125.CrossRef
go back to reference De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40(1), 1–9.CrossRef De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40(1), 1–9.CrossRef
go back to reference De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483–509.CrossRef De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483–509.CrossRef
go back to reference De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900.CrossRef De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900.CrossRef
go back to reference Delacour, H., François, N., Servonnet, A., Gentile, A., & Roche, B. (2009). Les rapports de vraisemblance : un outil de choix pour l’interprétation des tests biologiques [Likelihood ratios: A powerful tool for interpreting biological tests]. Immuno-Analyse & Biologie Spécialisée, 24(2), 92–99.CrossRef Delacour, H., François, N., Servonnet, A., Gentile, A., & Roche, B. (2009). Les rapports de vraisemblance : un outil de choix pour l’interprétation des tests biologiques [Likelihood ratios: A powerful tool for interpreting biological tests]. Immuno-Analyse & Biologie Spécialisée, 24(2), 92–99.CrossRef
go back to reference De Los Reyes, Andres (2013) Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research. Development and Psychopathology 25 (3):669-682CrossRef De Los Reyes, Andres (2013) Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research. Development and Psychopathology 25 (3):669-682CrossRef
go back to reference Dirks, M. A., De Los Reyes, A., Briggs-Gowan, M., Cella, D., & Wakschlag, L. S. (2012). Annual research review: Embracing not erasing contextual variability in children's behavior - theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry, 53(5), 558–574.CrossRef Dirks, M. A., De Los Reyes, A., Briggs-Gowan, M., Cella, D., & Wakschlag, L. S. (2012). Annual research review: Embracing not erasing contextual variability in children's behavior - theory and utility in the selection and use of methods and informants in developmental psychopathology. Journal of Child Psychology and Psychiatry, 53(5), 558–574.CrossRef
go back to reference Geiser, C., Burns, G. L., & Servera, M. (2014). Testing for measurement invariance and latent mean differences across methods: Interesting incremental information from multitrait-multimethod studies. Frontiers in Psychology, 5, 80–98. Geiser, C., Burns, G. L., & Servera, M. (2014). Testing for measurement invariance and latent mean differences across methods: Interesting incremental information from multitrait-multimethod studies. Frontiers in Psychology, 5, 80–98.
go back to reference Gouvernement du Québec (2006). Prévision de l'effectif scolaire à l'éducation préscolaire, au primaire et au secondaire. [Projected school populations for pre-school, elementary school and high school]. Québec : MELSQ, Direction de la statistique. Gouvernement du Québec (2006). Prévision de l'effectif scolaire à l'éducation préscolaire, au primaire et au secondaire. [Projected school populations for pre-school, elementary school and high school]. Québec : MELSQ, Direction de la statistique.
go back to reference Horton, N. J., & Fitzmaurice, G. M. (2004). Tutorial in biostatics: Regression analysis of multiple source and multiple informant data from complex survey samples. Statistics in Medicine, 23, 2911–2933.CrossRef Horton, N. J., & Fitzmaurice, G. M. (2004). Tutorial in biostatics: Regression analysis of multiple source and multiple informant data from complex survey samples. Statistics in Medicine, 23, 2911–2933.CrossRef
go back to reference Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51.CrossRef Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51.CrossRef
go back to reference Jekel, J. F., Katz, D. L., Elmore, J. G., & Wild, D. (2007). Epidemiology, biostatistics and preventive medicine. Philadelphia: Elsevier Health Sciences. Jekel, J. F., Katz, D. L., Elmore, J. G., & Wild, D. (2007). Epidemiology, biostatistics and preventive medicine. Philadelphia: Elsevier Health Sciences.
go back to reference Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577.CrossRef Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577.CrossRef
go back to reference Martel, M. M., Markon, K., & Smith, G. T. (2017). Research review: Multi-informant integration in child and adolescent psychopathology diagnosis. Journal of Child Psychology and Psychiatry, 58(2), 116–128.CrossRef Martel, M. M., Markon, K., & Smith, G. T. (2017). Research review: Multi-informant integration in child and adolescent psychopathology diagnosis. Journal of Child Psychology and Psychiatry, 58(2), 116–128.CrossRef
go back to reference Offord, D. R., Boyle, M. H., Racine, Y., Szatmari, P., Fleming, J. E., Sanford, M., & Lipman, E. L. (1996). Integrating assessment data from multiple informants. Journal of the American Academy of Child and Adolescent Psychiatry, 35(8), 1078–1085.CrossRef Offord, D. R., Boyle, M. H., Racine, Y., Szatmari, P., Fleming, J. E., Sanford, M., & Lipman, E. L. (1996). Integrating assessment data from multiple informants. Journal of the American Academy of Child and Adolescent Psychiatry, 35(8), 1078–1085.CrossRef
go back to reference Ohan, J. L., & Johnston, C. (2005). Gender appropriateness of symptom criteria for attention-deficit/hyperactivity disorder, oppositional-defiant disorder, and conduct disorder. Child Psychiatry and Human Development, 35, 359–381.CrossRef Ohan, J. L., & Johnston, C. (2005). Gender appropriateness of symptom criteria for attention-deficit/hyperactivity disorder, oppositional-defiant disorder, and conduct disorder. Child Psychiatry and Human Development, 35, 359–381.CrossRef
go back to reference Tremblay, R. E. (2000). The development of aggressive behavior during childhood: What have we learned in the past century? International Journal of Behavioral Development, 24, 129–141.CrossRef Tremblay, R. E. (2000). The development of aggressive behavior during childhood: What have we learned in the past century? International Journal of Behavioral Development, 24, 129–141.CrossRef
go back to reference Trépanier, N. & Dessureault, D. (2013). Les principes et le cadre d’intervention auprès des élèves ayant des difficultés de comportement. In L. Massé, N. Desbiens et C. Lanaris (Éds.), Les troubles du comportement à l’école. Prévention, évaluation et intervention (p. 85-102). Montréal : Gaëtan Morin Éditeur. Trépanier, N. & Dessureault, D. (2013). Les principes et le cadre d’intervention auprès des élèves ayant des difficultés de comportement. In L. Massé, N. Desbiens et C. Lanaris (Éds.), Les troubles du comportement à l’école. Prévention, évaluation et intervention (p. 85-102). Montréal : Gaëtan Morin Éditeur.
go back to reference van Dulmen, M. H. M., & Egeland, B. (2011). Analyzing multiple informant data on child and adolescent behavior problems: Predictive validity and comparison of aggregation procedures. Methods and Measures, 35(1), 84–92. van Dulmen, M. H. M., & Egeland, B. (2011). Analyzing multiple informant data on child and adolescent behavior problems: Predictive validity and comparison of aggregation procedures. Methods and Measures, 35(1), 84–92.
go back to reference Verlaan, P., Déry, M., & Boutin, S. (2012). Les conduites antisociales des filles : La question de l’agression indirecte [Antisocial behavior in girls: The issue of indirect aggression]. In G. M. Tarabulsy, M. A. Provost, J.-P. Lemelin, A. Plamondon, & C. Dufresne (Eds.), Le développement socio-affectif des enfants et des adolescents. Tome II (pp. 407–434). Québec : Presses de l’Université du Québec. Verlaan, P., Déry, M., & Boutin, S. (2012). Les conduites antisociales des filles : La question de l’agression indirecte [Antisocial behavior in girls: The issue of indirect aggression]. In G. M. Tarabulsy, M. A. Provost, J.-P. Lemelin, A. Plamondon, & C. Dufresne (Eds.), Le développement socio-affectif des enfants et des adolescents. Tome II (pp. 407–434). Québec : Presses de l’Université du Québec.
go back to reference Yeh, M., & Weisz, J. R. (2001). Why are we her’e at the clinic? Parent-child (dis)agreement on referral problems at outpatient treatment entry. Journal of Consulting and Clinical Psychology, 69(6), 1018–1025.CrossRef Yeh, M., & Weisz, J. R. (2001). Why are we her’e at the clinic? Parent-child (dis)agreement on referral problems at outpatient treatment entry. Journal of Consulting and Clinical Psychology, 69(6), 1018–1025.CrossRef
go back to reference Youngstrom, E. A. (2013) Future Directions in Psychological Assessment: Combining Evidence-Based Medicine Innovations with Psychology's Historical Strengths to Enhance Utility. Journal of Clinical Child & Adolescent Psychology 42 (1):139-159 Youngstrom, E. A. (2013) Future Directions in Psychological Assessment: Combining Evidence-Based Medicine Innovations with Psychology's Historical Strengths to Enhance Utility. Journal of Clinical Child & Adolescent Psychology 42 (1):139-159
Metagegevens
Titel
Comparison of Discriminant Validity Indices of Parent, Teacher, and Multi-Informant Reports of Behavioral Problems in Elementary Schoolers
Auteurs
Mélanie Lapalme
Vincent Bégin
Yann Le Corff
Michèle Déry
Publicatiedatum
02-01-2020
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 1/2020
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-019-09782-7

Andere artikelen Uitgave 1/2020

Journal of Psychopathology and Behavioral Assessment 1/2020 Naar de uitgave