Abstract
Using a multimethod multistage screening procedure, the authors interviewed 201 parents and their children with the Diagnostic Interview Schedule for Children (DISC 2.1). In addition, parents completed the Child Behavior Checklist (CBCL) and other survey measures, while their children completed self-report scales. Receiver operating characteristic (ROC) analyses were done to determine optimal cutpoints on the CBCL, referenced to DISC diagnostic “caseness.” DISC diagnoses, DISC “stem” symptoms, CBCL scores, and CBCL ROC-cutpoints were compared against “external validators,” in order to determine the comparative advantages of each approach for assessing child psychopathology. Overall findings suggest that the controversies about “best” assessment strategies may be artificial: When both assessment approaches are compared using similar methods, they are reasonably comparable. However, highly specific diagnostic categories may show fewer relationships with external validators and may therefore need more systematic validational studies.
Similar content being viewed by others
References
Achenbach, T. M. (1988). Integrating assessment and taxonomy. In M. Rutter, A. H. Tuma, & I. S. Lann (Eds.),Assessment and diagnosis in child psychopathology (pp. 300–343). New York: Guilford Press.
Achenbach, T. M., & Edelbrock, C. S. (1983).Manual for the Child Behavior Checklist and Revised Child Behavior Profile. Burlington, VT: University Associates in Psychiatry.
American Psychiatric Association. (1980).Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
American Psychiatric Association. (1987).Diagnostic and statistical manual of mental disorders (3rd ed., rev.). Washington, DC: Author.
Bird, H., Gould, M., & Staghezza, B. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research.Journal of the American Academy of Child and Adolescent Psychiatry, 31, 78–85.
Bird, H., Yager, T. J., Staghezza, B., Gould, M. S., Canino, G., & Rubio-Stipec, M. A. (1990). Impairment in the epidemiologic measurement of childhood psychopathology in the community.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 796–803.
Brunshaw, J. M., & Szatmari, P. (1988). The agreement between behavior checklists and structured psychiatric interviews for children.Canadian Journal of Psychiatry, 33, 474–481.
Cloninger, C. R. (1989). Establishment of diagnostic validity in psychiatric illness: Robins and Guze's method revisited. In L. N. Robins & J. E. Barrett (Eds.),The validity of psychiatric diagnosis (pp. 9–18). New York: Raven Press.
Coddington, R. D. (1972). The significance of life events as etiologic factors in the diseases of children: A study of a normal population.Journal of Psychosomatic Research, 16, 205–213.
Cohen, P., Velez, N., Kohn, M., Schwab-Stone, M., & Johnson, J. (1987). Child psychiatric diagnosis by computer algorithm: Theoretical issues and empirical tests.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 631–638.
Costello, A. J., Edelbrock, C. S., Kalas, R., Kessler, M. K., & Klaric, S. A. (1982). NIMH Diagnostic Interview Schedule for Children, Bethesda, MD; National Institute of Mental Health.
Costello, E., Edelbrock, C., & Costello, A. (1985). Validity of the NIMH Diagnostic Interview Schedule for Children: A comparison between psychiatric and pediatric referrals.Journal of Abnormal Child Psychology, 13, 579–595.
Edelbrock, C., & Costello, A. (1988). Convergence between statistically derived behavior problem syndromes and child psychiatric diagnoses.Journal of Abnormal Child Psychology, 16, 219–231.
Gould, M. S., Bird, H., & Jaramillo, B. S. (1993). Correspondence between statistically derived behavior problem syndromes and child psychiatric diagnoses in a community sample.Journal of Abnormal Child Psychology, 21, 287–313.
Holmes, T. H., & Rahe, R. H. (1967). The social readjustment rating scale.Journal of Psychosomatic Research, 11, 213–218.
Jensen, P. S., Lewis, R. L., & Xenakis, S. N. (1986). The military family in review: Context, risk, and prevention.Journal of the American Academy of Child and Adolescent Psychiatry, 25, 225–234.
Jensen, P., Roper, M., Fisher, P., Piacentini, J., Canino, G., Richters, J., Rubio-Stipec, M., Dulcan, M., Goodman, S., Danes, M., Rae, D., Shaffer, D., Bird, A., Lahey, B., Schwab-Stone, M. (1995). Test-retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1).Archives of General Psychiatry, 52, 61–71.
Jensen, P. S., Saltzberg, A. D., Richters, J., Watanabe, H. K., & Roper, M. (1993). Scales, diagnoses, and child psychopathology. I. CBCL and DISC relationships.Journal of the American Academy of Child and Adolescent Psychiatry, 32, 397–406.
Kendell, R. E. (1989). Clinical validity. In L. N. Robins & J. E. Barrett (Eds.),The validity of psychiatric diagnosis (pp. 305–323). New York: Raven Press.
Kovacs, M., & Beck, A. T. (1977). An empirical-clinical approach toward a definition of childhood depression. In J. Schulterbrandt & A. Raskin (Eds.),Depression in childhood (pp. 1–25). New York: Raven Press.
Koriath, U., Gualtieri, C. T., Van Bourgondien, M. E., Quade, D., & Werry, J. S. (1985). Construct validity of clinical diagnosis in pediatric psychiatry: Relationship among measures.Journal of the American Academy of Child and Adolescent Psychiatry, 24, 429–436.
Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population.Applied Psychological Measurement, 3, 385–401.
Reynolds, C. R., & Richmond, B. O. (1978). What I think and feel: A revised measure of children's manifest anxiety.Journal of Abnormal Child Psychology, 6, 271–280.
Robins, E., & Guze, S. B. (1970). Establishment of diagnostic validity in psychiatric illness: Its application to schizophrenia.American Journal of Psychiatry, 126, 983–987.
Rubio-Stipec, M., Shrout, P. E., Canino, G., Jensen, P., Dulcan, M., Bird, H. R. (in press). Empirically defined symptom scales using the DISC 2.3.Journal of Abnormal Child Psychology.
Shaffer, D., Schwab-Stone, M., Regier, D., Fisher, P., Cohen, P., Piacentini, J., & Davies, M. (1991).Revised versions of the Diagnostic Interview Schedule for Children (DISC): Preparation, field testing, inter-rater, reliability and acceptability. Unpublished manuscript.
Sharpley, C. F., & Cross, D. G. (1982). A psychometric evaluation of the Dyadic Adjustment Scale.Journal of Marriage and the Family, 7, 739–741.
Weinstein, S. R., Noam, G. G., Grimes, K., Stone, K., & Schwab-Stone, M. (1990). Convergence of DSM-III diagnoses and self-reported symptoms in child and adolescent inpatients.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 627–634.
Weissman, M. M., Warner, V., & Fendrich, F. (1990). Applying impairment criteria to children's psychiatric diagnosis.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 789–795.
Werry, J. W., Reeves, J. C., Elkind, G. S. (1987). Attention deficit, conduct, oppositional, and anxiety disorders in children. I. A review of research on differentiating characteristics.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 133–143.
Author information
Authors and Affiliations
Additional information
The opinions and assertions contained in this paper are the private views of the authors and are not to be construed as official or as reflecting the views of the Department of Health and Human Services, the National Institute of Mental Health, the Walter Reed Army Institute of Research, or the Department of the Army.
Rights and permissions
About this article
Cite this article
Jensen, P.S., Watanabe, H.K., Richters, J.E. et al. Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. J Abnorm Child Psychol 24, 151–168 (1996). https://doi.org/10.1007/BF01441482
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01441482