Skip to main content
Log in

Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators

  • Published:
Journal of Abnormal Child Psychology Aims and scope Submit manuscript

Abstract

Using a multimethod multistage screening procedure, the authors interviewed 201 parents and their children with the Diagnostic Interview Schedule for Children (DISC 2.1). In addition, parents completed the Child Behavior Checklist (CBCL) and other survey measures, while their children completed self-report scales. Receiver operating characteristic (ROC) analyses were done to determine optimal cutpoints on the CBCL, referenced to DISC diagnostic “caseness.” DISC diagnoses, DISC “stem” symptoms, CBCL scores, and CBCL ROC-cutpoints were compared against “external validators,” in order to determine the comparative advantages of each approach for assessing child psychopathology. Overall findings suggest that the controversies about “best” assessment strategies may be artificial: When both assessment approaches are compared using similar methods, they are reasonably comparable. However, highly specific diagnostic categories may show fewer relationships with external validators and may therefore need more systematic validational studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Achenbach, T. M. (1988). Integrating assessment and taxonomy. In M. Rutter, A. H. Tuma, & I. S. Lann (Eds.),Assessment and diagnosis in child psychopathology (pp. 300–343). New York: Guilford Press.

    Google Scholar 

  • Achenbach, T. M., & Edelbrock, C. S. (1983).Manual for the Child Behavior Checklist and Revised Child Behavior Profile. Burlington, VT: University Associates in Psychiatry.

    Google Scholar 

  • American Psychiatric Association. (1980).Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.

    Google Scholar 

  • American Psychiatric Association. (1987).Diagnostic and statistical manual of mental disorders (3rd ed., rev.). Washington, DC: Author.

    Google Scholar 

  • Bird, H., Gould, M., & Staghezza, B. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research.Journal of the American Academy of Child and Adolescent Psychiatry, 31, 78–85.

    PubMed  Google Scholar 

  • Bird, H., Yager, T. J., Staghezza, B., Gould, M. S., Canino, G., & Rubio-Stipec, M. A. (1990). Impairment in the epidemiologic measurement of childhood psychopathology in the community.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 796–803.

    PubMed  Google Scholar 

  • Brunshaw, J. M., & Szatmari, P. (1988). The agreement between behavior checklists and structured psychiatric interviews for children.Canadian Journal of Psychiatry, 33, 474–481.

    Google Scholar 

  • Cloninger, C. R. (1989). Establishment of diagnostic validity in psychiatric illness: Robins and Guze's method revisited. In L. N. Robins & J. E. Barrett (Eds.),The validity of psychiatric diagnosis (pp. 9–18). New York: Raven Press.

    Google Scholar 

  • Coddington, R. D. (1972). The significance of life events as etiologic factors in the diseases of children: A study of a normal population.Journal of Psychosomatic Research, 16, 205–213.

    PubMed  Google Scholar 

  • Cohen, P., Velez, N., Kohn, M., Schwab-Stone, M., & Johnson, J. (1987). Child psychiatric diagnosis by computer algorithm: Theoretical issues and empirical tests.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 631–638.

    PubMed  Google Scholar 

  • Costello, A. J., Edelbrock, C. S., Kalas, R., Kessler, M. K., & Klaric, S. A. (1982). NIMH Diagnostic Interview Schedule for Children, Bethesda, MD; National Institute of Mental Health.

  • Costello, E., Edelbrock, C., & Costello, A. (1985). Validity of the NIMH Diagnostic Interview Schedule for Children: A comparison between psychiatric and pediatric referrals.Journal of Abnormal Child Psychology, 13, 579–595.

    PubMed  Google Scholar 

  • Edelbrock, C., & Costello, A. (1988). Convergence between statistically derived behavior problem syndromes and child psychiatric diagnoses.Journal of Abnormal Child Psychology, 16, 219–231.

    PubMed  Google Scholar 

  • Gould, M. S., Bird, H., & Jaramillo, B. S. (1993). Correspondence between statistically derived behavior problem syndromes and child psychiatric diagnoses in a community sample.Journal of Abnormal Child Psychology, 21, 287–313.

    PubMed  Google Scholar 

  • Holmes, T. H., & Rahe, R. H. (1967). The social readjustment rating scale.Journal of Psychosomatic Research, 11, 213–218.

    PubMed  Google Scholar 

  • Jensen, P. S., Lewis, R. L., & Xenakis, S. N. (1986). The military family in review: Context, risk, and prevention.Journal of the American Academy of Child and Adolescent Psychiatry, 25, 225–234.

    Google Scholar 

  • Jensen, P., Roper, M., Fisher, P., Piacentini, J., Canino, G., Richters, J., Rubio-Stipec, M., Dulcan, M., Goodman, S., Danes, M., Rae, D., Shaffer, D., Bird, A., Lahey, B., Schwab-Stone, M. (1995). Test-retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1).Archives of General Psychiatry, 52, 61–71.

    PubMed  Google Scholar 

  • Jensen, P. S., Saltzberg, A. D., Richters, J., Watanabe, H. K., & Roper, M. (1993). Scales, diagnoses, and child psychopathology. I. CBCL and DISC relationships.Journal of the American Academy of Child and Adolescent Psychiatry, 32, 397–406.

    PubMed  Google Scholar 

  • Kendell, R. E. (1989). Clinical validity. In L. N. Robins & J. E. Barrett (Eds.),The validity of psychiatric diagnosis (pp. 305–323). New York: Raven Press.

    Google Scholar 

  • Kovacs, M., & Beck, A. T. (1977). An empirical-clinical approach toward a definition of childhood depression. In J. Schulterbrandt & A. Raskin (Eds.),Depression in childhood (pp. 1–25). New York: Raven Press.

    Google Scholar 

  • Koriath, U., Gualtieri, C. T., Van Bourgondien, M. E., Quade, D., & Werry, J. S. (1985). Construct validity of clinical diagnosis in pediatric psychiatry: Relationship among measures.Journal of the American Academy of Child and Adolescent Psychiatry, 24, 429–436.

    Google Scholar 

  • Radloff, L. S. (1977). The CES-D Scale: A self-report depression scale for research in the general population.Applied Psychological Measurement, 3, 385–401.

    Google Scholar 

  • Reynolds, C. R., & Richmond, B. O. (1978). What I think and feel: A revised measure of children's manifest anxiety.Journal of Abnormal Child Psychology, 6, 271–280.

    PubMed  Google Scholar 

  • Robins, E., & Guze, S. B. (1970). Establishment of diagnostic validity in psychiatric illness: Its application to schizophrenia.American Journal of Psychiatry, 126, 983–987.

    PubMed  Google Scholar 

  • Rubio-Stipec, M., Shrout, P. E., Canino, G., Jensen, P., Dulcan, M., Bird, H. R. (in press). Empirically defined symptom scales using the DISC 2.3.Journal of Abnormal Child Psychology.

  • Shaffer, D., Schwab-Stone, M., Regier, D., Fisher, P., Cohen, P., Piacentini, J., & Davies, M. (1991).Revised versions of the Diagnostic Interview Schedule for Children (DISC): Preparation, field testing, inter-rater, reliability and acceptability. Unpublished manuscript.

  • Sharpley, C. F., & Cross, D. G. (1982). A psychometric evaluation of the Dyadic Adjustment Scale.Journal of Marriage and the Family, 7, 739–741.

    Google Scholar 

  • Weinstein, S. R., Noam, G. G., Grimes, K., Stone, K., & Schwab-Stone, M. (1990). Convergence of DSM-III diagnoses and self-reported symptoms in child and adolescent inpatients.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 627–634.

    PubMed  Google Scholar 

  • Weissman, M. M., Warner, V., & Fendrich, F. (1990). Applying impairment criteria to children's psychiatric diagnosis.Journal of the American Academy of Child and Adolescent Psychiatry, 29, 789–795.

    PubMed  Google Scholar 

  • Werry, J. W., Reeves, J. C., Elkind, G. S. (1987). Attention deficit, conduct, oppositional, and anxiety disorders in children. I. A review of research on differentiating characteristics.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 133–143.

    PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

The opinions and assertions contained in this paper are the private views of the authors and are not to be construed as official or as reflecting the views of the Department of Health and Human Services, the National Institute of Mental Health, the Walter Reed Army Institute of Research, or the Department of the Army.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jensen, P.S., Watanabe, H.K., Richters, J.E. et al. Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. J Abnorm Child Psychol 24, 151–168 (1996). https://doi.org/10.1007/BF01441482

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01441482

Keywords

Navigation