Skip to main content
Log in

Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones?

Journal of Abnormal Child Psychology Aims and scope Submit manuscript

Abstract

Optimizing methods of combining discrepant diagnostic information from multiple sources is one of the more daunting tasks facing the field of child psychopathology. Several researchers have asserted that complex information-combining schemes, those in which certain information or sources of information are weighted differently from others, are preferable. This study provides theoretical and empirical evidence that simple information-combining schemes, those in which all information from all sources is weighted equally, will as a rule work as well as complex schemes and may even work better. The implications of these findings for diagnostic instrument and algorithm design are discussed. A two-step diagnostic procedure utilizing a simple information-combining scheme is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity.Psychological Bulletin, 101, 213–232.

    Google Scholar 

  • American Psychiatric Association. (1980).Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.

    Google Scholar 

  • American Psychiatric Association. (1987).Diagnostic and statistical manual of mental disorders (3rd. ed., rev.). Washington, DC: Author.

    Google Scholar 

  • Bird, H. R., Canino, G., Rubio-Stipec, M., Gould, M. S., Ribera, J., Sesman, M., Woodbury, M., Huertas-Goldman, S., Pagan, A., Sanchez-Lacay, A., and Moscoso, M. (1988). Estimates of the prevalence of childhood maladjustment in a community survey in Puerto Rico.Archives of General Psychiatry, 45, 1120–1126.

    Google Scholar 

  • Bird, H. R., Gould, M. S., & Staghezza, B. (1990). Maximizing diagnostic discrimination: Analyses on epidemiologic data to combine different information types and sources.Scientific Proceedings of the Annual Meeting of the American Academy of Child and Adolescent Psychiatry, 6, 43.

    Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 20, 37–46.

    Google Scholar 

  • Cohen, J. (1990). Things that I have learned (so far).American Psychologist, 45, 1304–1312.

    Google Scholar 

  • Cohen, P., Velez, C. N., Brook, J. S., and Smith, J. (1989). Mechanisms between the relationship between perinatal problems, early childhood illness, and psychopathy in late childhood and adolescence.Child Development, 60, 701–709.

    Google Scholar 

  • Cohen, P., Velez, C. N., Kohn, M., Schwab-Stone, M., & Johnson, J. (1987). Child psychiatric diagnosis by computer algorithm: Theoretical issues and empirical tests.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 631–638.

    Google Scholar 

  • Costello, A., & Edelbrock, C. (1985). Detection of psychiatric disorders in pediatric primary care: A preliminary report.Journal of the American Academy of Child and Adolescent Psychiatry, 24, 771–774.

    Google Scholar 

  • Costello, E. J., Edelbrock, C., & Costello, A. J. (1985). Validity of the NIMH Diagnostic Interview Schedule for Children: A comparison between psychiatric and pediatric referrals.Journal of Abnormal Child Psychology, 13, 579–595.

    Google Scholar 

  • Dawes, R. M. (1971). A case study of graduate admissions: Application of three principles of human decision making.American Psychologist, 26, 180–188.

    Google Scholar 

  • Dawes, R. M. (1979). The robust beauty of improper linear models in decision making.American Psychologist, 34, 571–582.

    Google Scholar 

  • Goldberg, L. R. (1970). Man versus model of man: A rationale, plus some evidence for a method of improving on clinical inferences.Psychological Bulletin, 73, 422–432.

    Google Scholar 

  • Green, B. F., Jr. (1977). Parameter sensitivity in multivariate methods.Multivariate Behavioral Research, 12, 263–288.

    Google Scholar 

  • Gulliksen, H. (1985).Psychometric theory. Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Jensen, P. S., Traylor, J., Xenakis, S. N., & Davis, H. (1988). Child psychopathology rating scales and interrater agreement: I. Parents' gender and psychiatric symptoms.Journal of the American Academy of Child Psychiatry, 27, 442–450.

    Google Scholar 

  • Jensen, P. S., Xenakis, S. N., Davis, H., & DeGroot, J. (1988). Child psychopathology rating scales and interrater agreement: II. Child and family characteristics.Journal of the American Academy of Child Psychiatry, 27, 451–461.

    Google Scholar 

  • Leckman, J. F., Sholomskas, D., Thompson, W. D., Belanger, A., and Weissman, M. M. (1982). Best estimate of lifetime psychiatric diagnosis.Archives of General Psychiatry, 39, 879–883.

    Google Scholar 

  • Loeber, R., Green, S. M., & Lahey, B. B. (1989). Mental health professionals' perceptions of the utility of children, parents, and teachers as informants on childhood psychopathology.Journal of Clinical Child Psychology, 19, 136–143.

    Google Scholar 

  • Loeber, R., Green, S. M., Lahey, B. B., & Stouthamer-Loeber, M. (1990). Optimal informants on childhood disruptive behaviors.Development and Psychopathology, 1, 317–337.

    Google Scholar 

  • Loeber, R., Green, S. M., Lahey, B. B., & Stouthamer-Loeber, M. (1991). Differences and similarities between children, mothers, and teachers as informants on disruptive behavior disorders.Journal of Abnormal Child Psychology, 19, 75–95.

    Google Scholar 

  • Milich, R., Widiger, T., & Landau, S. (1987). Differential diagnosis of attention deficit and conduct disorders using conditional probabilities.Journal of Consulting and Clinical Psychology, 55, 762–767.

    Google Scholar 

  • Reich, W., & Earls, F. (1987). Rules for making psychiatric diagnoses in children on the basis of multiple sources of information.Journal of Abnormal Child Psychology, 15, 601–616.

    Google Scholar 

  • Shaffer, D., Fisher, P., Piacentini, J., Schwab-Stone, M., & Wicks, J. (1989).Diagnostic Interview Schedule for Children-Second Revision (DISC-2). New York: New York State Psychiatric Institite.

    Google Scholar 

  • Shaffer, D., Schwab-Stone, M., Fisher, P. Davies, M., Piacentini, J., & Gioia, P. (1988).A revised version of the Diagnostic Interview Schedule for Children (DISC-R);Results of a field trial and proposals for a new instrument (DISC-2). Washington, DC: National Institute of Mental Health.

    Google Scholar 

  • Spitzer, R. L. (1983). Psychiatric diagnosis: Are clinicians still necessary?Comprehensive Psychiatry, 24, 399–411.

    Google Scholar 

  • Velez, C. N., Johnson, J., and Cohen, P. (1989). Longitudinal analyses of selected risk factors for childhood psychopathology.Journal of the American Academy of Child and Adolescent Psychiatry, 28, 861–864.

    Google Scholar 

  • Wainer, H. (1976). Estimating coefficients in linear models: It don't make no nevermind.Psychological Bulletin, 83, 312–317.

    Google Scholar 

  • Wiggins, N., & Kohen, E. S. (1971). Man versus model of man revisited: The forecasting of graduate school success.Journal of Personality and Social Psychology, 19, 100–106.

    Google Scholar 

  • Wilks, S. S. (1938). Weighting systems for linear functions of correlated variables when there is no dependent variable.Psychometrika, 8, 23–40.

    Google Scholar 

  • Young, J. G., O'Brien, J. D., Gutterman, E. M., and Cohen, P. (1987). Research on the Clinical Interview.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 613–620.

    Google Scholar 

  • Zahner, G., Leckman, J., Benedict, T., & Leo-Summers, L. (1989).The clinical process of assembling psychodiagnostic information from parents, children, and teachers: Recommendations for multiple informant algorithms for the Diagnostic Interview Schedule for Children Report to the Epidemiology and Psychopathology Research Branch, Division of Clinical Research, NIMH, Washington, DC.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Piacentini, J.C., Cohen, P. & Cohen, J. Combining discrepant diagnostic information from multiple sources: Are complex algorithms better than simple ones?. J Abnorm Child Psychol 20, 51–63 (1992). https://doi.org/10.1007/BF00927116

Download citation

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00927116

Keywords

Navigation