Skip to main content
Log in

The Reliability and Validity of the Dominic Interactive: A Computerized Child Report Instrument for Mental Health Problems

  • Original Paper
  • Published:
Child & Youth Care Forum Aims and scope Submit manuscript

Abstract

Background

Children and youths’ self-report of mental health problems is considered essential but complicated.

Objective

This study examines the psychometric properties of the Dominic Interactive, a computerized DSM-IV based self-report questionnaire and explores informant correspondence.

Methods

The Dominic Interactive was administered to 214 Dutch children, 6–11 year old, 122 attended special education schools and 92 children attended public schools. Within 2 weeks 155 children were reassessed. Parents of 211 children completed a paper version of the Dominic Interactive.

Results

The findings showed moderate to good internal consistency and test-retest reliability, although stability increased with age. Factor structure concerning generalized anxiety disorder and major depressive disorder displayed ambiguous results. Comparing special education with public school children revealed that both parents and children in special education reported significantly more problems on almost all scales. The results on informant correspondence revealed that discrepancies in reports were not consistent across individual pairs; they were due to a few extreme cases. Eliminating these cases increased the agreement in reports.

Conclusions

Although more research is needed to determine the value of the Dominic Interactive, the Dominic Interactive has the potential to contribute with its unique features to the existing self-report instruments for screening and assessing child mental health.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. doi:10.1037/0033-2909.101.2.213.

    Article  PubMed  Google Scholar 

  • American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd rev. ed). Washington, DC: Author.

  • American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed). Washington, DC: Author.

  • American Psychiatric Association. (n.d.). DSM-5: The future of psychiatric diagnosis. Retrieved 8 Oct 2010, from http://www.dsm5.org.

  • Arseneault, L., Kim-Cohen, J., Taylor, A., Caspi, A., & Moffitt, T. E. (2005). Psychometric evaluation of 5- and 7-year-old children’s self-reports of conduct problems. Journal of Abnormal Child Psychology, 33, 537–550. doi:10.1007/s10802-005-6736-5.

    Article  PubMed  Google Scholar 

  • Bird, H. R., Gould, M. S., & Staghezza, B. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research. Journal of the American Academy of Child and Adolescent Psychiatry, 31, 78–85. doi:10.1097/00004583-199201000-00012.

    Article  PubMed  Google Scholar 

  • Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

    Google Scholar 

  • Boyle, M. H., Offord, D. R., Racine, Y., Sanford, D., Szatmari, P., Fleming, J. E., et al. (1993). Evaluation of the diagnostic interview for children and adolescents for use in general population samples. Journal of Abnormal Child Psychology, 21, 663–681. doi:10.1007/BF00916449.

    Article  PubMed  Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational Psychology Measurement, 20, 37–46. doi:10.1177/001316446002000104.

    Article  Google Scholar 

  • Cohen, J. (1977). Statistical power analysis for the behavioral sciences (revised ed.). New York: Academic Press.

  • Collett, B. R., Ohan, J. L., & Myers, K. M. (2003a). Ten-year review of rating scales. V: Scales assessing attention-deficit/hyperactivity disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1015–1037. doi:10.1097/01.CHI.0000070245.24125.B6.

    Article  PubMed  Google Scholar 

  • Collett, B. R., Ohan, J. L., & Myers, K. M. (2003b). Ten-year review of rating scales. VI: Scales assessing externalizing behaviors. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1143–1170. doi:10.1097/01.chi.0000081821.25107.e7.

    Article  PubMed  Google Scholar 

  • Comer, J. S., & Kendall, P. C. (2004). A symptom-level examination of parent-child agreement in the diagnosis of anxious youth. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 878–886. doi:10.1097/01.chi.0000125092.35109.c5.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child & Adolescent Psychology, 40, 1–9. doi:10(1080/15374416),2011,533405.

    Google Scholar 

  • De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16, 330–334. doi:10.1037/1040-3590.16.3.330.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509. doi:10.1037/0033-2909.131.4.483.

    Article  PubMed  Google Scholar 

  • Dugré, S., Trudel, M., & Valla, J. P. (2001). Considérations individuelles et culturelles en santé mentale des enfants: Le Dominique à l’épreuve. Revue Canadienne de Psycho-Education, 30, 119–138.

    Google Scholar 

  • Edelbrock, C., Costello, A. J., Dulcan, M. K., Calabro-Conover, N., & Kalas, R. (1986). Parent-child agreement on child psychiatric symptoms assessed via structured interview. Journal of Child Psychology and Psychiatry, 27, 181–190. doi:10.1111/j.1469-7610.1986.tb02329.x.

    PubMed  Google Scholar 

  • Edelbrock, C., Costello, A. J., Dulcan, M. K., Kalas, R., & Calabro-Conover, N. (1985). Age differences in the reliability of the psychiatric interview of the child. Child Development, 56, 265–275. doi:10.1111/j.1467-8624.1985.tb00104.x.

    Article  PubMed  Google Scholar 

  • Ederer, E. M. (2004). Mental health problems in young children: Self-reports and significant others as informants. Psychology Science, 46, 123–140.

    Google Scholar 

  • Fallon, T., & Schwab-Stone, M. (1994). Determinants of reliability in psychiatric survey of children aged 6–12. Journal of Child Psychology and Psychiatry, 35, 1391–1408. doi:10.1111/j.1469-7610.1994.tb01282.x.

    Article  PubMed  Google Scholar 

  • Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613–619. doi:10.1177/001316447303300309.

    Article  Google Scholar 

  • Grills, A. E., & Ollendick, T. H. (2002). Issues in parent-child agreement: The case of structured diagnostic interviews. Clinical Child and Family Psychology Review, 5, 57–86. doi:10.1023/A:1014573708569.

    Article  PubMed  Google Scholar 

  • Hartman, C. A., Hox, J., Mellenbergh, G. J., Boyle, M. H., Offord, D. R., Racine, Y., et al. (2001). DSM-IV internal construct validity: When a taxonomy meets data. Journal of Child Psychology and Psychiatry, 42, 817–836. doi:10.1111/1469-7610.00778.

    Article  PubMed  Google Scholar 

  • Hu, L., & Bentler, P. M. (1999). Cut-off criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6, 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  • Ialongo, N. S., Edelsohn, G., & Kellam, S. G. (2001). A further look at the prognostic power of young children’s reports of depressed mood and feelings. Child Development, 72, 736–747. doi:10.1111/1467-8624.00312.

    Article  PubMed  Google Scholar 

  • Jensen, P. S., Rubio-Stipec, M., Canino, G., Bird, H. R., Dulcan, M. K., Schwab-stone, M. E., et al. (1999). Parent and child contributions to diagnosis of mental disorder: Are both informants always necessary? Journal of the American Academy of Child and Adolescent Psychiatry, 38, 1569–1579. doi:10.1097/00004583-199912000-00019.

    Article  PubMed  Google Scholar 

  • Kittler, J. E., Menard, W., & Phillips, K. A. (2007). Weight concerns in individuals with body dysmorphic disorder. Eating Behaviors, 8, 115–120. doi:10.1016/j.eatbeh.2006.02.006.

    Article  PubMed  Google Scholar 

  • Klein, D. N., Dougherty, L. R., & Olino, T. M. (2005). Toward guidelines for evidence-based assessment of depression in children and adolescents. Journal of Clinical Child & Adolescent Psychology, 34, 412–432. doi:10.1207/s15374424jccp3403_3.

    Google Scholar 

  • Lahey, B. B., Applegate, B., Waldman, I. D., Loft, J. D., Hankin, B. L., & Rick, J. (2004). The structure of child and adolescent psychopathology: Generating new hypothesis. Journal of Abnormal Psychology, 113, 358–385. doi:10.1037/0021-843X.113.3.358.

    Article  PubMed  Google Scholar 

  • Lahey, B. B., Rathouz, P. J., Van Hulle, C., Urbano, R. C., Krueger, R. F., Applegate, B., et al. (2008). Testing structural models of DSM-IV symptoms of common forms of child and adolescent psychopathology. Journal of Abnormal Child Psychology, 36, 187–206. doi:10.1007/s10802-007-9169-5.

    Article  PubMed  Google Scholar 

  • Landis, J. R., & Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. doi:10.2307/2529310.

    Article  PubMed  Google Scholar 

  • Linares Scott, T. J., Short, E. J., Singer, L. T., Russ, S. W., & Minnes, S. (2006). Psychometric properties of the Dominic interactive assessment. A computerized self-report for children. Assessment, 13, 16–26. doi:10.1177/1073191105284843.

    Article  Google Scholar 

  • Mash, E. J., & Hunsley, J. (2005). Evidence-based assessment of child and adolescent disorders: Issues and challenges. Journal of Clinical Child & Adolescent Psychology, 34, 362–379. doi:10.1207/s15374424jccp3403_1.

    Google Scholar 

  • Measelle, J. R., Ablow, J. C., Cowan, P. A., & Cowan, C. P. (1998). Assessing young children’s views of their academic, social, and emotional lives: An evaluation of the self-perception scales of the Berkeley Puppet interview. Child Development, 69, 1556–1576. doi:10.1111/j.1467-8624.1998.tb06177.x.

    PubMed  Google Scholar 

  • Murphy, D. A., Marelich, W. D., & Hoffman, D. (2000). Assessment of anxiety and depression in young children: Support for two separate constructs. Journal of Clinical Child Psychology, 29, 383–391. doi:10.1207/S15374424JCCP2903_9.

    Article  PubMed  Google Scholar 

  • Muthén, L. K., & Muthén, B. O. (1998–2006). MPLUS user’s guide (4th ed). Los Angeles, CA: Muthén & Muthén.

  • Ollendick, T. H., Grills, A. E., & King, N. J. (2001). Applying developmental theory to the assessment and treatment of childhood disorders: Does it make a difference? Clinical Psychology and Psychotherapy, 8, 304–314. doi:10.1002/cpp.311.

    Article  Google Scholar 

  • Schwab-Stone, M., Fallon, T., Briggs, M., & Crowther, B. (1994). Reliability of diagnostic reporting for children aged 6–11 years: A test-retest study of the Diagnostic interview schedule for children-revised. American Journal of Psychiatry, 151, 1048–1054.

    PubMed  Google Scholar 

  • Shojaei, T., Wazana, A., Pitrou, I., Gilbert, F., Bergeron, L., Valla, J. P., et al. (2009). Psychometric properties of the Dominic interactive in a large French sample. The Canadian Journal of Psychiatry, 54, 767–776.

    Google Scholar 

  • Silverman, W. K., & Ollendick, T. H. (2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. Journal of Clinical Child & Adolescent Psychology, 34, 380–411. doi:10.1207/s15374424jccp3403_2.

    Google Scholar 

  • Troutt, M. D. (2006). Regression, 10 k rule of thumb for. Encyclopedia of Statistical Sciences. New York: Wiley.

  • Valla, J. P. (2000). Instruction manual for the Dominic interactive. In J. P. Valla (Ed.), The Dominic interactive. Montreal: DIMAT.

    Google Scholar 

  • Valla, J. P., Bergeron, L., Bérubé, H., Gaudet, N., & St-Georges, M. (1994). A structured pictorial questionnaire to assess DSM-III-R-based diagnoses in children (6–11 years): Development, validity and reliability. Journal of Abnormal Child Psychology, 22, 403–423. doi:10.1007/BF02168082.

    Article  PubMed  Google Scholar 

  • Valla, J. P., Bergeron, L., Bidaut-Russel, M., St-Georges, M., & Gaudet, N. (1997). Reliability of the Dominic-R: A young child mental health questionnaire combining visual and auditory stimuli. Journal of Child Psychology and Psychiatry, 38, 717–724. doi:10.1111/j.1469-7610.1997.tb01698.x.

    Article  PubMed  Google Scholar 

  • Valla, J. P., Kovess, V., Chan Chee, C., Berthiaume, C., Vantalon, V., Piquet, C., et al. (2002). A French study of the Dominic interactive. Social Psychiatry and Psychiatric Epidemiology, 37, 441–448. doi:10.1007/s00127-002-0575-2.

    Article  PubMed  Google Scholar 

  • Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM-IV. Journal of Abnormal Psychology, 114, 522–536. doi:10.1037/0021-843X.114.4.522.

    Article  PubMed  Google Scholar 

  • Weems, C. F., Feaster, D. J., Horigian, V. E., & Robbins, M. S. (2011). Parent and child agreement on anxiety disorder symptoms using the DISC predictive scales. Assessment, 18, 213–216. doi:10.1177/1073191110389278.

    Article  PubMed  Google Scholar 

  • Weems, C. F., Taylor, L. K., Marks, A. B., & Varela, R. E. (2010). Anxiety sensitivity in childhood and adolescence: Parent reports and factors that influence associations with child reports. Cognitive Therapy and Research, 34, 303–315. doi:10.1007/s10608-008-9222-x.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rowella C. W. M. Kuijpers.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kuijpers, R.C.W.M., Otten, R., Krol, N.P.C.M. et al. The Reliability and Validity of the Dominic Interactive: A Computerized Child Report Instrument for Mental Health Problems. Child Youth Care Forum 42, 35–52 (2013). https://doi.org/10.1007/s10566-012-9185-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10566-012-9185-7

Keywords

Navigation