Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 2/2020

08-01-2020

Making the Most of it: Application of Planned Missingness Design to Increase the Efficiency of Diagnostic Assessment

Auteurs: Zvi R. Shapiro, Cynthia Huang-Pollock, John W. Graham, Kristina Neely

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 2/2020

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Multimethod assessment is recommended as “best practice” in clinical assessment and is often implemented through the combined use of symptom rating scales and structured interviews. While this approach increases confidence in the validity of assessment, it also increases burden, expense, and leads to the accumulation of redundant information. To address this problem, we evaluate the use of a planned missingness design within the framework of adult Attention Deficit/Hyperactivity Disorder (ADHD) assessment. In a sample of 169 young adults, we fit a two-method measurement (TMM) model using ADHD symptoms obtained from rating scales and a structured diagnostic interview. Based on an estimated 8:1 differential between the cost of conducting an in-person diagnostic interview vs. completing questionnaires online, we conducted a series of Monte Carlo simulations to determine the utility of combining TMM with a planned missingness design. We find that even when costs are kept constant, statistical power of the TMM/planned missingness design was equal to the power that would have been obtained had nearly twice the number of participants with complete data been recruited. Conversely, costs could be decreased by 20–25%, while maintaining statistical power equivalent to a design with complete data. Our results suggest the TMM design is a promising technique for reducing the cost and burden of diagnostic assessment within research settings.
Voetnoten
1
Three participants who had reported elevated scores on the CAARS did not attend the on-campus laboratory visit. They were never enrolled their scores were not included in the study whose total N = 169.
 
Literatuur
go back to reference Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-age Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-age Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families.
go back to reference Achenbach, T. M., & Rescorla, L. A. (2003). Manual for the ASEBA Adult Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families. Achenbach, T. M., & Rescorla, L. A. (2003). Manual for the ASEBA Adult Forms & Profiles. Burlington: University of Vermont, Research Center for Children, Youth, & Families.
go back to reference Angold, A., & Fisher, P. W. (1999). Interviewer-based interviews. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 34–64). New York: Guilford Press. Angold, A., & Fisher, P. W. (1999). Interviewer-based interviews. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 34–64). New York: Guilford Press.
go back to reference Ash, P. (1949). The reliability of psychiatric diagnoses. The Journal of Abnormal and Social Psychology, 44(2), 272.CrossRef Ash, P. (1949). The reliability of psychiatric diagnoses. The Journal of Abnormal and Social Psychology, 44(2), 272.CrossRef
go back to reference Barkley, R. A. (2006). Attention-deficit hyperactivity disorder, third edition: A handbook for diagnosis and treatment (3rd ed.). New York: Guilford. Barkley, R. A. (2006). Attention-deficit hyperactivity disorder, third edition: A handbook for diagnosis and treatment (3rd ed.). New York: Guilford.
go back to reference Biederman, J., Faraone, S. V., Doyle, A., Lehman, B. K., Kraus, I., Perrin, J., & Tsuang, M. T. (1993). Convergence of the child-behavior checklist with structured interview-based psychiatric diagnoses of Adhd children with and without comorbidity. Journal of Child Psychology and Psychiatry and Allied Disciplines, 34(7), 1241–1251. https://doi.org/10.1111/j.1469-7610.1993.tb01785.x.CrossRef Biederman, J., Faraone, S. V., Doyle, A., Lehman, B. K., Kraus, I., Perrin, J., & Tsuang, M. T. (1993). Convergence of the child-behavior checklist with structured interview-based psychiatric diagnoses of Adhd children with and without comorbidity. Journal of Child Psychology and Psychiatry and Allied Disciplines, 34(7), 1241–1251. https://​doi.​org/​10.​1111/​j.​1469-7610.​1993.​tb01785.​x.CrossRef
go back to reference Brown, T. A. (2015). Confirmatory factor analysis for applied research, 2nd Edition. New York: Guilford Publications. Brown, T. A. (2015). Confirmatory factor analysis for applied research, 2nd Edition. New York: Guilford Publications.
go back to reference Conners, C. K. (2008). Conners 3rd edition manual. Toronto: Multi-Health Systems. Conners, C. K. (2008). Conners 3rd edition manual. Toronto: Multi-Health Systems.
go back to reference Conners, C. K., Epstein, J., & Johnson, D. E. (1999a). Conner's adult ADHD Diagonostic interview for DSM-IV: CAADID: Technical manual. New York: Multi-Health Systems. Conners, C. K., Epstein, J., & Johnson, D. E. (1999a). Conner's adult ADHD Diagonostic interview for DSM-IV: CAADID: Technical manual. New York: Multi-Health Systems.
go back to reference Conners, C. K., Erhardt, D., & Sparrow, E. P. (1999b). Conners' adult ADHD rating scales (CAARS): Technical manual. Toronto: Multi-Health Systems. Conners, C. K., Erhardt, D., & Sparrow, E. P. (1999b). Conners' adult ADHD rating scales (CAARS): Technical manual. Toronto: Multi-Health Systems.
go back to reference Derogatis, L. R. (1994). Symptom Checklist-90-R (SCL-90-R): Administration, scoring and procedures manual. Minneapolis: Pearson. Derogatis, L. R. (1994). Symptom Checklist-90-R (SCL-90-R): Administration, scoring and procedures manual. Minneapolis: Pearson.
go back to reference Enders, C. K. (2010). Applied missing data analysis. New York: Guilford Press. Enders, C. K. (2010). Applied missing data analysis. New York: Guilford Press.
go back to reference First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). User’s guide for the structured clinical interview for DSM-5 disorders, research version (SCID-5-RV). Arlington: American Psychiatric Association. First, M. B., Williams, J. B. W., Karg, R. S., & Spitzer, R. L. (2015). User’s guide for the structured clinical interview for DSM-5 disorders, research version (SCID-5-RV). Arlington: American Psychiatric Association.
go back to reference Frick, P. J., Barry, C. T., & Kamphaus, R. W. (2010). Clinical assessment of child and adolescent personality and behavior (Vol. 3). New York: Springer.CrossRef Frick, P. J., Barry, C. T., & Kamphaus, R. W. (2010). Clinical assessment of child and adolescent personality and behavior (Vol. 3). New York: Springer.CrossRef
go back to reference Graham, J. W. (2012). Missing data: Analysis and design. New York: Springer New York.CrossRef Graham, J. W. (2012). Missing data: Analysis and design. New York: Springer New York.CrossRef
go back to reference Hart, E. L., & Lahey, B. B. (1999). General child behavior rating scales. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 65–87). New York: Guilford Press. Hart, E. L., & Lahey, B. B. (1999). General child behavior rating scales. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 65–87). New York: Guilford Press.
go back to reference Hinshaw, S. P., & Nigg, J. T. (1999). Behavior rating scales in the assessment of disruptive behavior problems in childhood. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 91–126). New York: Guilford Press. Hinshaw, S. P., & Nigg, J. T. (1999). Behavior rating scales in the assessment of disruptive behavior problems in childhood. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 91–126). New York: Guilford Press.
go back to reference Hunsley, J., & Mash, E. J. (2008). A guide to assessments that work. New York: Oxford University Press.CrossRef Hunsley, J., & Mash, E. J. (2008). A guide to assessments that work. New York: Oxford University Press.CrossRef
go back to reference Jensen, P. S., Watanabe, H. K., Richters, J. E., Roper, M., Hibbs, E. D., Salzberg, A. D., & Liu, S. (1996). Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. Journal of Abnormal Child Psychology, 24(2), 151–168. https://doi.org/10.1007/BF01441482.PubMedCrossRef Jensen, P. S., Watanabe, H. K., Richters, J. E., Roper, M., Hibbs, E. D., Salzberg, A. D., & Liu, S. (1996). Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. Journal of Abnormal Child Psychology, 24(2), 151–168. https://​doi.​org/​10.​1007/​BF01441482.PubMedCrossRef
go back to reference Kaufman, J., Birmaher, B., Brent, D., Rao, U. M. A., Flynn, C., Moreci, P., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36(7), 980–988. https://doi.org/10.1097/00004583-199707000-00021.CrossRef Kaufman, J., Birmaher, B., Brent, D., Rao, U. M. A., Flynn, C., Moreci, P., et al. (1997). Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36(7), 980–988. https://​doi.​org/​10.​1097/​00004583-199707000-00021.CrossRef
go back to reference Kovacs, M. (1985). The Children's depression, inventory (CDI). Psychopharmacology Bulletin, 21(4), 995–998.PubMed Kovacs, M. (1985). The Children's depression, inventory (CDI). Psychopharmacology Bulletin, 21(4), 995–998.PubMed
go back to reference Little, T. D. (2013). Longitudinal structural equation modeling. New York: The Guilford Press. Little, T. D. (2013). Longitudinal structural equation modeling. New York: The Guilford Press.
go back to reference Magnússon, P., Smári, J., Sigurðardóttir, D., Baldursson, G., Sigmundsson, J., Kristjánsson, K., et al. (2006). Validity of self-report and informant rating scales of adult ADHD symptoms in comparison with a Semistructured diagnostic interview. Journal of Attention Disorders, 9(3), 494–503. https://doi.org/10.1177/1087054705283650.PubMedCrossRef Magnússon, P., Smári, J., Sigurðardóttir, D., Baldursson, G., Sigmundsson, J., Kristjánsson, K., et al. (2006). Validity of self-report and informant rating scales of adult ADHD symptoms in comparison with a Semistructured diagnostic interview. Journal of Attention Disorders, 9(3), 494–503. https://​doi.​org/​10.​1177/​1087054705283650​.PubMedCrossRef
go back to reference Martin, R. P., Hooper, S., & Snow, J. (1986). Behavior rating scale approaches to personality assessment in. Children and adolescents. In H. M. Knoff (Ed.), The assessment of child and adolescent personality (pp. 309–348). New York: Guilford Press. Martin, R. P., Hooper, S., & Snow, J. (1986). Behavior rating scale approaches to personality assessment in. Children and adolescents. In H. M. Knoff (Ed.), The assessment of child and adolescent personality (pp. 309–348). New York: Guilford Press.
go back to reference Mash, E. J., & Barkley, R. A. (2007). Assessment of childhood disorders (4th ed.). New York: Guilford Press. Mash, E. J., & Barkley, R. A. (2007). Assessment of childhood disorders (4th ed.). New York: Guilford Press.
go back to reference Muthen, L. K., & Muthen, B. O. (2012). Mplus user’s guide (7th ed.). CA: Los Angeles. Muthen, L. K., & Muthen, B. O. (2012). Mplus user’s guide (7th ed.). CA: Los Angeles.
go back to reference Neely, K. A., Wang, P., Chennavasin, A. P., Samimy, S., Tucker, J., Merida, A., Perez-Edgar, K., Huang-Pollock, C. (2017). Deficits in inhibitory force control in young adults with ADHD. Neuropsychologia, 99, 172–178.PubMedPubMedCentralCrossRef Neely, K. A., Wang, P., Chennavasin, A. P., Samimy, S., Tucker, J., Merida, A., Perez-Edgar, K., Huang-Pollock, C. (2017). Deficits in inhibitory force control in young adults with ADHD. Neuropsychologia, 99, 172–178.PubMedPubMedCentralCrossRef
go back to reference Rapport, M. D., Alderson, R. M., Kofler, M. J., Sarver, D. E., Bolden, J., & Sims, V. (2008). Working memory deficits in boys with attention-deficit/hyperactivity disorder (ADHD): The contribution of central executive and subsystem processes. Journal of Abnormal Child Psychology, 36(6), 825–837. https://doi.org/10.1007/s10802-008-9215-y.PubMedCrossRef Rapport, M. D., Alderson, R. M., Kofler, M. J., Sarver, D. E., Bolden, J., & Sims, V. (2008). Working memory deficits in boys with attention-deficit/hyperactivity disorder (ADHD): The contribution of central executive and subsystem processes. Journal of Abnormal Child Psychology, 36(6), 825–837. https://​doi.​org/​10.​1007/​s10802-008-9215-y.PubMedCrossRef
go back to reference Reynolds, W. M. (2003). Manual for the multidimensional anxiety questionnaire. Lutz: Psychological Assessment Resources. Reynolds, W. M. (2003). Manual for the multidimensional anxiety questionnaire. Lutz: Psychological Assessment Resources.
go back to reference Reynolds, C. R., & Kamphaus, R. W. (2015). Behavior assessment system for children – Third edition (BASC-3). Bloomington: Pearson. Reynolds, C. R., & Kamphaus, R. W. (2015). Behavior assessment system for children – Third edition (BASC-3). Bloomington: Pearson.
go back to reference Robins, L., Cottler, L., Bucholz, K., Compton, W., North, C., & Rourke, K. (2000). Diagnostic interview schedule for the DSM-IV (DIS-IV). St. Louis: Washington University School of Medicine. Robins, L., Cottler, L., Bucholz, K., Compton, W., North, C., & Rourke, K. (2000). Diagnostic interview schedule for the DSM-IV (DIS-IV). St. Louis: Washington University School of Medicine.
go back to reference Sattler, J. M. (2014). Foundations of behavioral, social, and clinical assessment of children. San Diego, CA: Jerome M Sattler Publisher Inc. Sattler, J. M. (2014). Foundations of behavioral, social, and clinical assessment of children. San Diego, CA: Jerome M Sattler Publisher Inc.
go back to reference Schmidt, H. O., & Fonda, C. P. (1956). The reliability of psychiatric diagnosis; a new look. Journal of Abnormal Psychology, 52(2), 262.PubMedCrossRef Schmidt, H. O., & Fonda, C. P. (1956). The reliability of psychiatric diagnosis; a new look. Journal of Abnormal Psychology, 52(2), 262.PubMedCrossRef
go back to reference Shaffer, D., Fisher, P., Lucas, C. P., Dulcan, M. K., & Schwab-Stone, M. E. (2000). NIMH diagnostic interview schedule for children version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 28–38. https://doi.org/10.1097/00004583-200001000-00014.CrossRef Shaffer, D., Fisher, P., Lucas, C. P., Dulcan, M. K., & Schwab-Stone, M. E. (2000). NIMH diagnostic interview schedule for children version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 28–38. https://​doi.​org/​10.​1097/​00004583-200001000-00014.CrossRef
go back to reference Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The Mini-international neuropsychiatric interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry, 59(Suppl 20), 22–23.PubMed Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., et al. (1998). The Mini-international neuropsychiatric interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. The Journal of Clinical Psychiatry, 59(Suppl 20), 22–23.PubMed
go back to reference Spitzer, R. L., & Fleiss, J. L. (1974). A re-analysis of the reliability of psychiatric diagnosis. The British Journal of Psychiatry, 125, 341–347.PubMedCrossRef Spitzer, R. L., & Fleiss, J. L. (1974). A re-analysis of the reliability of psychiatric diagnosis. The British Journal of Psychiatry, 125, 341–347.PubMedCrossRef
go back to reference Steiger, J., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the psychometric society annual meeting, Iowa City, Iowa. Steiger, J., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the psychometric society annual meeting, Iowa City, Iowa.
go back to reference Vitola, E. S., Bau, C. H., Salum, G. A., Horta, B. L., Quevedo, L., Barros, F. C., Pinheiro, R. T., Kieling, C., Rohde, L. A., & Grevet, E. H. (2017). Exploring DSM-5 ADHD criteria beyond young adulthood: Phenomenology, psychometric properties and prevalence in a large three-decade birth cohort. Psychological Medicine, 47(4), 744–754. https://doi.org/10.1017/S0033291716002853.PubMedCrossRef Vitola, E. S., Bau, C. H., Salum, G. A., Horta, B. L., Quevedo, L., Barros, F. C., Pinheiro, R. T., Kieling, C., Rohde, L. A., & Grevet, E. H. (2017). Exploring DSM-5 ADHD criteria beyond young adulthood: Phenomenology, psychometric properties and prevalence in a large three-decade birth cohort. Psychological Medicine, 47(4), 744–754. https://​doi.​org/​10.​1017/​S003329171600285​3.PubMedCrossRef
Metagegevens
Titel
Making the Most of it: Application of Planned Missingness Design to Increase the Efficiency of Diagnostic Assessment
Auteurs
Zvi R. Shapiro
Cynthia Huang-Pollock
John W. Graham
Kristina Neely
Publicatiedatum
08-01-2020
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 2/2020
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-019-09780-9

Andere artikelen Uitgave 2/2020

Journal of Psychopathology and Behavioral Assessment 2/2020 Naar de uitgave