Skip to main content

Advertisement

Log in

A Multi-Informant Approach to Measuring Depressive Symptoms in Clinical Assessments of Adolescent Social Anxiety Using the Beck Depression Inventory-II: Convergent, Incremental, and Criterion-Related Validity

  • Original Paper
  • Published:
Child & Youth Care Forum Aims and scope Submit manuscript

Abstract

Background

Among adolescents, depressive symptoms commonly co-occur with social anxiety, with social anxiety often developmentally preceding depressive symptoms. Thus, evidence-based assessments of adolescent social anxiety should be augmented with assessments of depressive symptoms using measures that can be administered across developmental transitions (e.g., adolescence into adulthood).

Objective

The widely used self-report measure, Beck Depression Inventory-II (BDI-II), was designed to assess depressive symptoms among adolescents and adults. Yet, scarce work exists on the psychometric properties of BDI-II self-reports among adolescents, and we know of no prior study that tested the properties of BDI-II parent reports.

Method

We examined the BDI-II within a mixed clinical/community sample of 89 adolescents and their parents, who each provided BDI-II reports about the adolescent. Further, adolescents completed self-reports and parents provided reports of adolescents on measures of adolescent trait social anxiety and other associated features of adolescent depressive symptoms (e.g., parent–adolescent conflict; attention-deficit/hyperactivity disorder symptoms). Adolescents self-reported their state arousal within a 20-min mock social interaction period.

Results

Parent–adolescent dyads displayed low-to-moderate correspondence between their BDI-II reports. Further, adolescents’ and parents’ BDI-II reports related to measures of associated features of adolescent depressive symptoms, and established cut scores on the BDI-II significantly distinguished adolescents on these same features. Adolescents’ BDI-II reports predicted adolescents’ self-reported arousal within social interactions and distinguished adolescents on referral status.

Conclusions

Adolescents and parents can provide psychometrically sound reports on the BDI-II. These findings have important implications for evidence-based assessments of adolescent depressive symptoms, when clinically assessing adolescent social anxiety.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aalto-Setälä, T., Marttunen, M., Tuulio-Henriksson, A., Poikolainen, K., & Lönnqvist, J. (2002). Depressive symptoms in adolescence as predictors of early adulthood depressive disorders and maladjustment. American Journal of Psychiatry, 159, 1235–1237. doi:10.1176/appi.ajp.159.7.1235.

    Article  PubMed  Google Scholar 

  • Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232. doi:10.1037/0033-2909.101.2.213.

    Article  PubMed  Google Scholar 

  • Adams, R., & Laursen, B. (2001). The organization and dynamics of adolescent conflict with parents and friends. Journal of Marriage and Family, 63, 97–110. doi:10.1111/j.1741-3737.2001.00097.x.

    Article  Google Scholar 

  • Alfano, C. A., & Beidel, D. C. (2011). Social anxiety in adolescents and young adults: Translating developmental science into practice. Washington, DC: American Psychological Association. doi:10.1037/12315-000.

    Book  Google Scholar 

  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-V) (5th ed.). Washington, DC: American Psychiatric Association.

    Book  Google Scholar 

  • Augenstein, T. M., Thomas, S. A., Ehrlich, K. B., Daruwala, S. E., Reyes, S. M., Chrabaszcz, J. S., et al. (2016). Comparing multi-informant assessment measures of parental monitoring and their links with adolescent delinquent behavior. Parenting: Science and Practice, 16, 164–186. doi:10.1080/15295192.2016.1158600.

    Article  Google Scholar 

  • Barkley, R. A., Anastopoulos, A. D., Guevremont, D. C., & Fletcher, K. E. (1992). Adolescents with attention deficit hyperactivity disorder: Mother-adolescent interactions, family beliefs and conflicts, and maternal psychopathology. Journal of Abnormal Child Psychology, 20, 263–288. doi:10.1007/BF00916692.

    Article  PubMed  Google Scholar 

  • Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory—Second Edition manual. San Antonio, TX: The Psychological Corporation.

    Google Scholar 

  • Beidel, D. C., Rao, P. A., Scharfstein, L., Wong, N., & Alfano, C. A. (2010). Social skills and social phobia: An investigation of DSM-IV subtypes. Behaviour Research and Therapy, 48, 992–1001. doi:10.1016/j.brat.2010.06.005.

    Article  PubMed  PubMed Central  Google Scholar 

  • Beidel, D. C., Turner, S. M., & Morris, T. L. (1995). A new inventory to assess childhood social anxiety and phobia: The Social Phobia and Anxiety Inventory for Children. Psychological Assessment, 7, 73–79. doi:10.1037/1040-3590.7.1.73.

    Article  Google Scholar 

  • Beidel, D. C., Turner, S. M., & Morris, T. L. (2000b). Behavioral treatment of childhood social phobia. Journal of Consulting and Clinical Psychology, 68, 1072–1080. doi:10.1037//0022-006X.68.6.1072.

    Article  PubMed  Google Scholar 

  • Beidel, D. S., Turner, S. M., Hamlin, K., & Morris, T. L. (2000a). The Social Phobia and Anxiety Inventory for Children (SPAI-C): External and discriminative validity. Behavior Therapy, 31, 75–87. doi:10.1016/S0005-7894(00)80005-2.

    Article  Google Scholar 

  • Bögels, S. M., Alden, L., Beidel, D. C., Clark, L. A., Pine, D. S., Stein, M. B., et al. (2010). Social anxiety disorder: Questions and answers for the DSM-V. Depression and Anxiety, 27, 168–189. doi:10.1002/da.20670.

    Article  PubMed  Google Scholar 

  • Byrne, B. M., Stewart, S. M., & Lee, P. W. H. (2004). Validating the Beck Depression Inventory-II for Hong Kong community adolescents. International Journal of Testing, 4, 199–216. doi:10.1207/s15327574ijt0403_1.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Mahwah, NJ: Erlbaum.

    Google Scholar 

  • Curran, J. P. (1982). A procedure for the assessment of social skills: The Simulated Social Interaction Test. In J. P. Curran & P. M. Monti (Eds.), Social skills training: A practical handbook for assessment and treatment (pp. 348–373). New York, NY: Guilford.

    Google Scholar 

  • De Los Reyes, A., Aldao, A., Thomas, S. A., Daruwala, S. E., Swan, A. J., Van Wie, M., et al. (2012a). Adolescent self-reports of social anxiety: Can they disagree with objective psychophysiological measures and still be valid? Journal of Psychopathology and Behavioral Assessment, 34, 308–322. doi:10.1007/s10862-012-9289-2.

    Article  Google Scholar 

  • De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2010). The relations among measurements of informant discrepancies within a multisite trial of treatments for childhood social phobia. Journal of Abnormal Child Psychology, 38, 395–404. doi:10.1007/s10802-009-9373-6.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Alfano, C. A., & Beidel, D. C. (2011). Are clinicians’ assessments of improvements in children’s functioning “global”? Journal of Clinical Child and Adolescent Psychology, 40, 281–294. doi:10.1080/15374416.2011.546043.

    Article  PubMed  PubMed Central  Google Scholar 

  • De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D., et al. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141, 858–900. doi:10.1037/a0038498.

    Article  PubMed  PubMed Central  Google Scholar 

  • De Los Reyes, A., & Ohannessian, C. M. (2016). Introduction to the special issue: Discrepancies in adolescent–parent perceptions of the family and adolescent adjustment. Journal of Youth and Adolescence, 45, 1957–1972. doi:10.1007/s10964-016-0533-z.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Salas, S., Menzer, M. M., & Daruwala, S. E. (2013a). Criterion validity of interpreting scores from multi-informant statistical interactions as measures of informant discrepancies in psychological assessments of children and adolescents. Psychological Assessment, 25, 509–519. doi:10.1037/a0032081.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. A. (2013b). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123–149. doi:10.1146/annurev-clinpsy-050212-185617.

    Article  PubMed  Google Scholar 

  • De Los Reyes, A., Thomas, S. A., Swan, A. J., Ehrlich, K. B., Reynolds, E. K., Suarez, L., et al. (2012b). “It depends on what you mean by ‘disagree’”: Differences between parent and child perceptions of parent–child conflict. Journal of Psychopathology and Behavioral Assessment, 34, 293–307. doi:10.1007/s10862-012-9288-3.

    Article  PubMed  PubMed Central  Google Scholar 

  • Dozois, D. J., Dobson, K. S., & Ahnberg, J. L. (1998). A psychometric evaluation of the Beck Depression Inventory-II. Psychological Assessment, 10, 83–89. doi:10.1037/1040-3590.10.2.83.

    Article  Google Scholar 

  • Drabick, D. A. G., & Kendall, P. C. (2010). Developmental psychopathology and the diagnosis of mental health problems among youth. Clinical Psychology: Science and Practice, 17, 272–280. doi:10.1111/j.1468-2850.2010.01219.x.

    Google Scholar 

  • Ehrlich, K. B., Cassidy, J., & Dykas, M. J. (2011). Reporter discrepancies among parents, adolescents, and peers: Adolescent attachment and informant depressive symptoms as explanatory factors. Child Development, 82, 999–1012. doi:10.1111/j.1467-8624.2010.01530.x.

    Article  PubMed  PubMed Central  Google Scholar 

  • Epkins, C. C., & Heckler, D. R. (2011). Integrating etiological models of social anxiety and depression in youth: Evidence for a cumulative interpersonal risk model. Clinical Child and Family Psychology Review, 14, 329–376. doi:10.1007/s10567-011-0101-8.

    Article  PubMed  Google Scholar 

  • Fuligni, A. J. (1998). Authority, autonomy, and parent–adolescent conflict and cohesion: A study of adolescents from Mexican, Chinese, Filipino, and European backgrounds. Developmental Psychology, 34, 782–792. doi:10.1037/0012-1649.34.4.782.

    Article  PubMed  Google Scholar 

  • Grant, B. F., Hasin, D. S., Blanco, C., Stinson, F. S., Chou, S. P., Goldstein, R. B., et al. (2005). The epidemiology of social anxiety disorder in the United States: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. The Journal of Clinical Psychiatry, 66, 1351–1361. doi:10.4088/JCP.v66n1102.

    Article  PubMed  Google Scholar 

  • Hanley, J. A., Negassa, A., Edwardes, M. D., & Forrester, J. E. (2003). Statistical analysis of correlated data using generalized estimating equations: An orientation. American Journal of Epidemiology, 157, 364–375. doi:10.1093/aje/kwf215.

    Article  PubMed  Google Scholar 

  • Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51. doi:10.1146/annurev.clinpsy.3.022806.091419.

    Article  PubMed  Google Scholar 

  • Kazdin, A. E. (2003). Research design in clinical psychology (4th ed.). Boston: Allyn & Bacon.

    Google Scholar 

  • Kessler, R. C., Adler, L. A., Gruber, M. J., Sarawate, C. A., Spencer, T., & van Brunt, D. L. (2007). Validity of the World Health Organization Adult ADHD Self-Report Scale (ASRS) screener in a representative sample of health plan members. International Journal of Methods in Psychiatric Research, 16, 52–65. doi:10.1002/mpr.208.

    Article  PubMed  PubMed Central  Google Scholar 

  • Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry, 62, 593–602. doi:10.1001/archpsyc.62.6.593.

    Article  PubMed  Google Scholar 

  • Kessler, R. C., Petukhova, M., Sampson, N. A., Zaslavsky, A. M., & Wittchen, H. U. (2012). Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. International Journal of Methods in Psychiatric Research, 21, 169–184. doi:10.1002/mpr.1359.

    Article  PubMed  PubMed Central  Google Scholar 

  • Klein, D. N., Dougherty, L. R., & Olino, T. M. (2005). Toward guidelines for evidence-based assessment of depression in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 412–432. doi:10.1207/s15374424jccp3403_3.

    Article  PubMed  Google Scholar 

  • Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160, 1566–1577. doi:10.1176/appi.ajp.160.9.1566.

    Article  PubMed  Google Scholar 

  • Lang, P. J. (1980). Behavioral treatment and bio-behavioral assessment: Computer applications. In J. B. Sidowski, J. H. Johnson, & T. A. Williams (Eds.), Technology in mental health care delivery systems (pp. 119–137). Norwood, NJ: Ablex.

    Google Scholar 

  • Lipton, M. F., Augenstein, T. M., Weeks, J. W., & De Los Reyes, A. (2014). A multi-informant approach to assessing fear of positive evaluation in socially anxious adolescents. Journal of Child and Family Studies, 23, 1247–1257. doi:10.1007/s10826-013-9785-3.

    Article  Google Scholar 

  • Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.

    Google Scholar 

  • Osman, A., Barrios, F. X., Gutierrez, P. M., Williams, J. E., & Bailey, J. (2008). Psychometric properties of the Beck Depression Inventory-II in nonclinical adolescent samples. Journal of Clinical Psychology, 64, 83–102. doi:10.1002/jclp.20433.

    Article  PubMed  Google Scholar 

  • Pelham, W. E., Jr., Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476. doi:10.1207/s15374424jccp3403_5.

    Article  PubMed  Google Scholar 

  • Pine, D. S., Cohen, P., Brook, J., Gurley, D., & Ma, Y. (1998). Anxiety and depression in adolescence as predictors of anxiety and depression in adulthood. Archives of General Psychiatry, 55, 56–66.

    Article  PubMed  Google Scholar 

  • Pine, D. S., Cohen, E., Cohen, P., & Brook, J. (1999). Adolescent depressive symptoms as predictors of adult depression: Moodiness or mood disorder? American Journal of Psychiatry, 156, 133–135. doi:10.1176/ajp.156.1.133.

    Article  PubMed  Google Scholar 

  • Prinz, R. J., Foster, S. L., Kent, R. N., & O’Leary, K. D. (1979). Multivariate assessment of conflict in distressed and nondistressed mother–adolescent dyads. Journal of Applied Behavior Analysis, 12, 691–700. doi:10.1901/jaba.1979.12-691.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rice, F., Harold, G. T., Shelton, K. H., & Thapar, A. (2006). Family conflicts interacts with genetic liability in predicting childhood and adolescent depression. Journal of the American Academy of Child and Adolescent Psychiatry, 45, 841–848. doi:10.1097/01.chi.0000219834.08602.44.

    Article  PubMed  Google Scholar 

  • Roza, S. J., Hofstra, M. B., van der Ende, J., & Verhulst, F. C. (2003). Stable prediction of mood and anxiety disorders based on behavioral and emotional problems in childhood: A 14- year follow-up during childhood, adolescence, and young adulthood. American Journal of Psychiatry, 160, 2116–2121. doi:10.1176/appi.ajp.160.12.2116.

    Article  PubMed  Google Scholar 

  • Sheeber, L., Hops, H., Alpert, A., Davis, B., & Andrews, J. (1997). Family support and conflict: Prospective relations to adolescent depression. Journal of Abnormal Child Psychology, 25, 333–344. doi:10.1023/A:1025768504415.

    Article  PubMed  Google Scholar 

  • Silverman, W. K., & Ollendick, T. H. (2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 380–411. doi:10.1207/s15374424jccp3403_2.

    Article  PubMed  Google Scholar 

  • Smetana, J. G. (2008). “It’s 10 o’clock: Do you know where your children are?” Recent advances in understanding parental monitoring and adolescents’ information management. Child Development Perspectives, 2, 19–25. doi:10.1111/j.1750-8606.2008.00036.x.

    Article  Google Scholar 

  • Smetana, J., & Gaines, C. (1999). Adolescent–parent conflict in middle-class African American families. Child Development, 70, 1447–1463. doi:10.1111/1467-8624.00105.

    Article  PubMed  Google Scholar 

  • Steer, R. A., Kumar, G., Ranieri, W. F., & Beck, A. T. (1998). Use of the Beck Depression Inventory-II with adolescent psychiatric outpatients. Journal of Psychopathology and Behavioral Assessment, 20, 127–137. doi:10.1023/A:1023091529735.

    Article  Google Scholar 

  • Stein, M. B., Fuetsch, M., Mu¨ller, N., Ho¨fler, M., Lieb, R., & Wittchen, H. (2001). Social anxiety disorder and the risk of depression: A prospective community study of adolescents and young adults. Archives of General Psychiatry, 58, 251–256. doi:10.1001/archpsyc.58.3.251.

    Article  PubMed  Google Scholar 

  • Steinberg, L. (1987). Impact of puberty on family relations: Effects of pubertal status and pubertal timing. Developmental Psychology, 23, 451–460. doi:10.1037/0012-1649.23.3.451.

    Article  Google Scholar 

  • Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Boston: Allyn and Bacon.

    Google Scholar 

  • Thomas, S. A., Daruwala, S. E., Goepel, K. A., & De Los Reyes, A. (2012). Using the Subtle Avoidance Frequency Examination in adolescent social anxiety assessments. Child and Youth Care Forum, 41, 547–559. doi:10.1007/s10566-012-9181-y.

    Article  Google Scholar 

  • Treutler, C. M., & Epkins, C. C. (2003). Are discrepancies among child, mother, and father reports on children’s behavior related to parents’ psychological symptoms and aspects of parent–child relationships? Journal of Abnormal Child Psychology, 31, 13–27. doi:10.1023/A:1021765114434.

    Article  PubMed  Google Scholar 

  • Tse, W. S., & Bond, A. J. (2004). The impact of depression on social skills: A review. Journal of Nervous and Mental Disease, 192, 260–268. doi:10.1097/01.nmd.0000120884.60002.2b.

    Article  PubMed  Google Scholar 

  • Turner, S. M., Beidel, D. C., Cooley, M. R., Woody, S., & Messer, S. C. (1994). A multicomponent behavioral treatment for social phobia: Social Effectiveness Therapy. Behavior Research and Therapy, 32, 381–390. doi:10.1016/0005-7967(94)90001-9.

    Article  Google Scholar 

  • U.S. Census Bureau. (2015). State and county quickfacts: Washington, DC. Retrieved from http://www.census.gov/quickfacts/table/PST045215/11,00.

  • VanVoorhis, C. R. W., & Blumentritt, T. L. (2007). Psychometric properties of the Beck Depression Inventory-II in a clinically-identified sample of Mexican American adolescents. Journal of Child and Family Studies, 16, 789–798. doi:10.1007/s10826-006-9125-y.

    Article  Google Scholar 

  • Whalen, C. K., Henker, B., Jamner, L. D., Ishikawa, S. S., Floro, J. N., Swindle, R., et al. (2006). Toward mapping daily challenges of living with ADHD: Maternal and child perspectives using electronic diaries. Journal of Abnormal Child Psychology, 34, 115–130. doi:10.1007/s10802-005-9008-5.

    Article  PubMed  Google Scholar 

  • Youngstrom, E. A. (2013). Future directions in psychological assessment: Combining evidence-based medicine innovations with psychology’s historical strengths to enhance utility. Journal of Clinical Child and Adolescent Psychology, 42, 139–159. doi:10.1080/15374416.2012.736358.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This work was supported, in part, by an internal grant from the University of Maryland at College Park (College of Behavioral and Social Sciences Dean’s Research Initiative-Summer Scholars Program) awarded to the first and last authors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andres De Los Reyes.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rausch, E., Racz, S.J., Augenstein, T.M. et al. A Multi-Informant Approach to Measuring Depressive Symptoms in Clinical Assessments of Adolescent Social Anxiety Using the Beck Depression Inventory-II: Convergent, Incremental, and Criterion-Related Validity. Child Youth Care Forum 46, 661–683 (2017). https://doi.org/10.1007/s10566-017-9403-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10566-017-9403-4

Keywords

Navigation