Top

Journal of Psychopathology and Behavioral Assessment

14-02-2024

Automated Coding of Children’s Spoken Language is Associated with Internalizing Symptoms and Cortisol Reactivity to Stress

Auteurs: Bianca C. Iddiols, Andrew R. Daoust, Jennifer N. Mullen, Yuliya Kotelnikova, Elizabeth P. Hayden

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment

Abstract

Automated coding has the potential to streamline otherwise laborious manual coding of psychologically relevant human behaviour. For example, automated coding of adults’ written language (e.g., social media posts) shows that incidental language patterns are associated with internal psychological processes, including symptoms of depression. However, it is unclear whether automated coding of children’s incidental spoken language is related to their symptoms and other indices of risk. We therefore examined associations between 146 children’s (M_age = 9.53 years, SD = 0.88; 82 girls) spoken language, transcribed for automated coding, and their internalizing symptoms and cortisol stress reactivity. Children completed self-reports of depression and anxiety, and cortisol reactivity to stress was measured using salivary cortisol samples during the Trier Social Stress Test for Children (TSST-C). Emotional and other linguistic indices derived using Linguistic Inquiry and Word Count software package were meaningfully correlated with children’s depressive symptoms and children’s cortisol reactivity, with medium mean effect sizes of |r| = 0.21 (range: 0.19-0.28) and |r| = 0.23 (range: 0.20-0.29), respectively, across significant correlations, providing preliminary evidence that children’s spoken language coded via automated methods is a valid marker of children’s internal states.

Alison, J., & Burgess, C. (2003). Effects of chronic non-clinical depression on the use of positive and negative words in language contexts. Brain and Cognition, 53(2), 125–128. https://doi.org/10.1016/S0278-2626(03)00093-9.CrossRefPubMed

Anderson, B., Goldin, P. R., Kurita, K., & Gross, J. J. (2008). Self-representation in social anxiety disorder: Linguistic analysis of autobiographical narratives. Behaviour Research and Therapy, 46(10), 1119–1125. https://doi.org/10.1016/j.brat.2008.07.001.CrossRefPubMedPubMedCentral

Asarnow, J. R., & Carlson, G. A. (1985). Depression self-rating scale: Utility with child psychiatric inpatients. Journal of Consulting and Clinical Psychology, 53(4), 491–499. https://doi.org/10.1037/0022-006X.53.4.491.CrossRefPubMed

Author(s) (Ed.). Blinded for masked review

Bantum, E. O., & Owen, J. E. (2009). Evaluating the validity of computerized content analysis programs for identification of emotional expression in cancer narratives. Psychological Assessment, 21(1), 79–88. https://doi.org/10.1037/a0014643.CrossRefPubMed

Bauer, P. J., Stark, E. N., Lukowski, A. F., Rademacher, J., Van Abbema, D. L., & Ackil, J. K. (2005). Working together to make sense of the past: Mothers’ and children’s use of internal states language in conversations about traumatic and nontraumatic events. Journal of Cognition and Development, 6(4), 463–488. https://doi.org/10.1207/s15327647jcd0604_2.CrossRef

Birleson, P., Hudson, I., Buchanan, D. G., & Wolff, S. (1987). Clinical evaluation of a self-rating scale for depressive disorder in childhood (Depression Self-Rating Scale). Journal of Child Psychology and Psychiatry, 28(1), 43–60. https://doi.org/10.1111/j.1469-7610.1987.tb00651.x.CrossRefPubMed

Borelli, J. L., Sbarra, D. A., Mehl, M., & David, D. H. (2011). Experiential connectedness in children’s attachment interviews: An examination of natural word use. Personal Relationships, 18(3), 341–351. https://doi.org/10.1111/j.1475-6811.2010.01294.x.CrossRef

Borelli, J. L., Smiley, P. A., Rasmussen, H. F., & Gómez, A. (2016). Is it about me, you, or us? Stress reactivity correlates of discrepancies in we-talk among parents and preadolescent children. Journal of Youth and Adolescence, 45(10), 1996–2010. https://doi.org/10.1007/s10964-016-0459-5.CrossRefPubMed

Boyd, R. L., & Pennebaker, J. W. (2017). Language-based personality: A new approach to personality in a digital world. Current Opinion in Behavioral Sciences, 18, 63–68. https://doi.org/10.1016/j.cobeha.2017.07.017.CrossRef

Boyd, R. L., Ashokkumar, A., Seraj, S., & Pennebaker, J. W. (2022). The Development and Psychometric Properties of LIWC-22. https://doi.org/10.13140/RG.2.2.23890.43205.

Boyes, M. E., & Cluver, L. D. (2013). Performance of the revised children’s manifest anxiety scale in a sample of children and adolescents from poor urban communities in Cape Town. European Journal of Psychological Assessment, 29(2), 113–120. https://doi.org/10.1027/1015-5759/a000134.CrossRef

Brand, S., Mikoteit, T., Kalak, N., Bahmani, S., Lemola, D., Gerber, S., Ludyga, M., Bossard, S., Pühse, M., Holsboer-Trachsler, U., E., & Hatzinger, M. (2018). Cortisol impacted on explicit learning encoding, but not on storage and retrieval, and was not associated with sleep patterns - results from the Trier Social stress test for children (TSST-C) among 9-years old children. Frontiers in Psychology, 9, 2240. https://doi.org/10.3389/fpsyg.2018.02240.CrossRefPubMedPubMedCentral

Brockmeyer, T., Zimmermann, J., Kulessa, D., Hautzinger, M., Bents, H., Friederich, H-C., Herzog, W., & Backenstrass, M. (2015). Me, myself, and I: Self-referent word use as an indicator of self-focused attention in relation to depression and anxiety. Frontiers in Psychology, 6, https://doi.org/10.3389/fpsyg.2015.01564.

Buchanan, T. W., Laures-Gore, J. S., & Duff, M. C. (2014). Acute stress reduces speech fluency. Biological Psychology, 97, 60–66. https://doi.org/10.1016/j.biopsycho.2014.02.005.CrossRefPubMed

Buske-Kirschbaum, A., Jobst, S., Wustmans, A., Kirschbaum, C., Rauh, W., & Hellhammer, D. (1997). Attenuated free cortisol response to psychosocial stress in children with atopic dermatitis. Psychosomatic Medicine, 59(4), 419–426. https://doi.org/10.1097/00006842-199707000-00012.CrossRefPubMed

Desrosiers, A., Vine, V., & Kershaw, T. (2019). R U Mad? Computerized text analysis of affect in social media relates to stress and substance use among ethnic minority emerging adult males. Anxiety Stress & Coping, 32(1), 109–123. https://doi.org/10.1080/10615806.2018.1539964.CrossRef

Dunn, L. M., & Dunn, L. M. (1997). Peabody Picture Vocabulary Test (3rd ed.). American Guidance Service.

Dupré, D., Krumhuber, E. G., Küster, D., & McKeown, G. J. (2020). A performance comparison of eight commercially available automatic classifiers for facial affect recognition. PLOS ONE, 15(4), e0231968. https://doi.org/10.1371/journal.pone.0231968.CrossRefPubMedPubMedCentral

Edwards, T., & Holtzman, N. S. (2017). A meta-analysis of correlations between depression and first person singular pronoun use. Journal of Research in Personality, 68, 63–68. https://doi.org/10.1016/j.jrp.2017.02.005.CrossRef

Eichstaedt, J. C., Smith, R. J., Merchant, R. M., Ungar, L. H., Crutchley, P., Preoţiuc-Pietro, D., Asch, D. A., & Schwartz, H. A. (2018). Facebook language predicts depression in medical records. Proceedings of the National Academy of Sciences, 115(44), 11203–11208. https://doi.org/10.1073/pnas.1802331115.ADSCrossRef

Eriksson, M., Marschik, P. B., Tulviste, T., Almgren, M., Pérez Pereira, M., Wehberg, S., Marjanovič-Umek, L., Gayraud, F., Kovacevic, M., & Gallego, C. (2012). Differences between girls and boys in emerging language skills: Evidence from 10 language communities: Differences between girls and boys in early language. British Journal of Developmental Psychology, 30(2), 326–343. https://doi.org/10.1111/j.2044-835X.2011.02042.x.CrossRefPubMed

Foltz, P. W., Gilliam, S., & Kendall, S. (2000). Supporting content-based feedback in on-line writing evaluation with LSA. Interactive Learning Environments, 8(2), 111–127. https://doi.org/10.1076/1049-4820(200008)8:2;1-B;FT111.CrossRef

Funder, D. C., & Ozer, D. J. (2019). Evaluating effect size in psychological research: Sense and nonsense. Advances in Methods and Practices in Psychological Science, 2(2), 156–168. https://doi.org/10.1177/2515245919847202.CrossRef

Gerard, A. B., & Reynolds, C. R. (1999). Characteristics and applications of the Revised Children’s Manifest Anxiety Scale (RCMAS). In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (pp. 323–340). Lawrence Erlbaum Associates.

Gignac, G. E., & Szodorai, E. T. (2016). Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74–78. https://doi.org/10.1016/j.paid.2016.06.069.CrossRef

Green, H. E., Gabel, L. N., Stewart, E. K., Kotelnikova, Y., & Hayden, E. P. (under review). Latent structure and measurement invariance of the depression self-rating scale for children across sex and age. Psychological Assessment.

Grosse, G., Streubel, B., Gunzenhauser, C., & Saalbach, H. (2021). Let’s talk about emotions: The development of children’s emotion vocabulary from 4 to 11 years of age. Affective Science, 2(2), 150–162. https://doi.org/10.1007/s42761-021-00040-2.CrossRefPubMedPubMedCentral

Guntuku, S. C., Giorgi, S., & Ungar, L. (2018). Current and future psychological health prediction using language and socio-demographics of children for the CLPysch 2018 Shared Task. Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: from Keyboard to Clinic, 98-106, https://doi.org/10.18653/v1/W18-0610.

Hayden, E. P., Hankin, B. L., Mackrell, S. V. M., Sheikh, H. I., Jordan, P. L., Dozois, D. J. A., Singh, S. M., Olino, T. M., & Badanes, L. S. (2014). Parental depression and child cognitive vulnerability predict children’s cortisol reactivity. Development and Psychopathology, 26(4pt2), 1445–1460. https://doi.org/10.1017/S0954579414001138.

Hayden, E. P., Olino, T. M., Mackrell, S. V. M., Jordan, P. L., Desjardins, J., & Katsiroumbas, P. (2013). Cognitive vulnerability to depression during middle childhood: Stability and associations with maternal affective styles and parental depression. Personality and Individual Differences, 55(8), 892–897. https://doi.org/10.1016/j.paid.2013.07.016.

Hart, R. P., & Carroll, C. E. (2014). DICTION 7.0 text analysis program – help manual. Digitext.

Hofmann, S. G., Moore, P. M., Gutner, C., & Weeks, J. W. (2012). Linguistic correlates of social anxiety disorder. Cognition & Emotion, 26(4), 720–726. https://doi.org/10.1080/02699931.2011.602048.CrossRef

Hyde, J. S., & Linn, M. C. (1988). Gender differences in verbal ability: A meta-analysis. Psychological Bulletin, 104(1), 53–69. https://doi.org/10.1037/0033-2909.104.1.53.CrossRef

Ivarsson, T., Lidberg, A., & Gillberg, C. (1994). The Birleson Depression Self-Rating Scale (DSRS). Clinical evaluation in an adolescent inpatient population. Journal of Affective Disorders, 32(2), 115–125. https://doi.org/10.1016/0165-0327(94)90069-8.CrossRefPubMed

Kahn, J. H., Tobin, R. M., Massey, A. E., & Anderson, J. A. (2007). Measuring emotional expression with the linguistic Inquiry and Word Count. The American Journal of Psychology, 120(2), 263–286.CrossRefPubMed

Kahn, J. H., Cox, D. W., Bakker, A. M., O’Loughlin, J. I., & Kotlarczyk, A. M. (2017). The role of Distress Disclosure tendencies in the experience and expression of Laboratory-Induced sadness. Journal of Individual Differences, 38(1), 55–62. https://doi.org/10.1027/1614-0001/a000222.CrossRef

Kotelnikova, Y., Mackrell, S. V. M., Jordan, P. L., & Hayden, E. P. (2015). Longitudinal associations between reactive and regulatory temperament traits and depressive symptoms in middle childhood. Journal of Clinical Child & Adolescent Psychology, 44(5), 775–786. https://doi.org/10.1080/15374416.2014.893517.

Kotelnikova, Y., Olino, T. M., Mackrell, S. V. M., Jordan, P. L., & Hayden, E. P. (2013). Structure of observed temperament in middle childhood. Journal of Research in Personality, 47(5), 524–532. https://doi.org/10.1016/j.jrp.2013.04.013.

Leaper, C., & Smith, T. E. (2004). A Meta-Analytic review of gender variations in children’s Language Use: Talkativeness, Affiliative Speech, and assertive Speech. Developmental Psychology, 40(6), 993–1027. https://doi.org/10.1037/0012-1649.40.6.993.CrossRefPubMed

Lyons, M., Aksayli, N. D., & Brewer, G. (2018). Mental distress and language use: Linguistic analysis of discussion forum posts. Computers in Human Behavior, 87, 207–211. https://doi.org/10.1016/j.chb.2018.05.035.CrossRef

Mackrell, S. V. M., Sheikh, H. I., Kotelnikova, Y., Kryski, K. R., Jordan, P. L., Singh, S. M., & Hayden, E. P. (2014). Child temperament and parental depression predict cortisol reactivity to stress in middle childhood. Journal of Abnormal Psychology, 123(1), 106–116. https://doi.org/10.1037/a0035612.

Morsbach, S. K., & Prinz, R. J. (2006). Understanding and improving the validity of self-report of parenting. Clinical Child and Family Psychology Review, 9(1), 1–21. https://doi.org/10.1007/s10567-006-0001-5.CrossRefPubMed

Newell, E. E., McCoy, S. K., Newman, M. L., Wellman, J. D., & Gardner, S. K. (2018). You sound so down: Capturing depressed affect through depressed language. Journal of Language and Social Psychology, 37(4), 451–474. https://doi.org/10.1177/0261927X17731123.CrossRef

Newman, M. L., Groom, C. J., Handelman, L. D., & Pennebaker, J. W. (2008). Gender differences in language use: An analysis of 14,000 text samples. Discourse Processes, 45(3), 211–236. https://doi.org/10.1080/01638530802073712.CrossRef

Paget, K. D., & Reynolds, C. R. (1984). Dimensions, levels and reliabilities on the revised children’s manifest anxiety scale with learning disabled children. Journal of Learning Disabilities, 17(3), 137–141.CrossRefPubMed

Pennebaker, J. W., & Francis, M. E. (1996). Cognitive, emotional, and language processes in disclosure. Cognition and Emotion, 10(6), 601–626. https://doi.org/10.1080/026999396380079.CrossRef

Pennebaker, J. W., & Graybeal, A. (2001). Patterns of natural language use: Disclosure, personality, and social integration. Current Directions in Psychological Science, 10(3), 90–93. https://doi.org/10.1111/1467-8721.00123.CrossRef

Pennebaker, J. W., & King, L. A. (1999). Linguistic styles: Language use as an individual difference. Journal of Personality and Social Psychology, 77(6), 1296–1312. https://doi.org/10.1037/0022-3514.77.6.1296.CrossRefPubMed

Pennebaker, J. W., Francis, M. E., & Booth, R. J. (2001). Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates, 71(2001), 2001.

Pruessner, J. C., Kirschbaum, C., Meinlschmid, G., & Hellhammer, D. H. (2003). Two formulas for computation of the area under the curve represent measures of total hormone concentration versus time-dependent change. Psychoneuroendocrinology, 28(7), 916–931. https://doi.org/10.1016/S0306-4530(02)00108-7.CrossRefPubMed

Reynolds, C. R., & Paget, K. D. (1981). Factor analysis of the revised children’s manifest anxiety scale for blacks, whites, males, and females with a national normative sample. Journal of Consulting and Clinical Psychology, 49(3), 352–359. https://doi.org/10.1037/0022-006X.49.3.352.CrossRefPubMed

Reynolds, C. R., & Richmond, B. O. (1978). What I think and feel: A revised measure of children’s manifest anxiety. Journal of Abnormal Child Psychology, 6(2), 271–280. https://doi.org/10.1007/BF00919131.CrossRefPubMed

Rodriguez, E. M., Dunn, M. J., Zuckerman, T., Hughart, L., Vannatta, K., Gerhardt, C. A., Saylor, M., Schuele, C. M., & Compas, B. E. (2013). Mother-child communication and maternal depressive symptoms in families of children with cancer: Integrating macro and micro levels of analysis. Journal of Pediatric Psychology, 38(7), 732–743. https://doi.org/10.1093/jpepsy/jst018.CrossRefPubMedPubMedCentral

Rude, S., Gortner, E. M., & Pennebaker, J. (2004). Language use of depressed and depression-vulnerable college students. Cognition & Emotion, 18(8), 1121–1133. https://doi.org/10.1080/02699930441000030.CrossRef

Saslow, L. R., McCoy, S., van der Löwe, I., Cosley, B., Vartan, A., Oveis, C., Keltner, D., Moskowitz, J. T., & Epel, E. S. (2014). Speaking under pressure: Low linguistic complexity is linked to high physiological and emotional stress reactivity: Speaking under pressure. Psychophysiology, 51(3), 257–266. https://doi.org/10.1111/psyp.12171.CrossRefPubMed

Sonnenschein, A. R., Hofmann, S. G., Ziegelmayer, T., & Lutz, W. (2018). Linguistic analysis of patients with mood and anxiety disorders during cognitive behavioral therapy. Cognitive Behaviour Therapy, 47(4), 315–327. https://doi.org/10.1080/16506073.2017.1419505.CrossRefPubMed

Spengler, B., Hofer, J., Busch, H., Dzionsko, I., & Emslander, V. (2020). Implicit motives and children’s salivary cortisol reactivity to an adapted version of the Trier Social stress test for children (TSST-C). Personality and Individual Differences, 162, 110010. https://doi.org/10.1016/j.paid.2020.110010.CrossRef

Stamatis, C. A., Meyerhoff, J., Liu, T., Hou, Z., Sherman, G., Curtis, B. L., Ungar, L. H., & Mohr, D. C. (2022). The association of language style matching in text messages with mood and anxiety symptoms. Procedia Computer Science, 206, 151–161. https://doi.org/10.1016/j.procs.2022.09.094.CrossRefPubMedPubMedCentral

Statistics Canada (July 24, 2008). Community Profiles: London Ontario (2006 Census Data) (Table) Statistics Canada Online Catalogue no 92-591-XWE.

Stephens, N. M., Townsend, S. S. M., Markus, H. R., & Phillips, L. T. (2012). A cultural mismatch: Independent cultural norms produce greater increases in cortisol and more negative emotions among first-generation college students. Journal of Experimental Social Psychology, 48(6), 1389–1393. https://doi.org/10.1016/j.jesp.2012.07.008.CrossRef

Stone, P. J., Dunphy, D. C., & Smith, M. S. (1966). The general inquirer: A computer approach to content analysis. M.I.T.

Tamagawa, R., Moss-Morris, R., Martin, A., Robinson, E., & Booth, R. J. (2013). Dispositional emotion coping styles and physiological responses to expressive writing. British Journal of Health Psychology, 18(3), 574–592. https://doi.org/10.1111/bjhp.12004.CrossRefPubMed

Tølbøll, K. B. (2019). Linguistic features in depression: A meta-analysis. Journal of Lan-guage. Works-Sprogvidenskabeligt Studentertidsskrift, 4(2), 39–59.

Tsugawa, S., Kikuchi, Y., Kishino, F., Nakajima, K., Itoh, Y., & Ohsaki, H. (2015). Recognizing Depression from Twitter Activity. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 3187–3196. https://doi.org/10.1145/2702123.2702280.

Varela, R. E., & Biggs, B. K. (2006). Reliability and validity of the revised children’s manifest anxiety scale (RCMAS) across samples of Mexican, Mexican American, and European American children: A preliminary investigation. Anxiety Stress & Coping, 19(1), 67–80. https://doi.org/10.1080/10615800500499727.CrossRef

Vedula, N., & Parthasarathy, S. (2017). Emotional and Linguistic Cues of Depression from Social Media. Proceedings of the 2017 International Conference on Digital Health, 127–136. https://doi.org/10.1145/3079452.3079465.

Ventola, G. (2020). Language Usage of Stress-Induced Individuals (Bachelor’s thesis, University of Arizona, Tucson, USA). http://hdl.handle.net/10150/651422.

Vine, V., Hilt, L. M., Marroquín, B., & Gilbert, K. E. (2019). Socially oriented thinking and the biological stress response: Thinking of friends and family predicts trajectories of salivary cortisol decline. Psychophysiology, 56(12). https://doi.org/10.1111/psyp.13461.

Vine, V., Boyd, R. L., & Pennebaker, J. W. (2020). Natural emotion vocabularies as windows on distress and well-being. Nature Communications, 11(1), 4525. https://doi.org/10.1038/s41467-020-18349-0.ADSCrossRefPubMedPubMedCentral

Wang, W., Hernandez, I., Newman, D. A., He, J., & Bian, J. (2016). Twitter analysis: Studying US Weekly trends in work stress and emotion: Twitter Analysis of work stress and emotion. Applied Psychology, 65(2), 355–378. https://doi.org/10.1111/apps.12065.CrossRef

Warren, S. L., Emde, R. N., & Sroufe, L. A. (2000). Internal representations: Predicting anxiety from children’s play narratives. Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 100–107. https://doi.org/10.1097/00004583-200001000-00022.CrossRef

Titel: Automated Coding of Children’s Spoken Language is Associated with Internalizing Symptoms and Cortisol Reactivity to Stress
Auteurs: Bianca C. Iddiols
Andrew R. Daoust
Jennifer N. Mullen
Yuliya Kotelnikova
Elizabeth P. Hayden
Publicatiedatum: 14-02-2024
Uitgeverij: Springer US
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI: https://doi.org/10.1007/s10862-024-10124-5

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen