Abstract
Background
Childhood internalizing and externalizing problems are closely related and often co-occur. Directional models have been employed to test how these problems are related, while few studies have tested a third variables model.
Objective
This study investigates whether internalizing and externalizing problems are reciprocally or unidirectionally related, whether these relations can be explained by third variables, and how these relations are associated with onset and stability.
Methods
A community sample of 1,434 children aged 5.08 (SD = 1.25) and their mothers participated in two 1-year interval data waves. Internalizing and externalizing problems were examined with the Strengths and Difficulties Questionnaire.
Results
Using latent cross-lagged modeling, externalizing problems were found not be related to subsequent internalizing problems, or vice versa. These results were also found when controlling for inadequate parenting, parenting stress, maternal health and social preference. When taking problem level into account, externalizing problems were related to stability of clinical level internalizing problems, even when controlling for third variables inadequate parenting, parenting stress, maternal mental health and social preference.
Conclusions
Strong autoregressive paths for internalizing and externalizing problems were found. Internalizing and externalizing problems do not seem to influence each other over time in the community sample. When investigating relations among internalizing and externalizing problems, it seems to be important to take problem level into account.
Similar content being viewed by others
Notes
We conducted multi-group modeling to check whether child age or sex moderated our results. We found no moderation effects. Details are available upon request at the first author.
References
Achenbach, T. M., Howell, C. T., Quay, H. C., & Conners, C. K. (1991). National survey of problems and competencies among four- to sixteen-year-olds: Parents’ reports for normative and clinical samples. Monographs of the Society for Research in Child Development, 56, 1–131.
Angold, A., Costello, E. J., & Erkanli, A. (1999). Comorbidity. Journal of Child Psychology and Psychiatry, 40, 57–87.
Arnold, D. S., O’Leary, S. G., Wolff, L. S., & Acker, M. M. (1993). The parenting scale: A measure of dysfunctional parenting in discipline situations. Psychological Assessment, 5, 137–144.
Asparouhav, T., & Muthén, B. (2010). Weighted least squares estimation with missing data. http://www.statmodel.com/download/GstrucMissingRevision.pdf
Barry, T. D., Dunlap, S. T., Cotten, S. J., Lochman, J. E., & Wells, K. C. (2005). The influence of maternal stress and distress on disruptive behavior problems in boys. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 265–273.
Beardslee, W. R., Versage, E. M., & Gladstone, T. R. G. (1998). Children of affectively ill parents: A review of the past 10 years. Journal of the American Academy of Child and Adolescent Psychiatry, 37, 1134–1141.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606.
Benzies, K. M., Harrison, M. J., & Magill-Evans, J. (2004). Parenting stress, marital quality, and child behavior problems at age 7 years. Public Health Nursing, 21, 111–121.
Bittner, A., Egger, H. L., Erkanli, A., Costello, J. E., Foley, D. L., & Angold, A. (2007). What do childhood anxiety disorders predict? Journal of Child Psychology and Psychiatry, 48, 1174–1183.
Bodden, D. H., Bögels, S. M., Nauta, M. H., De Haan, E., Ringrose, J., Appelboom, C., & Appelboom-Geerts, K. C. (2008). Child versus family cognitive-behavioral therapy in clinically anxious youth: An efficacy and partial effectiveness study. Journal of the American Academy of Child and Adolescent Psychiatry, 47(12), 1384–1394.
Bornstein, M. H., Hahn, C.-S., & Haynes, O. M. (2010). Social competence, externalizing, and internalizing behavioral adjustment from early childhood through early adolescence: Developmental cascades. Development and Psychopathology, 22, 717–735.
Boylan, K., Vaillancourt, T., Boyle, M., & Szatmari, P. (2007). Comorbidity of internalizing disorders in children with oppositional defiant disorder. European Child and Adolescent Psychiatry, 16, 484–494.
Boylan, K., Vaillancourt, T., & Szatmari, P. (2012). Linking oppositional behaviour trajectories to the development of depressive symptoms in childhood. Child Psychiatry and Human Development, 43, 484–497.
Bronfenbrenner, U., & Evans, G. W. (2000). Developmental science in the 21st century: Emerging theoretical models, research designs, and empirical findings. Social Development, 9, 115–125.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258.
Burke, J. D., Loeber, R., Lahey, B. B., & Rathouz, P. (2005). Developmental transitions among affective and behavioral disorders in adolescent boys. Journal of Child Psychology and Psychiatry, 46, 1200–1210.
Burt, K. B., & Roisman, G. I. (2010). Competence and psychopathology: Cascade effects in the NICHD Study of Early Child Care and Youth Development. Development and Psychopathology, 22, 557–567.
Cicchetti, D., & Toth, S. L. (1998). The development of depression in children and adolescents. American Psychologist, 53, 221–241.
Coie, J. D., Dodge, K. A., & Coppotelli, H. (1982). Dimensions and types of social status: A cross-age perspective. Developmental Psychology, 18, 557–570.
Copeland, W. E., Shanahan, L., Costello, E. J., & Angold, A. (2009). Childhood and adolescent psychiatric disorders as predictors of young adult disorders. Archives of General Psychiatry, 66, 764–772.
Crnic, K. A., & Greenberg, M. T. (1990). Minor parenting stresses with young children. Child Development, 61, 1628–1637.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483–509.
De Pauw, S. S. W., & Mervielde, I. (2010). Temperament, personality and developmental psychopathology: A review based on the conceptual dimensions underlying childhood traits. Child Psychiatry and Human Development, 41, 313–329.
Deater-Deckard, K. (2004). Parenting stress. New Haven, CT: Yale University Press.
Dishion, T. J., & Patterson, G. R. (2006). The development and ecology of antisocial behavior in children and adolescents. In D. J. Cohen & D. Cicchetti (Eds.), Developmental psychopathology. Vol. 3: Risk, disorder, and adaptation (pp. 503–541). Hoboken, NJ: Wiley.
Fanti, K. A., & Henrich, C. C. (2010). Trajectories of pure and co-occurring internalizing and externalizing problems from age 2 to age 12: Findings from the National Institute of Child Health and Human Development Study of Early Child Care. Developmental Psychology, 46, 1159–1175.
Fergusson, D. M., Lynskey, M. T., & Horwood, L. J. (1996). Origins of comorbidity between conduct and affective disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 451–460.
Ford, T., Collishaw, S., Meltzer, H., & Goodman, R. (2007). A prospective study of childhood psychopathology: Independent predictors of change over three years. Social Psychiatry and Psychiatric Epidemiology, 42, 953–961.
Frick, P. J., Silverthorn, P., & Evans, C. (1994). Assessment of childhood anxiety using structured interviews: Patterns of agreement among informants and association with maternal anxiety. Psychological Assessment, 6, 372–379.
Gilliom, M., & Shaw, D. S. (2004). Codevelopment of externalizing and internalizing problems in early childhood. Development and Psychopathology, 16, 313–333.
Gjone, H., & Stevenson, J. (1997). The association between internalizing and externalizing behavior in childhood and early adolescence: Genetic or environmental common influences? Journal of Abnormal Child Psychology, 25, 277–286.
Glaser, K. (1967). Masked depression in children and adolescents. American Journal of Psychotherapy, 21, 565–574.
Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345.
Gooren, E. M. J. C., van Lier, P. A. C., Stegge, H., Terwogt, M. M., & Koot, H. M. (2011). The development of conduct problems and depressive symptoms in early elementary school children: The role of peer rejection. Journal of clinical and adolescent psychology, 40, 245–253.
Granic, I. (2012). Don’t worry, be angry: Anxiety, aggression and repair in parent–child relationships. Unpublished inaugural speech, Radboud University Nijmegen, The Netherlands.
Gross, H. E., Shaw, D. S., & Moilanen, K. L. (2008). Reciprocal associations between boys’ externalizing problems and mothers’ depressive symptoms. Journal of Abnormal Psychology, 36, 693–709.
Hammen, C. (2006). Stress generation in depression: Reflections on origins, research, and future directions. Journal of Clinical Psychology, 62, 1065–1082.
Hardy, G. E., Shapiro, D. A., Haynes, C. E., & Rick, J. K. (1999). Validation of the General Health Questionnaire using a sample of employees from the Health Care Services. Psychological Assessment, 11, 159–165.
Hoglund, W. L., & Leadbeater, B. J. (2004). The effects of family, school, and classroom ecologies on changes in children’s social competence and emotional and behavioral problems in first grade. Developmental Psychology, 40, 533–544.
Horowitz, J. L., Garber, J., Ciesla, J. A., Young, J. F., & Mufson, L. (2007). Prevention of depressive symptoms in adolescents: A randomized trial of cognitive-behavioral and interpersonal prevention programs. Journal of Consulting and Clinical Psychology, 75(5), 693.
Ialongo, N., Edelsohn, G., Werthamer-Larsson, L., Crockett, L., & Kellman, S. (1996). The course of aggression in first-grade children with and without comorbid anxious symptoms. Journal of Abnormal Child Psychology, 24, 445–456.
Jöreskog, K. G. (1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109–133.
Keiley, M. K., Bates, J. E., Dodge, K. A., & Pettit, G. S. (2000). A cross-domain growth analysis: Externalizing and internalizing behaviors during 8 years of childhood. Journal of Abnormal Child Psychology, 28, 161–179.
Kessler, R. C., Petukhova, M., & Zaslavsky, A. M. (2011). The role of latent internalizing and externalizing predisposition in accounting for the development of comorbidity among common mental disorders. Current Opinion in Psychiatry, 24, 307–312.
Koeter, M. W. J., & Ormel, J. (1991). General Health Questionnaire, Dutch version manual. Swets and Zeitlinger, Lisse
Krueger, R. F., & Markon, K. E. (2006). Reinterpreting comorbidity: A model-based approach to understanding and classifying psychopathology. Annual Review of Clinical Psychology, 2, 111–133.
Lahey, B. B., Loeber, R., Burke, J., Rathouz, P. J., & McBurnett, K. (2002). Waxing and waning in concert: Dynamic comorbidity of conduct disorder with other disruptive and emotional problems over 7 years among clinic-referred boys. Journal of Abnormal Psychology, 111, 556–567.
Laird, R. D., Jordan, K., Dodge, K. A., Pettit, G. S., & Bates, J. E. (2001). Peer rejection in childhood, involvement with antisocial peers in early adolescence, and the development of externalizing problems. Development and Psychopathology, 13, 337–354.
Last, C. G., Perrin, S., Hersen, M., & Kazdin, A. E. (1996). A prospective study of childhood anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1502–1510.
Laursen, B. P., & Hoff, E. (2006). Person-centered and variable-centered approaches to longitudinal data. Merrill-Palmer Quarterly, 52, 377–389.
Lee, E. J., & Bukowski, W. M. (2012). Co-development of internalizing and externalizing problems behaviors: Causal direction and common vulnerability. Journal of Adolescence. doi:10.1016/j.adolescence.2011.10.008.
Lilienfeld, S. O. (2003). Comorbidity between and within childhood externalizing and internalizing disorders: Reflections and directions. Journal of Abnormal Child Psychology, 31, 285–291.
Loeber, R., & Keenan, K. (1994). Interaction between conduct disorder and its comorbid conditions: Effects of age and gender. Clinical Psychology Review, 14, 497–523.
Manassis, K., Tannock, R., & Monga, S. (2009). Anxious by maternal- versus self-report: Are they the same children? Journal of Canadian Academy of Child and Adolescent Psychiatry, 18, 103–109.
Mathiesen, K. S., Sanson, A., Stoolmiller, M., & Karevold, E. (2009). The nature and predictors of undercontrolled and internalizing problem trajectories across early childhood. Journal of Abnormal Child Psychology, 37, 209–222.
McDonald, R. P. (1978). Generalizability in factorable domains: “Domain validity and generalizability”. Educational and Psychological Measurement, 38, 75–79.
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum.
Mesman, J., Bongers, I. L., & Koot, H. M. (2001). Preschool developmental pathways to preadolescent internalizing and externalizing problems. Journal of Child Psychology and Psychiatry, 42, 679–690.
Muthén, L. K., & Muthén, B. O. (1998–2007). Mplus user’s guide (5th ed.). Los Angeles, CA: Muthén and Muthén.
Nagin, D. (1999). Analyzing developmental trajectories: A semi-parametric, group-based approach. Psychological Methods, 4, 139–157.
Nauta, M. H., Scholing, A., Emmelkamp, P. M., & Minderaa, R. B. (2003). Cognitive-behavioral therapy for children with anxiety disorders in a clinical setting: No additional effect of a cognitive parent training. Journal of the American Academy of Child and Adolescent Psychiatry, 42(11), 1270–1278.
O’Connor, T. C., McGuire, S., Reiss, D., Hetherington, E. M., & Plomin, R. (1998). Co-occurrence of depressive symptoms and antisocial behavior in adolescence: A common genetic liability. Journal of Abnormal Psychology, 107, 27–38.
Oland, A. J., & Shaw, D. S. (2005). Pure versus co-occurring externalizing and internalizing symptoms in children: The potential role of socio-developmental milestones. Clinical Child and Family Psychology Review, 8, 247–270.
Otten, R., Wanner, B., Vitaro, F., & Engels, R. C. (2009). Disruptiveness, peer experiences and adolescent smoking: A long-term longitudinal approach. Addiction, 104, 641–650.
Panak, W. F., & Garber, J. (1992). Role of aggression, rejection, and attributions in the prediction of depression in children. Development and Psychopathology, 4, 145–165.
Patterson, G. R., & Capaldi, D. M. (1990). A mediational model for boys’ depressed mood. In J. E. Rolf & A. S. Masten (Eds.), Risk and protective factors in the development of psychopathology (pp. 141–163). New York: Cambridge University Press.
Pinderhughes, E. E., Dodge, K. A., Bates, J. A., Pettit, G. S., & Zelli, A. (2000). Discipline responses: Influence of parents’ socioeconomic status, ethnicity, beliefs about parenting, stress, and cognitive–emotional processes. Journal of Family Psychology, 14, 380–400.
Prinzie, P., Onghena, P., Hellinckx, W., Grietens, H., Ghesquiere, P., & Colpin, H. (2003). The additive and interactive effects of parenting and children’s personality on externalizing behaviour. European Journal of Personality, 17, 95–117.
Rathert, J., Fite, P. J., & Gaertner, A. E. (2011). Associations between effortful control, psychological control and proactive and reactive aggression. Child Psychiatry and Human Development, 42, 609–621.
Renk, K., Roberts, R., Roddenberry, A., Luick, M., Hillhouse, S., Meehan, C., et al. (2003). Mothers, fathers, gender role, and time parents spend with their children. Sex Roles, 48, 305–315.
Revelle, W., & Zinbarg, R. E. (2009). Coefficients alpha, beta, omega, and the GLB: Comments on Sijtsma. Psychometrika, 74, 145–154.
Rispens, J., Hermanns, J. M. A., & Meeus, W. H. J. (1996). Opvoeden in Nederland. Assen: van Gorcum.
Ritakallio, M., Koivisto, A., von der Pahlen, B., Pelkonen, M., Marttunen, M., & Kaltiala-Heino, R. (2008). Continuity, comorbidity and longitudinal associations between depression and antisocial behavior in middle adolescence: a 2-year prospective follow-up study. Journal of Adolescence, 31, 355–370.
Rodriguez, C. (2011). Association between independent reports of maternal parenting stress and children’s internalizing symptomatology. Journal of Child and Family Studies, 20, 631–639.
Rubin, K. H., & Mills, R. S. L. (1991). Conceptualizing developmental pathways to internalizing disorders in childhood. Canadian Journal of Behavioural Science, 23, 300–317.
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8, 23–74.
Speltz, M., McClellan, J., DeKleyn, M., & Jones, K. (1999). Preschool boys with oppositional defiant disorder: Clinical presentation and diagnostic change. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 838–845.
Stice, E., Shaw, H., Bohon, C., Marti, C. N., & Rohde, P. (2009). A meta-analytic review of depression prevention programs for children and adolescents: Factors that predict magnitude of intervention effects. Journal of Consulting and Clinical Psychology, 77, 486.
Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4-to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13, 254–274.
Stone, L. L., Otten, R., Ringlever, L., Hiemstra, M., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2013a). The parent version of the Strengths and Difficulties Questionnaire: Omega as an alternative to alpha and a test for measurement invariance. European Journal of Psychological Assessment, 29, 44–50.
Stone, L. L., Otten, R., Soenens, B., Kuntsche, E., & Engels, R. C. M. E. (2013b). Does parental psychological control relate to internalizing problems in early childhood? An examination using the Berkeley puppet interview. International Journal of Behavioral Development, 37, 309–318.
Van Lier, P., & Koot, H. M. (2010). Developmental cascades of peer relations and symptoms of externalizing and internalizing problems from kindergarten to fourth-grade elementary school. Development and Psychopathology, 22, 569–582.
van Widenfelt, B. M., Goedhart, A. W., Treffers, P. D. A., & Goodman, R. (2003). Dutch version of the Strengths and Difficulties Questionnaire (SDQ). European Child and Adolescent Psychiatry, 12, 281–289.
Vitaro, F., Brendgen, M., & Tremblay, R. (2000). Influence of deviant friends on delinquency: Searching for moderator variables. Journal of Abnormal Child Psychology, 28, 313–325.
Weiss, B., Süsser, K., & Catron, T. (1998). Common and specific features of childhood psychopathology. Journal of Abnormal Psychology, 107, 118–127.
Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363–381.
Acknowledgments
This research was granted by the Dutch Organization for Health Research and Care Innovation (ZonMW: 80-82435-98-8026).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stone, L.L., Otten, R., Engels, R.C.M.E. et al. Relations Between Internalizing and Externalizing Problems in Early Childhood. Child Youth Care Forum 44, 635–653 (2015). https://doi.org/10.1007/s10566-014-9296-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10566-014-9296-4