Abstract
This study examined the validity of micro social observations and macro ratings of parent–child interaction in early to middle childhood. Seven hundred and thirty-one families representing multiple ethnic groups were recruited and screened as at risk in the context of Women, Infant, and Children (WIC) Nutritional Supplement service settings. Families were randomly assigned to the Family Checkup (FCU) intervention or the control condition at age 2 and videotaped in structured interactions in the home at ages 2, 3, 4, and 5. Parent–child interaction videotapes were micro-coded using the Relationship Affect Coding System (RACS) that captures the duration of two mutual dyadic states: positive engagement and coercion. Macro ratings of parenting skills were collected after coding the videotapes to assess parent use of positive behavior support and limit setting skills (or lack thereof). Confirmatory factor analyses revealed that the measurement model of macro ratings of limit setting and positive behavior support was not supported by the data, and thus, were excluded from further analyses. However, there was moderate stability in the families’ micro social dynamics across early childhood and it showed significant improvements as a function of random assignment to the FCU. Moreover, parent–child dynamics were predictive of chronic behavior problems as rated by parents in middle childhood, but not emotional problems. We conclude with a discussion of the validity of the RACS and on methodological advantages of micro social coding over the statistical limitations of macro rating observations. Future directions are discussed for observation research in prevention science.
Similar content being viewed by others
Notes
Note that the recently developed three-step approach (Asparouhov and Muthén 2013) was not feasible in this study because the main predictor variable was a latent variable. It is not yet possible to include a latent variable in the auxiliary variable command in the new three-step approach.
The CFA result of this model at age 5 also had a poor fit of the data, χ 2 (89) = 1296.19, p < .001, RMSEA = 0.16, CFI = 0.70, and SRMR = 0.14
Additionally, we tested FCU intervention effects on parent–child dynamics at age 3 and 4, respectively. There was a significant intervention effect on parent–child dynamics at age 3 but not at age 4.
References
Achenbach, T. M., & Edelbrock, C. S. (1983). Manual for the Child Behavior Checklist and revised behavior profile. Burlington: University of Vermont Department of Psychiatry.
Asparouhov, T., & Muthén, B. (2013). Auxiliary variables in mixture modeling: A 3-step approach using Mplus. Online, http://statmodel.com/examples/webnotes/Aux-Mixture_submitted_corrected_webnote.pdf.
Bank, L., Dishion, T. J., Skinner, M., & Patterson, G. R. (1990). Method variance in structural equation modeling: Living with “glop”. In G. R. Patterson (Ed.), Aggression and depression in family interactions (pp. 247–280). Hillsdale: Erlbaum.
Bell, R. Q. (1979). Parent, child, and reciprocal influences. American Psychologist, 34, 821.
Bolck, A., Croon, M. A., & Hagenaars, J. A. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis, 12, 3–27. doi:10.1093/pan/mph001.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504.
Clark, S., & Muthen, B. (2009). Relating latent class analysis results to variables not included in the analysis. Online, https://www.statmodel.com/download/relatinglca.pdf.
Cohn, J. F., & De la Torre, F. (2015). Automated face analysis for affective computing. In R. A. Calvo, S. K. D’Mello, J. Gratch, & A. Kappas (Eds.), Handbook of affective computing (pp. 131–150). New York: Oxford. doi:10.1093/oxfordhb/9780199942237.001.0001.
Cook, R. D. (1977). Detection of influential observation in linear regression. Technometrics, 19, 15–18. doi:10.2307/1268249.
Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin Co.
Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children’s lives: An ecological, family-centered approach to mental health care. Washington, DC: American Psychological Association. doi:10.1037/11485-000.
Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2014). Prevention of problem behavior through annual family check-ups in early childhood: Intervention effects from the home to early elementary school. Journal of Abnormal Child Psychology, 42, 343–354. doi:10.1007/s10802-013-9768-2.
Dishion, T. J., Forgatch, M. S., Van Ryzin, M. J., & Winter, C. (2012). The nonlinear dynamics of family problem solving in adolescence: The predictive validity of a peaceful resolution attractor. Nonlinear Dynamics, Psychology, and Life Sciences, 16, 331–352.
Dishion, T. J., Shaw, D. S., Connell, A., Gardner, F. E. M., Weaver, C., & Wilson, M. (2008). The family check-up with high-risk indigent families: Preventing problem behavior by increasing parents’ positive behavior support in early childhood. Child Development, 79, 1395–1414. doi:10.1111/j.1467-8624.2008.01195.x.
Dishion, T. J., Stormshak, E. A., & Kavanagh, K. (2011). Everyday parenting: A therapist’s guide for supporting family management practices. Champaign: Research Press.
Dwyer, J. H. (1983). Statistical models for the social and behavioral sciences. New York: Oxford University Press.
Eisenberg, N., Zhou, Q., Spinrad, T. L., Valiente, C., Fabes, R. A., & Liew, J. (2005). Relations among positive parenting, children’s effortful control, and externalizing problems: A three-wave longitudinal study. Child Development, 76, 1055–1071.
Fiske, D. W. (1986). Specificity of method and knowledge in social science. In D. W. Fiske & R. A. Shweder (Eds.), Metatheory in social science: Pluralisms and subjectivities (pp. 61–82). Chicago: University of Chicago Press.
Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.
Forgatch, M. S., & Patterson, G. R. (2010). Parent management training-Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 159–178). New York: Guilford Press. doi:10.1080/07317107.2011.596010.
Gardner, F. (2000). Methodological issues in the use of observational methods for measuring parent child interaction. Clinical Child and Family Psychology Review, 3, 185–198.
Gardner, F., Sonuga-Barke, E., & Sayal, K. (1999). Parents anticipating misbehaviour: An observational study of strategies parents use to prevent conflict with behaviour problem children. Journal of Child Psychology and Psychiatry, 40, 1185–1196.
Glueck, S., & Glueck, E. (1950). Unraveling juvenile delinquency. New York: Commonwealth Fund.
Gonzales, N. A., Hiraga, Y., & Cauce, A. M. (1995). Observing mother-daughter interaction in African-American and Asian-American families. In H. I. McCubbin, E. A. Thompson, A. I. Thompson, & J. E. Fromer (Eds.), Resiliency in African-American families (Vol. 3, pp. 259–285). Thousand Oaks: SAGE.
Granic, I., & Patterson, G. R. (2006). Toward a comprehensive model of antisocial development: A dynamic systems approach. Psychological Review, 113, 101–131. doi:10.1037/0033-295X.113.1.101.
Griffin, W. A., & Gardner, W. (1989). Analysis of behavioral durations in observational studies of social interaction. Psychological Bulletin, 106, 497–502. doi:10.1037/0033-2909.106.3.497.
Hart, B., & Risley, T. R. (1995). Meaningful differences in the everyday experiences of young American children. Baltimore: Brookes Publishing Co.
Hollenstein, T. (2013). State space grids: Depicting dynamics across development. New York: Springer.
Hollenstein, T., & Lewis, M. D. (2006). A state space analysis of emotion and flexibility in parent-child interactions. Emotion, 6, 656–662. doi:10.1037/1528-3542.6.4.656.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118.
Lewis, M. D. (2000). The promise of dynamic systems approaches for an integrated account of human development. Child Development, 71, 36–43. doi:10.1111/1467-8624.00116.
Lo, Y., Mendell, N., & Rubin, D. (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778. doi:10.1093/biomet/88.3.767.
Loeber, R., & Dishion, T. J. (1984). Boys who fight at home and school: Family conditions influencing cross-setting consistency. Journal of Consulting and Clinical Psychology, 52(5), 759.
McLachlan, G., & Peel, D. (2000). Finite mixture models. New York: Wiley. doi:10.1002/0471721182.
Miller, W. R., & Rollnick, S. (2002). Motivational interviewing. New York: The Guilford Press.
Muthén, L. K., & Muthén, B. O. (2012a). Mplus (version 7.1). Los Angeles: Muthén & Muthén.
Muthén, L. K., & Muthén, B. O. (2012). Latent variable modeling using Mplus: Day 2. https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0ahUKEwj-3f3I9r7LAhUJ9mMKHYsHDnsQFggeMAA&url=http%3A%2F%2Fstatmodel2.com%2Fdownload%2Fhandouts%2FBeijing2012-Day2.pdf&usg=AFQjCNGLMmzxUzV9wMIFt9aa2bCj6iSDGw&bvm=bv.116636494,d.eWE&cad=rja.
Technology, N. I. (2012). The Observer XT reference manual 11.0. Wageningen: Author.
O’Dell, S. (1974). Training parents in behavior modification: A review. Psychological Bulletin, 81, 418–433. doi:10.1037/h0036545.
Osgood, C. E. (1962). Studies on the generality of affective meaning systems. American Psychologist, 17, 10–28. doi:10.1037/h0045146.
Patterson, G. R. (1974a). A basis for identifying stimuli which control behaviors in natural settings. Child Development, 45, 900–911. doi:10.2307/1128075.
Patterson, G. R. (1974b). Interventions for boys with conduct problems: Multiple settings, treatments, and criteria. Journal of Consulting and Clinical Psychology, 42, 471–481. doi:10.1037/h0036731.
Patterson, G. R. (1982). A social learning approach: III. Coercive family process. Eugene, OR: Castalia.
Patterson, G. R. (1986). Performance models for antisocial boys. American Psychologist, 41, 432–444. doi:10.1037/0003-066x.41.4.432.
Patterson, G. R., & Moore, D. R. (1979). Interactive patterns of units of behavior. In M. E. Lamb, S. J. Suomi, & G. R. Stevenson (Eds.), Social interaction analysis: Methodological issues. Madison: University of Wisconsin Press.
Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys. Eugene: Castalia.
Pitts, S. C., West, S. G., & Tein, J.-Y. (1996). Longitudinal measurement models in evaluation research: Examining stability and change. Evaluation and Program Planning, 19, 333–350.
Ram, N., & Grimm, K. J. (2009). Growth mixture modeling: A method for identifying differences in longitudinal change among unobserved groups. International Journal of Behavioral Development, 33, 565–576. doi:10.1177/0165025409343765.
Ramaswamy, V., DeSarbo, W., Reibstein, D., & Robinson, W. (1993). An empirical pooling approach for estimating marketing mix elasticities with PIMS data. Marketing Science, 12, 103–124. doi:10.1287/mksc.12.1.103.
Reid, J. B. (1978). The development of specialized observation systems. In J. B. Reid (Ed.), A social learning approach to family intervention. II. Observation in home settings (pp. 43–49). Eugene: Castalia.
Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461–464. doi:10.1214/aos/1176344136.
Sclove, L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333–343. doi:10.1007/bf02294360.
Shaw, D. S., & Bell, R. Q. (1993). Developmental theories of parental contributors to antisocial behavior. Journal of Abnormal Child Psychology, 21, 493–518.
Shaw, D. S., Dishion, T. J., Supplee, L., Gardner, F., & Arnds, K. (2006). Randomized trial of a family-centered approach to the prevention of early conduct problems: 2-year effects of the Family Check-Up in early childhood. Journal of Consulting and Clinical Psychology, 74, 1–9. doi:10.1037/0022-006x.74.1.1.
Sitnick, S. L., Shaw, D. S., Gill, A., Dishion, T., Winter, C., Waller, R., Gardner, F., & Wilson, M. (2014). Parenting and the Family Check-Up: Changes in observed parent–child interaction following early childhood intervention. Journal of Clinical Child and Adolescent Psychology, 44, 970–984. doi:10.1080/15374416.2014.940623.
Smith, J. D., Dishion, T. J., Shaw, D. S., Wilson, M. N., Winter, C. C., & Patterson, G. R. (2014). Coercive family process and early-onset conduct problems from age 2 to school entry. Development and Psychopathology, 26, 917–932. doi:10.1017/s0954579414000169.
Snyder, J., Edwards, P., McGraw, K., Kilgore, K., & Holton, A. (1994). Escalation and reinforcement in mother–child conflict: Social processes associated with the development of physical aggression. Development and Psychopathology, 6, 305–321. doi:10.1017/s0954579400004600.
Stoolmiller, M., & Snyder, J. (2006). Modeling heterogeneity in social interaction processes using multilevel survival analysis. Psychological Methods, 11, 164–177. doi:10.1037/1082-989x.11.2.164.
Tein, J.-Y., Coxe, S., Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural equation modeling, 20, 640–657. NIHMS359239. DOI: 10.1080/10705511.2013.824781
Webster-Stratton, C., & Reid, M. J. (2010). The incredible years parents, teachers, and children training series: A multifacted treatment approach for children with conduct problems. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 194–210). New York: Guilford Press.
Weinrott, M. R., Reid, J. B., Bauske, B. W., & Brummett, B. (1981). Supplementing naturalistic observations with observer impressions. Behavioral Assessment, 3, 151–159.
West, S., Finch, J., & Curran, P. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues and applications (pp. 56–75). Thousand Oaks: Sage.
Yasui, M., & Dishion, T. J. (2008). Direct observation of family management: Validity and reliability as a function of coder ethnicity and training. Behavior Therapy, 39, 336–347. doi:10.1016/j.beth.2007.10.001.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
Funding for this research was provided by National Institute on Drug Abuse grant R01 DA036832-01A1 awarded to Daniel Shaw.
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. This article does not contain any studies with animals performed by any of the authors.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
ESM 1
(PDF 37 kb)
Rights and permissions
About this article
Cite this article
Dishion, T.J., Mun, C.J., Tein, JY. et al. The Validation of Macro and Micro Observations of Parent–Child Dynamics Using the Relationship Affect Coding System in Early Childhood. Prev Sci 18, 268–280 (2017). https://doi.org/10.1007/s11121-016-0697-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11121-016-0697-5