Abstract
The growing acknowledgment of children’s agency has increased the use of child reports in family research. This study investigates three challenges that are related to the inclusion of children in surveys: 1) selection bias in the sample through parent and child refusal; 2) measurement equivalence of parent and child reports; and 3) the effect of parental presence during the interview on child reports. These challenges are investigated with the multi-actor data of the Divorce in Flanders study. The study shows that divorced parents more often refuse child participation than married parents. A parental refusal is also more likely in case of less frequent open communication with the child. The results further indicate that children answer as reliably as their parents on survey questions, but also that children report less frequent parental conflict, a less problematic communication with their mother, and a less open communication with mother and father, than their parents. This suggests that children’s perspectives on family relations are different from their parents. Therefore, including child reports in family research may enhance the understanding of family life. Finally, children tend to report slightly different on family relations when parents are present. It is concluded that processes of social desirability and selection are important to take into account when investigating children’s reports on their family life, as they can bias results and limit generalizability of the findings.
Similar content being viewed by others
References
Aquilino, W. (1999). Two views of one relationship: comparing parents’ and young adult children’s reports of the quality of intergenerational relations. Journal of Marriage and the Family, 61(4), 858–870.
Arbuckle, J. L. (1996). Full information estimation in the presence of incomplete data. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 243–277). Mahwah: Lawrence Erlbaum Associates, Inc.
Barnes, H., & Olson, D. H. (1986). Parent-adolescent communication scale. In D. H. Olson, H. I. McCubbin, H. Barnes, A. Larsen, M. Muxen, & M. Wilson (Eds.), Family inventories (pp. 35–37). St. Paul: University of Minnesota Press.
Bell, A. (2007). Designing and testing questionnaires for children. Journal of Research in Nursing, 12(5), 461–469.
Bengtson, V. L., & Kuypers, J. A. (1971). Generational differences and the developmental stake. Aging and Human Development, 2, 249–260.
Billiet, J., Philippens, M., Fitzgerald, R., & Stoop, I. (2007). Estimation of nonresponse bias in the European Social Survey: using information from reluctant respondents. Journal of Official Statistics, 23(2), 135–162.
Brown, T. A. (2006). Confirmatory factor analysis for applied research. London: Guilford Press.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills: Sage.
Byrne, M. (2011). Structural equation modeling with Mplus: Basic concepts, applications, and programming. London: Routledge.
Chin, T., & Phillips, M. (2004). Social reproduction and child-rearing practices: social class, children’s agency, and the summer activity gap. Sociology of Education, 77(3), 185–210.
Davidov, E., Meuleman, B., Billiet, J., & Schmidt, P. (2008). Values and support for immigration: a cross-country comparison. European Sociological Review, 24(3), 583–599.
Davidov, E., Datler, G., Schmidt, P., & Schwartz, S. H. (2011). Testing the invariance of values in the Benelux countries with the European Social Survey: accounting for ordinality. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural analysis: Methods and applications (pp. 149–168). New York: Routledge.
De Leeuw, E., Borgers, N., & Smits, A. (2004). Pretesting questionnaires for children and adolescents. In S. Presser, J. M. Rothgeb, M. P. Couper, J. T. Lessler, E. Martin, & E. S. Martin (Eds.), Methods for testing and evaluating survey questionnaires (pp. 409–429). New York: Wiley.
Docket, S., & Perry, B. (2011). Researching with young children: seeking assent. Child Indicators Research, 4, 231–247.
Haugen, G. (2008). Incorporating children’s perspectives into family sociology: dilemmas and potentialities. Barn, 1(1), 27–41.
Haugen, G. (2010). Children’s perspectives on everyday experiences of shared residence: time, emotions and agency dilemmas. Children & Society, 24(2), 112–122.
Kalmijn, M., & Liefbroer, A. C. (2011). Nonresponse of secondary respondents in multi-actor surveys: determinants, consequences, and possible remedies. Journal of Family Issues, 32(6), 735–767.
Krumpal, I. (2011). Determinants of social desirability bias in sensitive surveys: a literature review. Quality & Quantity, 47(4), 1–23.
Mandemaekers, J., & Dykstra, P. A. (2008). Discrepancies in parent’s and adult child’s reports of support and contact. Journal of Marriage and Family, 70(2), 495–506.
Mason, J., & Danby, S. (2011). Children as experts in their lives: child inclusive research. Child Indicators Research, 4(2), 185–189.
Mason, J., & Hood, S. (2011). Exploring issues of children as actors in social research. Children and Youth Services Review, 33(4), 490–495.
Matsuo, H., Billiet, J., Loosveldt, G., Berglund, F., & Kleven, Ø. (2010). Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3. Survey Research Methods, 4(3), 165–178.
Melli, M. S. (1999). Guideline review: child support and time sharing by parents. Family Law Quarterly, 33(1), 219–234.
Mortelmans, D., Pasteels, I., Van Bavel, J., Bracke, P., Matthijs, K. & Van Peer, C. (2011). Divorce in Flanders. Data collection and code book. http://www.scheidinginvlaanderen.be. Accessed 7 Jul 2014
Moskowitz, J. M. (2004). Assessment of cigarette smoking and smoking susceptibility among youth: telephone Computer-assisted self-interviews versus computer-assisted telephone interviews. Public Opinion Quarterly, 68(4), 565–587.
Nigg, C. R., Lippke, S., & Maddock, J. E. (2009). Factorial invariance of the theory of planned behavior applied to physical activity across gender, age, and ethnic groups. Psychology of Sport and Exercise, 10(2), 219–225.
Noller, P., Seth-Smith, M., Bouma, R., & Schweitzer, R. (1992). Parent and adolescent perceptions of family functioning: a comparison of clinic and non-clinic families. Journal of Adolescence, 15(2), 101–114.
Ogan, C., Karakuş, T., & Kurşun, E. (2013). Methodological issues in a survey of children’s online risk-taking and other behaviors in Europe. Journal of Children and Media, 7(1), 133–150.
Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517–529.
Snoeren, F., & Hoefnagels, C. (2013). Measuring perceived social support and perceived stress among primary school children in The Netherlands. Child Indicators Research, 7(3), 473–486.
Tigges, B. (2003). Parental consent and adolescent risk behavior research. Journal of Nursing Scholarship, 35(3), 283–289.
Van de Vijver, F. J. R. (2011). Capturing bias in structural equation modeling. In E. Davidov, P. Schmidt, & J. Billet (Eds.), Cross-cultural analysis. Methods and applications (pp. 3–34). New York: Routledge.
Whittaker, J. A. (2012). Using the modification index and standardized expected parameter change for model modification. The Journal of Experimental Education, 80(1), 26–44.
Acknowledgments
We would like to thank the Research Foundation Flanders (FWO) for her research grants, which made this research possible.
Author information
Authors and Affiliations
Corresponding author
Additional information
Nele Havermans and Sofie Vanassche joint first authorship.
Appendices
Appendix A
Appendix B
Rights and permissions
About this article
Cite this article
Havermans, N., Vanassche, S. & Matthijs, K. Methodological Challenges of Including Children in Family Research: Measurement Equivalence, Selection Bias and Social Desirability. Child Ind Res 8, 975–997 (2015). https://doi.org/10.1007/s12187-014-9275-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12187-014-9275-1