Skip to main content
Log in

Methodological Challenges of Including Children in Family Research: Measurement Equivalence, Selection Bias and Social Desirability

  • Published:
Child Indicators Research Aims and scope Submit manuscript

Abstract

The growing acknowledgment of children’s agency has increased the use of child reports in family research. This study investigates three challenges that are related to the inclusion of children in surveys: 1) selection bias in the sample through parent and child refusal; 2) measurement equivalence of parent and child reports; and 3) the effect of parental presence during the interview on child reports. These challenges are investigated with the multi-actor data of the Divorce in Flanders study. The study shows that divorced parents more often refuse child participation than married parents. A parental refusal is also more likely in case of less frequent open communication with the child. The results further indicate that children answer as reliably as their parents on survey questions, but also that children report less frequent parental conflict, a less problematic communication with their mother, and a less open communication with mother and father, than their parents. This suggests that children’s perspectives on family relations are different from their parents. Therefore, including child reports in family research may enhance the understanding of family life. Finally, children tend to report slightly different on family relations when parents are present. It is concluded that processes of social desirability and selection are important to take into account when investigating children’s reports on their family life, as they can bias results and limit generalizability of the findings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aquilino, W. (1999). Two views of one relationship: comparing parents’ and young adult children’s reports of the quality of intergenerational relations. Journal of Marriage and the Family, 61(4), 858–870.

    Article  Google Scholar 

  • Arbuckle, J. L. (1996). Full information estimation in the presence of incomplete data. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 243–277). Mahwah: Lawrence Erlbaum Associates, Inc.

    Google Scholar 

  • Barnes, H., & Olson, D. H. (1986). Parent-adolescent communication scale. In D. H. Olson, H. I. McCubbin, H. Barnes, A. Larsen, M. Muxen, & M. Wilson (Eds.), Family inventories (pp. 35–37). St. Paul: University of Minnesota Press.

    Google Scholar 

  • Bell, A. (2007). Designing and testing questionnaires for children. Journal of Research in Nursing, 12(5), 461–469.

    Article  Google Scholar 

  • Bengtson, V. L., & Kuypers, J. A. (1971). Generational differences and the developmental stake. Aging and Human Development, 2, 249–260.

    Article  Google Scholar 

  • Billiet, J., Philippens, M., Fitzgerald, R., & Stoop, I. (2007). Estimation of nonresponse bias in the European Social Survey: using information from reluctant respondents. Journal of Official Statistics, 23(2), 135–162.

    Google Scholar 

  • Brown, T. A. (2006). Confirmatory factor analysis for applied research. London: Guilford Press.

    Google Scholar 

  • Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Beverly Hills: Sage.

    Google Scholar 

  • Byrne, M. (2011). Structural equation modeling with Mplus: Basic concepts, applications, and programming. London: Routledge.

    Google Scholar 

  • Chin, T., & Phillips, M. (2004). Social reproduction and child-rearing practices: social class, children’s agency, and the summer activity gap. Sociology of Education, 77(3), 185–210.

    Article  Google Scholar 

  • Davidov, E., Meuleman, B., Billiet, J., & Schmidt, P. (2008). Values and support for immigration: a cross-country comparison. European Sociological Review, 24(3), 583–599.

    Article  Google Scholar 

  • Davidov, E., Datler, G., Schmidt, P., & Schwartz, S. H. (2011). Testing the invariance of values in the Benelux countries with the European Social Survey: accounting for ordinality. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural analysis: Methods and applications (pp. 149–168). New York: Routledge.

    Google Scholar 

  • De Leeuw, E., Borgers, N., & Smits, A. (2004). Pretesting questionnaires for children and adolescents. In S. Presser, J. M. Rothgeb, M. P. Couper, J. T. Lessler, E. Martin, & E. S. Martin (Eds.), Methods for testing and evaluating survey questionnaires (pp. 409–429). New York: Wiley.

    Chapter  Google Scholar 

  • Docket, S., & Perry, B. (2011). Researching with young children: seeking assent. Child Indicators Research, 4, 231–247.

    Article  Google Scholar 

  • Haugen, G. (2008). Incorporating children’s perspectives into family sociology: dilemmas and potentialities. Barn, 1(1), 27–41.

    Google Scholar 

  • Haugen, G. (2010). Children’s perspectives on everyday experiences of shared residence: time, emotions and agency dilemmas. Children & Society, 24(2), 112–122.

    Article  Google Scholar 

  • Kalmijn, M., & Liefbroer, A. C. (2011). Nonresponse of secondary respondents in multi-actor surveys: determinants, consequences, and possible remedies. Journal of Family Issues, 32(6), 735–767.

    Article  Google Scholar 

  • Krumpal, I. (2011). Determinants of social desirability bias in sensitive surveys: a literature review. Quality & Quantity, 47(4), 1–23.

    Google Scholar 

  • Mandemaekers, J., & Dykstra, P. A. (2008). Discrepancies in parent’s and adult child’s reports of support and contact. Journal of Marriage and Family, 70(2), 495–506.

    Article  Google Scholar 

  • Mason, J., & Danby, S. (2011). Children as experts in their lives: child inclusive research. Child Indicators Research, 4(2), 185–189.

    Article  Google Scholar 

  • Mason, J., & Hood, S. (2011). Exploring issues of children as actors in social research. Children and Youth Services Review, 33(4), 490–495.

    Article  Google Scholar 

  • Matsuo, H., Billiet, J., Loosveldt, G., Berglund, F., & Kleven, Ø. (2010). Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3. Survey Research Methods, 4(3), 165–178.

    Google Scholar 

  • Melli, M. S. (1999). Guideline review: child support and time sharing by parents. Family Law Quarterly, 33(1), 219–234.

    Google Scholar 

  • Mortelmans, D., Pasteels, I., Van Bavel, J., Bracke, P., Matthijs, K. & Van Peer, C. (2011). Divorce in Flanders. Data collection and code book. http://www.scheidinginvlaanderen.be. Accessed 7 Jul 2014

  • Moskowitz, J. M. (2004). Assessment of cigarette smoking and smoking susceptibility among youth: telephone Computer-assisted self-interviews versus computer-assisted telephone interviews. Public Opinion Quarterly, 68(4), 565–587.

    Article  Google Scholar 

  • Nigg, C. R., Lippke, S., & Maddock, J. E. (2009). Factorial invariance of the theory of planned behavior applied to physical activity across gender, age, and ethnic groups. Psychology of Sport and Exercise, 10(2), 219–225.

    Article  Google Scholar 

  • Noller, P., Seth-Smith, M., Bouma, R., & Schweitzer, R. (1992). Parent and adolescent perceptions of family functioning: a comparison of clinic and non-clinic families. Journal of Adolescence, 15(2), 101–114.

    Article  Google Scholar 

  • Ogan, C., Karakuş, T., & Kurşun, E. (2013). Methodological issues in a survey of children’s online risk-taking and other behaviors in Europe. Journal of Children and Media, 7(1), 133–150.

    Article  Google Scholar 

  • Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: a comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517–529.

    Article  Google Scholar 

  • Snoeren, F., & Hoefnagels, C. (2013). Measuring perceived social support and perceived stress among primary school children in The Netherlands. Child Indicators Research, 7(3), 473–486.

    Article  Google Scholar 

  • Tigges, B. (2003). Parental consent and adolescent risk behavior research. Journal of Nursing Scholarship, 35(3), 283–289.

    Article  Google Scholar 

  • Van de Vijver, F. J. R. (2011). Capturing bias in structural equation modeling. In E. Davidov, P. Schmidt, & J. Billet (Eds.), Cross-cultural analysis. Methods and applications (pp. 3–34). New York: Routledge.

    Google Scholar 

  • Whittaker, J. A. (2012). Using the modification index and standardized expected parameter change for model modification. The Journal of Experimental Education, 80(1), 26–44.

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank the Research Foundation Flanders (FWO) for her research grants, which made this research possible.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sofie Vanassche.

Additional information

Nele Havermans and Sofie Vanassche joint first authorship.

Appendices

Appendix A

Table 9 Mean scores on individual items of the conflict scale, openness in communication subscale, and problems with communication subscale per actor

Appendix B

Table 10 Descriptive values of child and parent characteristics

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Havermans, N., Vanassche, S. & Matthijs, K. Methodological Challenges of Including Children in Family Research: Measurement Equivalence, Selection Bias and Social Desirability. Child Ind Res 8, 975–997 (2015). https://doi.org/10.1007/s12187-014-9275-1

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12187-014-9275-1

Keywords

Navigation