Skip to main content
SpringerLink
Log in

Estimating Non-Response Bias in Family Studies: Application to Mental Health and Lifestyle

  • Published:
European Journal of Epidemiology Aims and scope Submit manuscript

Abstract

Non-response to mailed surveys reduces the effective sample size and may introduce bias. Non-response has been studied by (1) comparison to available data in population based registers, (2) directly contacting non-respondents by telephone or single-item reply cards, and (3) longitudinal repetition of the survey. The goal of this paper was to propose an additional method to study non-response bias: when the variable of interest has a familial component, data from respondents can be used as proxy for the data from their non-responding family members. This approach was used with data on smoking, alcohol consumption, physical activity, coffee- and tea-use, education, body mass index, religion, burnout, life events, personality and mental health in large number of siblings and DZ twins registered with the Netherlands Twin Register. In addition, for smoking behavior, we also used the second strategy by sending a reply card. Results show that scores of members from less cooperative families or incomplete twin pairs tended to be more unfavorable than the scores from highly cooperative families or complete twin pairs. For example, family members from less cooperative families cycled less often and scored higher on anxious depression and neuroticism. For smoking, both the results of the reply card and the results of the additional method suggested a higher percentage smokers among the non-respondents but this was only significant with reply card method. In general, differences between highly/less cooperative families and complete/incomplete DZ twins were small. Results suggest that, even for studies with moderate response rates, data collected on health, personality and lifestyle are relatively unbiased.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Hupkens CLH, Berg vd J, Zee vd J. National health interview surveys in Europe: An overview. Health Policy 1999; 47: 145–168.

    Google Scholar 

  2. Etter JF, Perneger TV. Analysis of non-response bias in a mailed health survey. J Clin Epidemiol 1997; 50: 1123–1128.

    Google Scholar 

  3. Reijneveld SA, Stonks K. The impact of response bias on estimates of health care utilization in a metropolitan area: The use of administrative data. Int J Epidemiol. 1999; 28: 1134–1140.

    Google Scholar 

  4. Bergstrand R, Vedin A, Wilhelmsson C, Wilhelmsen L. Bias due to non-participation and heterogenous subgroups in population surveys. J Chronic Dis 1983; 36: 725–728.

    Google Scholar 

  5. Barchielli A, Balzi D. Nine-year follow-up of a survey on smoking habits in Florence (Italy): Higher mortality among non-responders. Int J Epidemiol 2002; 31:1038–1042.

    Google Scholar 

  6. Hill A, Roberts J, Ewings P, Gunnell D. Non-response bias in a lifestyle survey. J Public Health Med 1997; 19: 203–207.

    Google Scholar 

  7. Jacobsen BK, Thelle DS. The Tromso Heart Study: responders and non-responders to a health questionnaire,do they differ? Scand J Soc Med 1988; 16: 101–104.

    Google Scholar 

  8. Macera CA, Jackson KL, Davis DR, Kronenfeld JJ, Blair SN. Patterns of non-response to a mail survey. J Clin Epidemiol 1990; 43: 1427–1430.

    Google Scholar 

  9. Loon v AJM, Tijhuis M, Picavet HSJ, Surtees PG, Ormel J. Survey non-response in the Netherlands: Effects on prevalence estimates and associations. Ann Epidemiol 2003; 13: 105–110.

    Google Scholar 

  10. Heath AC, Howells W, Kirk K, et al. Predictors of non-response to a questionnaire survey of a volunteer twin panel: Findings from the Australian 1989 twin cohort. Twin Res 2001; 4: 73–80.

    Google Scholar 

  11. Koopmans JR, Doornen v LJP, Boomsma DI, Smoking and sports participation. In: Goldbourt U, Faire de U, Berg K (eds), Genetic factors in coronary heart disease. Dordrecht, Boston: Kluwer Academic Publishers, 1994: 217–235.

    Google Scholar 

  12. Koopmans JR, Boomsma DI. Familial resemblances in alcohol use: Genetic or cultural transmission? J Studies Alcohol 1996; 57: 19–28.

    Google Scholar 

  13. Vink JM, Willemsen G, Boomsma DI. The association of current smoking behavior with the smoking behavior of parents, siblings, friends and spouses. Addiction 2003; 98: 923–931.

    Google Scholar 

  14. Boomsma DI, Geus EJC, de Baal GCM, van Koopmans JR. A religious upbringing reduces the influence of genetic factors on disinhibition: Evidence for interactions between genotype and environment on personality. Twin Res 1999; 2: 115–125.

    Google Scholar 

  15. Eaves LJ, Heath AC, et al. Comparing the biological and cultural inheritance of personality and social attitudes in the Virginia 30,000 study of twins and their relatives. Twin Res 1999; 2: 62–80.

    Google Scholar 

  16. Aarnio M, Winter T, Kujala UM, Kaprio J. Familial aggregation of leisure-time physical activity-a three generation study. Int J Sports Med 1997; 18: 549–556.

    Google Scholar 

  17. Geus de EJC, Boomsma DI, Snieder H. Genetic correlation of exercise with heart rate and respiratory sinus arrhytmia. Med Sci Sports Exerc 2003; 35: 1287–1295.

    Google Scholar 

  18. Vink JM, Willemsen AHM, Engels R, Boomsma DI. Smoking status of parents, siblings and friends: Predictors of regular smoking? Findings from a longitudinal twin-family study. Twin Res 2003; 6: 209–217.

    Google Scholar 

  19. Boomsma DI, Vink JM, Beijsterveldt CEM v, et al.Netherlands Twin Register: A focus on longitudinal research. Twin Res 2002; 5: 401–406.

    Google Scholar 

  20. Neale MC, Boker SM, Xie G, Maes HH. Mx: Statistical modeling. 5th edn. Richmond, VA 23298: VCU Box 900126, 1999.

    Google Scholar 

  21. Falconer DS, Mackay TFC, Quantitative Genetics. Essex: Longman Group Ltd., 1996.

    Google Scholar 

  22. Schaufeli WB, Leiter MP, Maslach C, Jackson SE, The MBI-General Survey, In: Maslach C, Jackson SE, Leiter MP (eds), Maslach burnout inventory. Palo Alto, CA: Consulting Psychologists Press, 1996: 19–26.

    Google Scholar 

  23. Wilde GJS. Neurotische labiliteit gemeten volgens devragenlijst methode (the questionnaire method as a means of measuring neurotic instability). Amsterdam: van Rossen, 1970.

  24. Achenbach TM. Manual for the young adult self report and young adult behavior checklist. Burlington, VT: University of Vermont, Department of Psychiatry,1997.

    Google Scholar 

  25. Verhulst FC, Ende Jvd, Koot HM. Handleiding voor de Youth Self-Report. Rotterdam: Afdeling Kinder-en Jeugdpsychiatrie, Sophia Kinderziekenhuis/Academisch Ziekenhuis Rotterdam/Erasmus Universiteit Rotterdam,1997.

    Google Scholar 

  26. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rate to postal questionnaires: Systematic review. Br Med J 2002; 324(18 MAY): 1–9.

    Google Scholar 

  27. Stang A. Nonresponse research-an underdeveloped field in epidemiology. Eur J Epidemiol 2003; 18: 929–931.

    Google Scholar 

  28. Kotaniemi JT, Hassi J, Kataja M, et al. Does nonresponder bias have a significant effect on the results in a postal questionnaire study? Eur J Epidemiol 2001; 17: 809–817.

    Google Scholar 

  29. Korkeila K, Suominen S, Ahvenainen J, et al. Nonresponse and related factors in a nationwide health survey. Eur J Epidemiol 2001; 17: 991–999.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Biological Psychology, Vrije Universiteit, Van der Boechorststraat 1, 1081, BT Amsterdam, The Netherlands

    Jacqueline M. Vink, Gonneke Willemsen, Janine H. Stubbe, Christel M. Middeldorp, Rozemarijn S.L. Ligthart, Kim D. Baas, Hanneke J.C. Dirkzwager, Eco J.C. de Geus & Dorret I. Boomsma

Authors
  1. Jacqueline M. Vink
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gonneke Willemsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Janine H. Stubbe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Christel M. Middeldorp
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Rozemarijn S.L. Ligthart
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kim D. Baas
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hanneke J.C. Dirkzwager
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Eco J.C. de Geus
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Dorret I. Boomsma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jacqueline M. Vink.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Vink, J.M., Willemsen, G., Stubbe, J.H. et al. Estimating Non-Response Bias in Family Studies: Application to Mental Health and Lifestyle. Eur J Epidemiol 19, 623–630 (2004). https://doi.org/10.1023/B:EJEP.0000036814.56108.66

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:EJEP.0000036814.56108.66

Search

Navigation