Abstract
Non-response to mailed surveys reduces the effective sample size and may introduce bias. Non-response has been studied by (1) comparison to available data in population based registers, (2) directly contacting non-respondents by telephone or single-item reply cards, and (3) longitudinal repetition of the survey. The goal of this paper was to propose an additional method to study non-response bias: when the variable of interest has a familial component, data from respondents can be used as proxy for the data from their non-responding family members. This approach was used with data on smoking, alcohol consumption, physical activity, coffee- and tea-use, education, body mass index, religion, burnout, life events, personality and mental health in large number of siblings and DZ twins registered with the Netherlands Twin Register. In addition, for smoking behavior, we also used the second strategy by sending a reply card. Results show that scores of members from less cooperative families or incomplete twin pairs tended to be more unfavorable than the scores from highly cooperative families or complete twin pairs. For example, family members from less cooperative families cycled less often and scored higher on anxious depression and neuroticism. For smoking, both the results of the reply card and the results of the additional method suggested a higher percentage smokers among the non-respondents but this was only significant with reply card method. In general, differences between highly/less cooperative families and complete/incomplete DZ twins were small. Results suggest that, even for studies with moderate response rates, data collected on health, personality and lifestyle are relatively unbiased.
Similar content being viewed by others
References
Hupkens CLH, Berg vd J, Zee vd J. National health interview surveys in Europe: An overview. Health Policy 1999; 47: 145–168.
Etter JF, Perneger TV. Analysis of non-response bias in a mailed health survey. J Clin Epidemiol 1997; 50: 1123–1128.
Reijneveld SA, Stonks K. The impact of response bias on estimates of health care utilization in a metropolitan area: The use of administrative data. Int J Epidemiol. 1999; 28: 1134–1140.
Bergstrand R, Vedin A, Wilhelmsson C, Wilhelmsen L. Bias due to non-participation and heterogenous subgroups in population surveys. J Chronic Dis 1983; 36: 725–728.
Barchielli A, Balzi D. Nine-year follow-up of a survey on smoking habits in Florence (Italy): Higher mortality among non-responders. Int J Epidemiol 2002; 31:1038–1042.
Hill A, Roberts J, Ewings P, Gunnell D. Non-response bias in a lifestyle survey. J Public Health Med 1997; 19: 203–207.
Jacobsen BK, Thelle DS. The Tromso Heart Study: responders and non-responders to a health questionnaire,do they differ? Scand J Soc Med 1988; 16: 101–104.
Macera CA, Jackson KL, Davis DR, Kronenfeld JJ, Blair SN. Patterns of non-response to a mail survey. J Clin Epidemiol 1990; 43: 1427–1430.
Loon v AJM, Tijhuis M, Picavet HSJ, Surtees PG, Ormel J. Survey non-response in the Netherlands: Effects on prevalence estimates and associations. Ann Epidemiol 2003; 13: 105–110.
Heath AC, Howells W, Kirk K, et al. Predictors of non-response to a questionnaire survey of a volunteer twin panel: Findings from the Australian 1989 twin cohort. Twin Res 2001; 4: 73–80.
Koopmans JR, Doornen v LJP, Boomsma DI, Smoking and sports participation. In: Goldbourt U, Faire de U, Berg K (eds), Genetic factors in coronary heart disease. Dordrecht, Boston: Kluwer Academic Publishers, 1994: 217–235.
Koopmans JR, Boomsma DI. Familial resemblances in alcohol use: Genetic or cultural transmission? J Studies Alcohol 1996; 57: 19–28.
Vink JM, Willemsen G, Boomsma DI. The association of current smoking behavior with the smoking behavior of parents, siblings, friends and spouses. Addiction 2003; 98: 923–931.
Boomsma DI, Geus EJC, de Baal GCM, van Koopmans JR. A religious upbringing reduces the influence of genetic factors on disinhibition: Evidence for interactions between genotype and environment on personality. Twin Res 1999; 2: 115–125.
Eaves LJ, Heath AC, et al. Comparing the biological and cultural inheritance of personality and social attitudes in the Virginia 30,000 study of twins and their relatives. Twin Res 1999; 2: 62–80.
Aarnio M, Winter T, Kujala UM, Kaprio J. Familial aggregation of leisure-time physical activity-a three generation study. Int J Sports Med 1997; 18: 549–556.
Geus de EJC, Boomsma DI, Snieder H. Genetic correlation of exercise with heart rate and respiratory sinus arrhytmia. Med Sci Sports Exerc 2003; 35: 1287–1295.
Vink JM, Willemsen AHM, Engels R, Boomsma DI. Smoking status of parents, siblings and friends: Predictors of regular smoking? Findings from a longitudinal twin-family study. Twin Res 2003; 6: 209–217.
Boomsma DI, Vink JM, Beijsterveldt CEM v, et al.Netherlands Twin Register: A focus on longitudinal research. Twin Res 2002; 5: 401–406.
Neale MC, Boker SM, Xie G, Maes HH. Mx: Statistical modeling. 5th edn. Richmond, VA 23298: VCU Box 900126, 1999.
Falconer DS, Mackay TFC, Quantitative Genetics. Essex: Longman Group Ltd., 1996.
Schaufeli WB, Leiter MP, Maslach C, Jackson SE, The MBI-General Survey, In: Maslach C, Jackson SE, Leiter MP (eds), Maslach burnout inventory. Palo Alto, CA: Consulting Psychologists Press, 1996: 19–26.
Wilde GJS. Neurotische labiliteit gemeten volgens devragenlijst methode (the questionnaire method as a means of measuring neurotic instability). Amsterdam: van Rossen, 1970.
Achenbach TM. Manual for the young adult self report and young adult behavior checklist. Burlington, VT: University of Vermont, Department of Psychiatry,1997.
Verhulst FC, Ende Jvd, Koot HM. Handleiding voor de Youth Self-Report. Rotterdam: Afdeling Kinder-en Jeugdpsychiatrie, Sophia Kinderziekenhuis/Academisch Ziekenhuis Rotterdam/Erasmus Universiteit Rotterdam,1997.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rate to postal questionnaires: Systematic review. Br Med J 2002; 324(18 MAY): 1–9.
Stang A. Nonresponse research-an underdeveloped field in epidemiology. Eur J Epidemiol 2003; 18: 929–931.
Kotaniemi JT, Hassi J, Kataja M, et al. Does nonresponder bias have a significant effect on the results in a postal questionnaire study? Eur J Epidemiol 2001; 17: 809–817.
Korkeila K, Suominen S, Ahvenainen J, et al. Nonresponse and related factors in a nationwide health survey. Eur J Epidemiol 2001; 17: 991–999.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Vink, J.M., Willemsen, G., Stubbe, J.H. et al. Estimating Non-Response Bias in Family Studies: Application to Mental Health and Lifestyle. Eur J Epidemiol 19, 623–630 (2004). https://doi.org/10.1023/B:EJEP.0000036814.56108.66
Issue Date:
DOI: https://doi.org/10.1023/B:EJEP.0000036814.56108.66