Abstract
Background
Web-based surveys may have advantages related to the speed and cost of data collection as well as data quality. However, they may be biased by low and selective participation. We predicted that such biases would distort point-estimates such as average symptom level or prevalence but not patterns of associations with putative risk-factors.
Methods
A structured psychiatric interview was administered to parents in two successive surveys of child mental health. In 2003, parents were interviewed face-to-face, whereas in 2006 they completed the interview online. In both surveys, interviews were preceded by paper questionnaires covering child and family characteristics.
Results
The rate of parents logging onto the web site was comparable to the response rate for face-to-face interviews, but the rate of full response (completing all sections of the interview) was much lower for web-based interviews. Full response was less frequent for non-traditional families, immigrant parents, and less educated parents. Participation bias affected point estimates of psychopathology but had little effect on associations with putative risk factors. The time and cost of full web-based interviews was only a quarter of that for face-to-face interviews.
Conclusions
Web-based surveys may be performed faster and at lower cost than more traditional approaches with personal interviews. Selective participation seems a particular threat to point estimates of psychopathology, while patterns of associations are more robust.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Dillman DA, Smyth JD (2007) Design effects in the transition to web-based surveys. Am J Prev Med 32:s90–s96
Ford T, Goodman R, Meltzer H (2004) The relative importance of child, family, school and neighbourhood correlates of childhood psychiatric disorder. Soc Psychiatry Psychiatr Epidemiol 39:487–496
Goodman R (1997) The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry 38:581–586
Goodman R (1999) The extended version of the Strengths and Difficulties Questionnaire (SDQ) as a guide to child psychiatric caseness and consequent burden. J Child Psychol Psychiatry 40:791–801
Goodman R (2001) Psychometric properties of the Strengths and Difficulties Questionnaire. J Child Psychol Psychiatry 40:1337–1345
Goodman R, Ford T, Richards H, Gatward R, Meltzer H (2000) The Development and Well-Being Assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. J Child Psychol Psychiatry 41:645–655
Heiervang E, Goodman A, Goodman R (2008) The Nordic advantage in child mental health: separating health differences from reporting style in a cross-cultural comparison of psychopathology. J Child Psychol Psychiatry 49:678–685
Heiervang E, Stormark KM, Lundervold AJ, Heimann M, Goodman R, Posserud MB, Ullebø AK, Plessen KJ, Bjelland I, Lie SA, Gillberg C (2007) Psychiatric disorders in Norwegian 8- to 10-year-olds: an epidemiological survey of prevalence, risk factors, and service use. J Am Acad Child Adolesc Psychiatry 46:438–447
Lundberg I, Damström Thakker K, Hällström T, Forsell Y (2005) Determinants of non-participation, and the effects of non-participation on potential cause-effect relationships, in the PART study on mental disorders. Soc Psychiatry Psychiatr Epidemiol 40:475–483
Pealer LN, Weiler RM, Pigg RM Jr, Miller D, Dorman SM (2001) The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 28:547–559
Pérez RG, Ezpeleta L, Domenech JM (2007) Features associated with the non-participation and drop out by socially-at-risk children and adolescents in mental-health epidemiological studies. Soc Psychiatry Psychiatr Epidemiol 42:251–258
Sanders D, Clarke HD, Stewart MC, Whiteley P (2007) Does mode matter for modeling political choice? Evidence from the 2005 British Election Study. Polit Anal 15:257–285
Smith B, Smith TC, Gray GC, Ryan MA, Millennium Cohort Study Team (2007) When epidemiology meets the internet: web-based surveys in the Millenium Cohort Study. Am J Epidemiol 166:1345–1354
Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, Sonenstein FL (1998) Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280:867–873
Wolford G, Rosenberg SD, Rosenberg HJ, Swartz MS, Butterfield MI, Swanson JW, Jankowski MK (2008) A clinical trial comparing interviewer and computer-assisted assessment among clients with severe mental illness. Psychiatr Serv 59:765–769
Wolke D, Waylen A, Samara M, Steer C, Goodman R, Ford T, Lamberts K (2009) Does selective dropout in longitudinal studies lead to biased prediction of behaviour disorders? Br J Psychiatry 195:249–256
Acknowledgments
We are grateful to children, parents and teachers participating in the study, and to Kjell Morten Stormark and Astri Lundervold who are members of the study steering group. The study was supported by the City of Bergen, the Research Council of Norway, the Norwegian Directorate of Health, Western Norway Regional Health Authority, Haukeland University Hospital, Unifob Health, and the Meltzer legacy.
Conflict of interest statement
EH is the owner of Careahead, which offers training and consultancy on the use of the DAWBA. RG and his family own Youthinmind Ltd, a software company that produces the online version of the DAWBA.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Heiervang, E., Goodman, R. Advantages and limitations of web-based surveys: evidence from a child mental health survey. Soc Psychiat Epidemiol 46, 69–76 (2011). https://doi.org/10.1007/s00127-009-0171-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00127-009-0171-9