Skip to main content
Top
Gepubliceerd in: Journal of Child and Family Studies 2/2015

01-02-2015 | Original Paper

Challenges with Online Research for Couples and Families: Evaluating Nonrespondents and the Differential Impact of Incentives

Auteurs: Dean M. Busby, Keitaro Yoshida

Gepubliceerd in: Journal of Child and Family Studies | Uitgave 2/2015

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

In this study some of the challenges of conducting online research with couples and families were considered. Of particular concern with internet samples are the high percentages of individuals who have invalid email addresses and the low response rates to research requests. Using a sample of 2,049 individuals from whom we had extensive information, we invited them to participant in a short survey on their couple relationship. We explored whether participants who had invalid email addresses were different from those who had valid addresses and we compared those who completed the survey with those who did not. Also we explored the influence of different monetary incentives on response rates. The findings indicated that when evaluating 18 different areas including background measures, personality measures, family of origin measures, and couple measures, there were only minor differences between those with valid and invalid email addresses, and only one difference between those who completed the survey and those who did not. Also a lottery type monetary incentive showed promise in improving response rates compared to no incentive and a standard $20 incentive.
Literatuur
go back to reference Bosnjak, M., & Batinic, B. (2002). Understanding the willingness to participate in online surveys: The case of email questionnaires. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 81–92). Seattle, WA: Hogrefe & Huber. Bosnjak, M., & Batinic, B. (2002). Understanding the willingness to participate in online surveys: The case of email questionnaires. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 81–92). Seattle, WA: Hogrefe & Huber.
go back to reference Bosnjak, M., & Tuten, T. L. (2003 ). Prepaid and promised incentives in web surveys. Social Science Computer Review, 21, 208–217.CrossRef Bosnjak, M., & Tuten, T. L. (2003 ). Prepaid and promised incentives in web surveys. Social Science Computer Review, 21, 208–217.CrossRef
go back to reference Brenner, V. (2002). Generalizability issues in internet-based survey research: Implications for the internet addiction controversy. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 93–113). Seattle, WA: Hogrefe & Huber. Brenner, V. (2002). Generalizability issues in internet-based survey research: Implications for the internet addiction controversy. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 93–113). Seattle, WA: Hogrefe & Huber.
go back to reference Busby, D. M., Gardner, B. C., & Taniguchi, N. (2005). The family of origin parachute model: Landing safely in adult romantic relationships. Family Relations, 54, 254–264.CrossRef Busby, D. M., Gardner, B. C., & Taniguchi, N. (2005). The family of origin parachute model: Landing safely in adult romantic relationships. Family Relations, 54, 254–264.CrossRef
go back to reference Busby, D. M., Holman, T. B., & Taniguchi, N. (2001). RELATE: Relationship evaluation of the individual, family, cultural, and couple contexts. Family Relations, 50, 308–316.CrossRef Busby, D. M., Holman, T. B., & Taniguchi, N. (2001). RELATE: Relationship evaluation of the individual, family, cultural, and couple contexts. Family Relations, 50, 308–316.CrossRef
go back to reference Cantrell, M. A., & Lupinacci, P. (2007). Methodological issues in online data collection. Journal of Advanced Nursing, 60, 544–549.PubMedCrossRef Cantrell, M. A., & Lupinacci, P. (2007). Methodological issues in online data collection. Journal of Advanced Nursing, 60, 544–549.PubMedCrossRef
go back to reference Carroll, A. E., Rivara, F. P., Ebel, B., Zimmerman, F. J., & Christakis, D. A. (2005). Household computer and Internet access: The digital divide in a pediatric clinic population. AMIA Annual Symposium Proceedings, 2005, 111–115.PubMedCentral Carroll, A. E., Rivara, F. P., Ebel, B., Zimmerman, F. J., & Christakis, D. A. (2005). Household computer and Internet access: The digital divide in a pediatric clinic population. AMIA Annual Symposium Proceedings, 2005, 111–115.PubMedCentral
go back to reference Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79.CrossRef Church, A. H. (1993). Estimating the effect of incentives on mail survey response rates: A meta-analysis. Public Opinion Quarterly, 57, 62–79.CrossRef
go back to reference Draper, T. W., & Holman, T. B. (2005). Locating the big five personality factors in the RELATE relationship evaluation measures. Psychological Reports, 97, 877–886.PubMed Draper, T. W., & Holman, T. B. (2005). Locating the big five personality factors in the RELATE relationship evaluation measures. Psychological Reports, 97, 877–886.PubMed
go back to reference Godwin, R. K. (1979). The consequences of large monetary incentives in mail surveys of elites. Public Opinon Quarterly, 43, 378–387.CrossRef Godwin, R. K. (1979). The consequences of large monetary incentives in mail surveys of elites. Public Opinon Quarterly, 43, 378–387.CrossRef
go back to reference Goritz, A. S. (2006). Incentives in web studies: Methodological issues and a review. International Journal of Internet Science, 1, 58–70. Goritz, A. S. (2006). Incentives in web studies: Methodological issues and a review. International Journal of Internet Science, 1, 58–70.
go back to reference Goritz, A. S., & Luthe, S. C. (2013). How do lotteries and study results influence response behavior in online panel? Social Science Computer Review, 31, 371–385.CrossRef Goritz, A. S., & Luthe, S. C. (2013). How do lotteries and study results influence response behavior in online panel? Social Science Computer Review, 31, 371–385.CrossRef
go back to reference Holman, T. B., et al. (2001). Premarital prediciton of maritla quality or breakup: Research, theory, and practice. New York: Bluwer Academic/Plenum Publishers. Holman, T. B., et al. (2001). Premarital prediciton of maritla quality or breakup: Research, theory, and practice. New York: Bluwer Academic/Plenum Publishers.
go back to reference Hopkins, K. D., & Podolak, J. (1983). Class of mail and the effects of monetary gratuity on the response rate of mail. Journal of Experimental Education, 51, 160–170. Hopkins, K. D., & Podolak, J. (1983). Class of mail and the effects of monetary gratuity on the response rate of mail. Journal of Experimental Education, 51, 160–170.
go back to reference Houston, M. J., & Nevin, J. (1977). The effects of source and appeal on mail survey response patterns. Journal of Marketing Research, 14, 374–378.CrossRef Houston, M. J., & Nevin, J. (1977). The effects of source and appeal on mail survey response patterns. Journal of Marketing Research, 14, 374–378.CrossRef
go back to reference James, J. M., & Bolstein, R. (1992). Large monetary incentives and their effect on mail survey response rate. Public Opinion Quarterly, 56(4), 442–453.CrossRef James, J. M., & Bolstein, R. (1992). Large monetary incentives and their effect on mail survey response rate. Public Opinion Quarterly, 56(4), 442–453.CrossRef
go back to reference LaCoursiere, S. (2003). Research methodology for the internet: External validity (generalizability). Advances in Nursing Science, 26, 257–273.PubMedCrossRef LaCoursiere, S. (2003). Research methodology for the internet: External validity (generalizability). Advances in Nursing Science, 26, 257–273.PubMedCrossRef
go back to reference Larson, J. H., & Holman, T. B. (1994). Premarital predictors of marital quality and stability. Family Relations, 43, 228–237.CrossRef Larson, J. H., & Holman, T. B. (1994). Premarital predictors of marital quality and stability. Family Relations, 43, 228–237.CrossRef
go back to reference Nederhof, A. J. (1983). The effects of material incentives in mail surveys: Two studies. Public Opinion Quarterly, 47, 103–111.CrossRef Nederhof, A. J. (1983). The effects of material incentives in mail surveys: Two studies. Public Opinion Quarterly, 47, 103–111.CrossRef
go back to reference Rogelberg, S. G., Conway, J. M., Sederburg, M. E., Spitzmuller, C., Aziz, S., & Knight, W. E. (2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88, 1104–1114.PubMedCrossRef Rogelberg, S. G., Conway, J. M., Sederburg, M. E., Spitzmuller, C., Aziz, S., & Knight, W. E. (2003). Profiling active and passive nonrespondents to an organizational survey. Journal of Applied Psychology, 88, 1104–1114.PubMedCrossRef
go back to reference Schoeni, R. F., Stafford, F., McGonagle, K. A., & Andreski, P. (2013). Response rates in national panel surveys. Annals of the American Academy of Political and Social Science, 645, 60–87.PubMedCentralPubMedCrossRef Schoeni, R. F., Stafford, F., McGonagle, K. A., & Andreski, P. (2013). Response rates in national panel surveys. Annals of the American Academy of Political and Social Science, 645, 60–87.PubMedCentralPubMedCrossRef
go back to reference Schonland, A., & Williams, P. (1996). Using the internet for travel and tourism survey research: Experiences from the Net traveler survey. Journal of Travel Research, 35, 81–87.CrossRef Schonland, A., & Williams, P. (1996). Using the internet for travel and tourism survey research: Experiences from the Net traveler survey. Journal of Travel Research, 35, 81–87.CrossRef
go back to reference Schwarz, N., Groves, R. M., & Schuman, H. (1998). Survey methods. In D. T. Gilbert, S. T. Fiske, & L. Gardner (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 143–179). New York: McGraw-Hill. Schwarz, N., Groves, R. M., & Schuman, H. (1998). Survey methods. In D. T. Gilbert, S. T. Fiske, & L. Gardner (Eds.), The handbook of social psychology (4th ed., Vol. 1, pp. 143–179). New York: McGraw-Hill.
go back to reference Singer, E., & Ye, C. (2013). The use and effects of incentives in surveys. Annals of the American Academy of Political and Social Science, 645, 112–141.CrossRef Singer, E., & Ye, C. (2013). The use and effects of incentives in surveys. Annals of the American Academy of Political and Social Science, 645, 112–141.CrossRef
go back to reference Sundberg-Cohon, J & Peacock, J (1998). Projectable internet panels. Using traditional “best practices” in an untraditional environment. ESOMAR Internet Conference, Paris, Jan 1998 Papers 219–232. Sundberg-Cohon, J & Peacock, J (1998). Projectable internet panels. Using traditional “best practices” in an untraditional environment. ESOMAR Internet Conference, Paris, Jan 1998 Papers 219–232.
go back to reference Szelenyi, K., Bryant, A., & Lindholm, J. A. (2005). What money can buy: Examining the effects of prepaid monetary incentives on survey response rates among college students. Educational Research and Evaluation, 11(4), 385–404.CrossRef Szelenyi, K., Bryant, A., & Lindholm, J. A. (2005). What money can buy: Examining the effects of prepaid monetary incentives on survey response rates among college students. Educational Research and Evaluation, 11(4), 385–404.CrossRef
go back to reference Tourangeau, R. (2004). Survey research and societal change. Annual Review of Psychology, 55, 775–801.PubMedCrossRef Tourangeau, R. (2004). Survey research and societal change. Annual Review of Psychology, 55, 775–801.PubMedCrossRef
go back to reference Tuten, T. L., Urban, D. J., & Bosnjak, M. (2002). Internet surveys and data quality: A review. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 7–26). Seattle, WA: Hogrefe & Huber. Tuten, T. L., Urban, D. J., & Bosnjak, M. (2002). Internet surveys and data quality: A review. In B. Batinic, U.-D. Reips, & M. Bosnak (Eds.), Online social sciences (pp. 7–26). Seattle, WA: Hogrefe & Huber.
go back to reference White, P. R. (1988). A buck for your thoughts? Even top execs can’t resist. Marketing News, 22, 24. White, P. R. (1988). A buck for your thoughts? Even top execs can’t resist. Marketing News, 22, 24.
go back to reference Whitmore, W. J. (1976). Mail survey premiums and response bias. Journal of Marketing Research, 13, 46–50.CrossRef Whitmore, W. J. (1976). Mail survey premiums and response bias. Journal of Marketing Research, 13, 46–50.CrossRef
Metagegevens
Titel
Challenges with Online Research for Couples and Families: Evaluating Nonrespondents and the Differential Impact of Incentives
Auteurs
Dean M. Busby
Keitaro Yoshida
Publicatiedatum
01-02-2015
Uitgeverij
Springer US
Gepubliceerd in
Journal of Child and Family Studies / Uitgave 2/2015
Print ISSN: 1062-1024
Elektronisch ISSN: 1573-2843
DOI
https://doi.org/10.1007/s10826-013-9863-6

Andere artikelen Uitgave 2/2015

Journal of Child and Family Studies 2/2015 Naar de uitgave