Skip to main content
SpringerLink
Log in

Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods

  • Published:
Environmental and Resource Economics Aims and scope Submit manuscript

Abstract

In a choice experiment setup considering a non-market good, this paper adds to the literature on survey mode effects by providing evidence that internet surveys can be a viable alternative to traditional mail surveys when gathering feedback from a sample of respondents. The case study concerns preferences for protecting different types of landscape from road encroachment when building new motorways in Denmark. Two samples of respondents are surveyed—one by internet and one by mail. The performances of the two samples are compared over six different criteria; response rates, protest responses, demographics, preferences and WTP, estimation precision, and, finally, certainty in choice. Differences are observed for some of these criteria, implying that analysts should be aware that choosing internet over mail could be accompanied by a survey mode effect. However, the observed differences do not translate into significant differences in the unconditional WTP estimates. In most applied economic valuation studies of non-market goods, the main objective is in fact estimation of WTP. Hence, in the present case, the identified survey mode effects do not severely invalidate the applicability and continued use of the internet as a suitable means of collecting data for choice experiment economic valuation of non-market goods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adamowicz WL, Louviere J, Swait J (1998) Introduction to attribute-based stated choice methods. National Oceanic and Atmospheric Administration, Washington

    Google Scholar 

  • Babbie E (1990) Survey research methods. Wadsworth, Belmont

    Google Scholar 

  • Ballantyne C (2004) Online or on paper: an examination of the differences in response and respondents to a survey administered in two modes. Paper presented at the Australasian Evaluation Society 2004 International Conference, Adelaide, 13–15 Oct 2004

  • Berrens RP, Bohara AK, Jenkins-Smith HC, Silva CL, Weimer L (2003) The advent of internet surveys for political research: a comparison of telephone and internet samples. Polit Anal 11(1): 1–22

    Article  Google Scholar 

  • Berrens RP, Bohara AK, Jenkins-Smith HC, Silva CL, Weimer DL (2004) Information and effort in contingent valuation surveys: application to global climate change using national internet samples. J Environ Econ Manag 47(2): 331–363

    Article  Google Scholar 

  • Bierlaire M (2003) BIOGEME: a free package for the estimation of discrete choice models. In: Proceedings of the 3rd Swiss Transportation Research Conference, Ascona, 19–21 Mar 2003

  • Boyle KJ (2003) Contingent valuation in practice. In: Champ PA, Boyle KJ, Brown TC (eds) A primer on nonmarket valuation. Kluwer, Dordrecht, pp 111–169

    Google Scholar 

  • Boyle KJ, Bergstrom JC (1999) Doubt, doubt, and doubters: the genesis of a new research agenda? In: Bateman IJ, Willis KG (eds) Valuing environmental preferences. Theory and practice of the contingent valuation method in the US, EU, and developing countries. Oxford University Press, Oxford, pp 183–206

    Google Scholar 

  • Bronner F, Kuijlen T (2007) The live or digital interviewer. Int J Market Res 49(2): 167–190

    Google Scholar 

  • Campbell D, Hutchinson WG, Scarpa R (2006) Using mixed logit models to derive individual-specific WTP estimates for landscape improvements under agri-environmental schemes: evidence from the Rural Environment Protection Scheme in Ireland. In: Koundouri P, Birol E (eds) Choice experiments informing European environmental policy. Edward Elgar (Forthcoming)

  • Carlsson F, Frykblom P, Liljenstolpe C (2003) Valuing wetland attributes: an application of choice experiments. Ecol Econ 47(1): 95–103

    Article  Google Scholar 

  • Cobanoglu C, Warde B, Moreo PJ (2001) A comparison of mail, fax and web-based survey methods. Int J Market Res 43(4): 441–452

    Google Scholar 

  • Couper MP (2000) Web surveys: a review of issues and approaches. Publ Opin Q 64: 464–494

    Article  Google Scholar 

  • Deutskens E, de Jong A, de Ruyter K, Wetzels M (2006) Comparing the generalizability of online and mail surveys in cross-national service quality research. Market Lett 17(2): 119–136

    Article  Google Scholar 

  • Dillman DA (1978) Mail and telephone surveys. The total design method. Wiley, New York

    Google Scholar 

  • Dillman DA (2007) Mail and internet surveys: the tailored design method—2007 update with new internet, visual, and mixed-mode guide. Wiley, New York

    Google Scholar 

  • Dillman DA, Christian LM (2005) Survey mode as a source of instability in responses across surveys. Field Methods 17(1): 30–52

    Article  Google Scholar 

  • Dommeyer CJ, Baum P, Hanna RW, Chapman KS (2004) Gathering faculty evaluations by in-class and online surveys: their effects on response rates and evaluations. Assess Eval High Edu 29(5): 611–623

    Article  Google Scholar 

  • Fleming CM, Bowden M (2009) Web-based surveys as an alternative to traditional mail methods. J Environ Manag 90(1): 284–292

    Article  Google Scholar 

  • Forsman G, Varedian M (2002) Mail and web surveys: a cost and response rate comparison in a study of students housing conditions. Paper presented at The International Conference on Improving Surveys, Copenhagen, 25–28 Aug 2002

  • Greene WH, Hensher DA (2007) Heteroscedastic control for random coefficients and error components in mixed logit. Transp Res E Logist Transp Rev 43(5): 610–623

    Article  Google Scholar 

  • Heckman JJ (1979) Sample selection bias as a specification error. Econometrica 47(1): 153–161

    Article  Google Scholar 

  • Hensher DA, Greene WH (2003) The mixed logit model: the state of practice. Transportation 30(2): 133–176

    Article  Google Scholar 

  • Hensher DA, Rose JM, Greene WH (2005) Applied choice analysis: a primer. Cambridge University Press, Cambridge

    Google Scholar 

  • Hess S, Bierlaire M, Polak J (2005) Estimation of value of travel-time savings using Mixed Logit models. Transp Res Pol Pract 39(3): 221–236

    Article  Google Scholar 

  • Hole AR (2007) A comparison of approaches to estimating confidence intervals for willingness to pay measures. Health Econ 16(8): 827–840

    Article  Google Scholar 

  • Hudson D, Seah L-H, Hite D, Haab T (2004) Telephone presurveys, self-selection, and non-response bias to mail and internet surveys in economic research. Appl Econ Lett 11(4): 237–240

    Article  Google Scholar 

  • Jorgensen BS, Syme GJ (2000) Protest responses and willingness to pay: attitude toward paying for stormwater pollution abatement. Ecol Econ 33(2): 251–265

    Article  Google Scholar 

  • Jorgensen BS, Syme GJ, Bishop BJ, Nancarrow BE (1999) Protest responses in contingent valuation. Environ Resour Econ 14(1): 131–150

    Article  Google Scholar 

  • Kaplowitz MD, Hadlock TD, Levine R (2004) A comparison of web and mail survey response rates. Publ Opin Q 68(1): 94–101

    Article  Google Scholar 

  • Knapp H, Kirk SA (2003) Using pencil and paper, Internet and touch-tone phones for self-administered surveys: does methodology matter? Comput Hum Behav 19(1): 117–134

    Article  Google Scholar 

  • Krinsky I, Robb AL (1986) On approximating the statistical properties of elasticities. Rev Econ Stat 68(4): 715–719

    Article  Google Scholar 

  • Krinsky I, Robb AL (1990) On approximating the statistical properties of elasticities: a correction. Rev Econ Stat 72(1): 189–190

    Article  Google Scholar 

  • Kuhfeld W (2005) Marketing research methods in SAS. Experimental design, choice, conjoint and graphical techniques. SAS Institute Inc. http://support.sas.com/techsup/technote/ts722.pdf. Cited 12 November 2008.

  • Ladenburg J, Olsen SB (2008) Gender specific starting point bias in choice experiments: evidence from an empirical study. J Environ Econ Manag 56(3): 275–285

    Article  Google Scholar 

  • Leece P, Bhandari M, Sprague S, Swiontkowski MF, Schemitsch EH, Tornetta P, Devereaux PJ, Guyatt GH (2004) Internet Versus Mailed Questionnaires: a controlled comparison. J Med Internet Res 6(4): e39

    Article  Google Scholar 

  • Lindsey G (1994) Market models, protest bids, and outliers in contingent valuation. J Water Resour Plan Manag 120(1): 121–129

    Article  Google Scholar 

  • Louviere J, Hensher DA, Swait J (2000) Stated choice methods. Analysis and applications. Cambridge University Press, Cambridge

    Google Scholar 

  • Lundhede TH, Olsen SB, Jacobsen JB, Thorsen BJ (2009) Handling respondent uncertainty in choice experiments: evaluating recoding approaches against explicit modelling of uncertainty. Paper presented at the International Choice Modelling Conference, Harrogate, 30 March–1 April 2009

  • Marta-Pedroso C, Freitas H, Domingos T (2007) Testing for the survey mode effect on contingent valuation data quality: a case study of web based versus in-person interviews. Ecol Econ 62(3-4): 388–398

    Article  Google Scholar 

  • McCabe SE, Boyd CJ, Couper MP, Crawford S, Darcy H (2002) Mode effects for collecting alcohol and other drug use data: web and US mail. J Stud Alcohol 63(6): 755–761

    Google Scholar 

  • McFadden D, Train K (2000) Mixed MNL models for discrete response. J Appl Econom 15(5): 447–470

    Article  Google Scholar 

  • McFadden D, Bemmaor AC, Caro FG, Dominitz J, Jun BH, Lewbel A, Matzkin RL, Molinari F, Schwarz N, Willis RJ, Winter JK (2005) Statistical analysis of choice experiments and surveys. Market Lett 16(3): 183–196

    Article  Google Scholar 

  • McMahon SR, Iwamoto M, Massoudi MS, Yusuf HR, Stevenson JM, David F, Chu SY, Pickering LK (2003) Comparison of e-mail, fax, and postal surveys of pediatricians. Pediatrics 111(4): 299–303

    Article  Google Scholar 

  • Meijer E, Rouwendal J (2006) Measuring welfare effects in models with random coefficients. J Appl Econom 21(2): 227–244

    Article  Google Scholar 

  • Meyerhoff J, Liebe U (2006) Protest beliefs in contingent valuation: explaining their motivation. Ecol Econ 57(4): 583–594

    Article  Google Scholar 

  • Mitchell RC, Carson RT (1989) Using surveys to value public goods: the contingent valuation method. Resources for the Future, Washington, DC

    Google Scholar 

  • Mitofsky WJ (1999) Pollsters.com. Publ Perspect 10: 24–26

    Google Scholar 

  • Morrison MD, Blamey RK, Bennett JW (2000) Minimising payment vehicle bias in contingent valuation studies. Environ Resour Econ 16(4): 407–422

    Article  Google Scholar 

  • Muffo JM, Sinclair A, Robson V (2003) A comparison of web versus paper alumni surveys. Paper presented at the Annual Forum of the Association for Institutional Research, Tampa, 20 May 2003

  • Olsen SB (2007) Internet vs mail—are stated preferences affected by the mode of sampling in a choice experiment. Paper presented at the EAERE 15th Annual Conference, Thessaloniki, 27–30 June 2007

  • Ottens M (2006) Use of the internet among individuals and enterprises. In: Statistics in focus. Available via Eurostat. http://epp.eurostat.ec.europa.eu/cache/ITY_OFFPUB/KS-NP-06-012/EN/KS-NP-06-012-EN.PDF. Cited 26 July 2007

  • Poe GL, Severance-Lossin E K, Welsh M P (1994) Measuring the difference (X−Y) of simulated distributions: a convolutions approach. Am J Agric Econ 76(4): 904–915

    Article  Google Scholar 

  • Poe GL, Giraud KL, Loomis JB (2005) Computational methods for measuring the difference of empirical distributions. Am J Agric Econ 87(2): 353–365

    Article  Google Scholar 

  • Revelt D, Train K (1998) Mixed logit with repeated choices: households’ choices of appliance efficiency level. Rev Econ Stat 80(4): 647–657

    Article  Google Scholar 

  • Rigby D, Burton M (2006) Modeling disinterest and dislike: a bounded Bayesian mixed logit model of the UK market for GM food. Environ Resour Econ 33(4): 485–509

    Article  Google Scholar 

  • Scarpa R, Ferrini S, Willis K (2005) Performance of error component models for status-quo effects in choice experiments. In: Scarpa R, Alberini A (eds) Applications of simulation methods in environmental and resource economics. The economics of non-market goods and resources, vol 6. Springer, Dordrecht, pp 247–273

    Chapter  Google Scholar 

  • Scarpa R, Thiene M, Marangon F (2008) Using flexible taste distributions to value collective reputation for environmentally friendly production methods. Can J Agric Econ 56(2): 145–162

    Article  Google Scholar 

  • Scarpa R, Willis K, Acutt M (2007) Valuing externalities from water supply: status quo, choice complexity, and individual random effects in panel kernel logit analysis of choice experiments. J Environ Plan Manag 50(4): 449–466

    Article  Google Scholar 

  • Schleyer TKL, Forrest JL (2000) Methods for the design and administration of web-based surveys. J Am Med Inform Assoc 7: 416–425

    Google Scholar 

  • Schmidt WC (1997) World-Wide Web survey research: benefits, potential problems, and solutions. Behav Res Methods Instrum Comput 29: 274–279

    Google Scholar 

  • Schonlau M, Fricker RD Jr, Elliott MN (2002) Conducting research surveys via E-mail and the web. RAND, Santa Monica

    Google Scholar 

  • Stanton J (1998) An empirical assessment of data collection using the Internet. Person Psychol 51: 709–725

    Article  Google Scholar 

  • Swait J, Louviere J (1993) The role of the scale parameter in the estimation and comparison of multinomial logit models. J Market Res 30(3): 305–314

    Article  Google Scholar 

  • Train K (2001) A comparison of hierarchical Bayes and maximum simulated likelihood for mixed logit. Working paper. Department of Economics, University of California, Berkeley

    Google Scholar 

  • Train K (2003) Discrete choice methods with simulation. Cambridge University Press, Cambridge

    Google Scholar 

  • Train K, Sonnier G (2005) Mixed logit with bounded distributions of correlated partworths. In: Scarpa R, Alberini A (eds) Applications of simulation methods in environmental and resource economics. The economics of non-market goods and resources, vol 6. Springer, Dordrecht, pp 117–134

    Chapter  Google Scholar 

  • Train K, Weeks M (2005) Discrete choice models in preference space and willing-to-pay space. In: Scarpa R, Alberini A (eds) Applications of simulation methods in environmental and resource economics. The economics of non-market goods and resources, vol 6. Springer, Dordrecht, pp 1–16

    Chapter  Google Scholar 

  • Tsuge T, Washida T (2003) Economic valuation of the Seto Inland Sea by using an Internet CV survey. Mar Pollut Bull 47(1–6): 230–236

    Article  Google Scholar 

  • Weible R, Wallace J (1998) Cyber research: the impact of the internet on data collection. Market Res 10(3): 19–24

    Google Scholar 

  • Wygant S, Lindorf R (1999) Surveying collegiate Net surfers—Web methodology or mythology. In: Quirk’s Marketing Research Review. http://www.quirks.com/articles/a1999/19990706.aspx?searchID=955999. Cited 26 July 2007

  • Yun GW, Trumbo C (2000) Comparative responses to a survey executed by post, email and web form. J Comput-Mediat Comm 6(1)

  • Zwerina K, Huber J, Kuhfeld W (1996) A general method for constructing efficient choice designs. SAS Institute Inc. http://support.sas.com/techsup/technote/ts650/ts650D.pdf. Cited 26 July 2007

Download references

Author information

Authors and Affiliations

  1. Institute of Food and Resource Economics, University of Copenhagen, Rolighedsvej 25, 1958, Frederiksberg C, Denmark

    Søren Bøye Olsen

Authors
  1. Søren Bøye Olsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Søren Bøye Olsen.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Olsen, S.B. Choosing Between Internet and Mail Survey Modes for Choice Experiment Surveys Considering Non-Market Goods. Environ Resource Econ 44, 591–610 (2009). https://doi.org/10.1007/s10640-009-9303-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10640-009-9303-7

Keywords

Search

Navigation