Skip to main content
Top
Gepubliceerd in: Quality of Life Research 4/2010

01-05-2010

Does mode of administration matter? Comparison of online and face-to-face administration of a time trade-off task

Auteurs: Richard Norman, Madeleine T. King, Dushyant Clarke, Rosalie Viney, Paula Cronin, Deborah Street

Gepubliceerd in: Quality of Life Research | Uitgave 4/2010

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Developments in electronic data collection methods have allowed researchers to generate larger datasets at lower costs, but relatively little is known about the comparative performance of the new methods. This paper considers the comparability of two modes of administration (face-to-face and remote electronic) for the time trade-off.

Method

Data were collected from a convenience sample of adults (n = 135) randomised to either a face-to-face time trade-off or a remote electronic tool. Patterns of responses were considered. For each sample, standard regression analysis was undertaken to generate a valuation set, which were then contrasted.

Results

The pattern of responses differed by mode of administration, with the electronic tool yielding larger standard deviations and higher proportions of responses at −1, 0 and 1. The impact of this on the regression was difficult to disentangle from the high variability around individual scores of states, which is a common feature of responses to time trade-off tasks. Under the scoring algorithms generated by mode of administration, the difference between scores exceeded 0.1 for 100 of the 243 EQ-5D health states.

Conclusions

This comparison demonstrates that variability arising from mode of administration needs to be considered in developing health state valuations. While electronic administration has considerable cost advantages, particular attention to the design of the task is required. This has wider implications, as all modes of administration may have mode-specific impacts on the distribution of valuation responses.
Literatuur
1.
go back to reference Hawthorne, G., Richardson, J., & Day, N. A. (2001). A comparison of the assessment of quality of life (AQoL) with four other generic utility instruments. Annals of Medicine, 33(5), 358–370.CrossRefPubMed Hawthorne, G., Richardson, J., & Day, N. A. (2001). A comparison of the assessment of quality of life (AQoL) with four other generic utility instruments. Annals of Medicine, 33(5), 358–370.CrossRefPubMed
2.
go back to reference Bansback, N., Davis, S., & Brazier, J. (2007). Using contrast sensitivity to estimate the cost-effectiveness of verteporfin in patients with predominantly classic age-related macular degeneration. Eye, 21(12), 1455–1463.CrossRefPubMed Bansback, N., Davis, S., & Brazier, J. (2007). Using contrast sensitivity to estimate the cost-effectiveness of verteporfin in patients with predominantly classic age-related macular degeneration. Eye, 21(12), 1455–1463.CrossRefPubMed
3.
go back to reference Brazier, J., Roberts, J., & Deverill, M. (2002). The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics, 21(2), 271–292.CrossRefPubMed Brazier, J., Roberts, J., & Deverill, M. (2002). The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics, 21(2), 271–292.CrossRefPubMed
4.
go back to reference Dolan, P. (1997). Modelling valuations for EuroQol health states. Medical Care, 35(11), 1095–1108.CrossRefPubMed Dolan, P. (1997). Modelling valuations for EuroQol health states. Medical Care, 35(11), 1095–1108.CrossRefPubMed
5.
go back to reference Hawthorne, G., Richardson, J., & Osborne, R. (1999). The assessment of quality of life (AQoL) instrument: A psychometric measure of health-related quality of life. Quality of Life Research, 8(3), 209–224.CrossRefPubMed Hawthorne, G., Richardson, J., & Osborne, R. (1999). The assessment of quality of life (AQoL) instrument: A psychometric measure of health-related quality of life. Quality of Life Research, 8(3), 209–224.CrossRefPubMed
6.
go back to reference Horsman, J., Furlong, W., Feeny, D., et al. (2003). The health utilities index (hui): Concepts, measurement properties and applications. Health and Quality of Life Outcomes, 1(54). Horsman, J., Furlong, W., Feeny, D., et al. (2003). The health utilities index (hui): Concepts, measurement properties and applications. Health and Quality of Life Outcomes, 1(54).
7.
go back to reference Drummond, M., O’Brien, B. J., Stoddart, G. L., et al. (2004). Methods for the economic evaluation of health care programmes. Oxford: Oxford Medical Publications. Drummond, M., O’Brien, B. J., Stoddart, G. L., et al. (2004). Methods for the economic evaluation of health care programmes. Oxford: Oxford Medical Publications.
8.
go back to reference Damschroder, L. J., Baron, J., Hershey, J. C., et al. (2004). The validity of person tradeoff measurements: Randomized trial of computer elicitation versus face-to-face interview. Medical Decision Making, 24(2), 170–180.CrossRefPubMed Damschroder, L. J., Baron, J., Hershey, J. C., et al. (2004). The validity of person tradeoff measurements: Randomized trial of computer elicitation versus face-to-face interview. Medical Decision Making, 24(2), 170–180.CrossRefPubMed
9.
go back to reference Dolan, P. (1996). Modelling valuations for health states: The effect of duration. Health Policy, 38(3), 189–203.CrossRefPubMed Dolan, P. (1996). Modelling valuations for health states: The effect of duration. Health Policy, 38(3), 189–203.CrossRefPubMed
10.
go back to reference Tsuchiya, A., Ikeda, S., Ikegami, N., et al. (2002). Estimating an EQ-5D population value set: The case of Japan. Health Economics, 11(4), 341–353.CrossRefPubMed Tsuchiya, A., Ikeda, S., Ikegami, N., et al. (2002). Estimating an EQ-5D population value set: The case of Japan. Health Economics, 11(4), 341–353.CrossRefPubMed
11.
go back to reference Bowling, A. (2005). Mode of questionnaire administration can have serious effects on data quality. Journal of Public Health (Oxford), 27(3), 281–291.CrossRef Bowling, A. (2005). Mode of questionnaire administration can have serious effects on data quality. Journal of Public Health (Oxford), 27(3), 281–291.CrossRef
12.
go back to reference Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008). Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value in Health, 11(2), 322–333.CrossRefPubMed Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008). Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: A meta-analytic review. Value in Health, 11(2), 322–333.CrossRefPubMed
13.
go back to reference Dolan, P., Gudex, C., Kind, P., et al. (1996). The time trade-off method: Results from a general population study. Health Economics, 5(2), 141–154.CrossRefPubMed Dolan, P., Gudex, C., Kind, P., et al. (1996). The time trade-off method: Results from a general population study. Health Economics, 5(2), 141–154.CrossRefPubMed
14.
go back to reference Hochberg, Y. (1988). A sharper bonferroni procedure for multiple tests of significance. Biometrika, 75(4), 800–802.CrossRef Hochberg, Y. (1988). A sharper bonferroni procedure for multiple tests of significance. Biometrika, 75(4), 800–802.CrossRef
15.
go back to reference Badia, X., Roset, M., Herdman, M., et al. (2001). A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states. Medical Decision Making, 21(1), 7–16.CrossRefPubMed Badia, X., Roset, M., Herdman, M., et al. (2001). A comparison of United Kingdom and Spanish general population time trade-off values for EQ-5D health states. Medical Decision Making, 21(1), 7–16.CrossRefPubMed
16.
go back to reference Chow, G. C. (1960). Tests of equality between sets of coefficients in two linear regressions. Econometrica, 28(3), 591–605.CrossRef Chow, G. C. (1960). Tests of equality between sets of coefficients in two linear regressions. Econometrica, 28(3), 591–605.CrossRef
17.
go back to reference Pickard, A. S., Neary, M. P., & Cella, D. (2007). Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health and Quality of Life Outcomes, 5(70). Pickard, A. S., Neary, M. P., & Cella, D. (2007). Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer. Health and Quality of Life Outcomes, 5(70).
18.
go back to reference Roberts, J., & Dolan, P. (2004). To what extent do people prefer health states with higher values? A note on evidence from the EQ-5D valuation set. Health Economics, 13(7), 733–737.CrossRefPubMed Roberts, J., & Dolan, P. (2004). To what extent do people prefer health states with higher values? A note on evidence from the EQ-5D valuation set. Health Economics, 13(7), 733–737.CrossRefPubMed
19.
go back to reference Johnson, F. R., Ozdemir, S., & Hauber, A. B. (2007). Motivating out-of-pocket treatment costs with cheap talk. iHEA 2007 6th World Congress. Copenhagen. Johnson, F. R., Ozdemir, S., & Hauber, A. B. (2007). Motivating out-of-pocket treatment costs with cheap talk. iHEA 2007 6th World Congress. Copenhagen.
20.
go back to reference Smith, D. M., Schwarz, N., Roberts, T. R., et al. (2006). Why are you calling me? How study introductions change response patterns. Quality of Life Research, 15(4), 621–630.CrossRefPubMed Smith, D. M., Schwarz, N., Roberts, T. R., et al. (2006). Why are you calling me? How study introductions change response patterns. Quality of Life Research, 15(4), 621–630.CrossRefPubMed
Metagegevens
Titel
Does mode of administration matter? Comparison of online and face-to-face administration of a time trade-off task
Auteurs
Richard Norman
Madeleine T. King
Dushyant Clarke
Rosalie Viney
Paula Cronin
Deborah Street
Publicatiedatum
01-05-2010
Uitgeverij
Springer Netherlands
Gepubliceerd in
Quality of Life Research / Uitgave 4/2010
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-010-9609-5

Andere artikelen Uitgave 4/2010

Quality of Life Research 4/2010 Naar de uitgave