Skip to main content
Top
Gepubliceerd in: Quality of Life Research 6/2014

01-08-2014

Anchoring vignettes for health comparisons: an analysis of response consistency

Auteurs: Nicole Au, Paula K. Lorgelly

Gepubliceerd in: Quality of Life Research | Uitgave 6/2014

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Self-rated health (SRH) is widely used to measure and compare the health status of different groups of individuals. However, SRH can suffer from heterogeneity in reporting styles, making health comparisons problematic. Anchoring vignettes is a promising technique for improving inter-group comparisons of SRH. A key identifying assumption of the approach is response consistency—that respondents rate themselves using the same underlying response scale that they rate the vignettes. Despite growing research into response consistency, it remains unclear how respondents rate vignettes and why respondents may not assess vignettes and themselves consistently.

Method

Vignettes for the EQ-5D-5L were developed and included in an online survey. In-depth interviews were conducted with participants following survey completion. Response consistency was examined through qualitative analysis of the interview responses and quantitative coding of participants’ thought processes.

Results

Our analysis showed that anchoring vignettes for the EQ-5D-5L is feasible, but that response consistency may not hold for some participants. Respondents are more likely to rate their own health and vignettes in the same way if presented with overall health state vignettes than single health dimension vignettes, and if they imagined themselves in the health state of the hypothetical individual.

Conclusion

This research highlights opportunities to improve the design of anchoring vignettes in order to enhance response consistency. It additionally provides new evidence on the feasibility of employing anchoring vignettes for the EQ-5D-5L, which is promising for future work to address reporting heterogeneity in the EQ-5D-5L.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Voetnoten
1
We focus on the issue of DIF in cross-population comparisons, but we note that it is also possible for DIF to occur within individuals, for example if patients change their point of reference over time when rating their own health [30].
 
2
A second key assumption is Vignette equivalence—that each vignette is perceived by all respondents as the same underlying level.
 
Literatuur
1.
go back to reference Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.PubMedCrossRef Idler, E. L., & Benyamini, Y. (1997). Self-rated health and mortality: A review of twenty-seven community studies. Journal of Health and Social Behavior, 38(1), 21–37.PubMedCrossRef
2.
go back to reference Gold, M., Franks, P., & Erickson, P. (1996). Assessing the health of the nation: The predictive validity of a preference-based measure and self-rated health. Medical Care, 34(2), 163–177.PubMedCrossRef Gold, M., Franks, P., & Erickson, P. (1996). Assessing the health of the nation: The predictive validity of a preference-based measure and self-rated health. Medical Care, 34(2), 163–177.PubMedCrossRef
3.
go back to reference Clarke, P. M., Hayes, A. J., Glasziou, P. G., Scott, R., Simes, J., & Keech, A. C. (2009). Using the EQ-5D index score as a predictor of outcomes in patients with type 2 diabetes. Medical Care, 47(1), 61–68.PubMedCrossRef Clarke, P. M., Hayes, A. J., Glasziou, P. G., Scott, R., Simes, J., & Keech, A. C. (2009). Using the EQ-5D index score as a predictor of outcomes in patients with type 2 diabetes. Medical Care, 47(1), 61–68.PubMedCrossRef
4.
go back to reference Rabin, R., & Charro, F. D. (2001). EQ-SD: A measure of health status from the EuroQol Group. Annals of Medicine, 33(5), 337–343.PubMedCrossRef Rabin, R., & Charro, F. D. (2001). EQ-SD: A measure of health status from the EuroQol Group. Annals of Medicine, 33(5), 337–343.PubMedCrossRef
5.
go back to reference McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges 1. Annual Review of Public Health, 20(1), 309–335.PubMedCrossRef McHorney, C. A. (1999). Health status assessment methods for adults: Past accomplishments and future challenges 1. Annual Review of Public Health, 20(1), 309–335.PubMedCrossRef
6.
go back to reference Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. British Medical Journal (BMJ), 322(7297), 1297.CrossRef Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. British Medical Journal (BMJ), 322(7297), 1297.CrossRef
8.
go back to reference Devlin, N. J., Parkin, D., & Browne, J. (2010). Patient reported outcome measures in the NHS: New methods for analysing and reporting EQ 5D data. Health Economics, 19(8), 886–905.PubMedCrossRef Devlin, N. J., Parkin, D., & Browne, J. (2010). Patient reported outcome measures in the NHS: New methods for analysing and reporting EQ 5D data. Health Economics, 19(8), 886–905.PubMedCrossRef
10.
11.
go back to reference Euroqol Group. (1990). EuroQol-a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208.CrossRef Euroqol Group. (1990). EuroQol-a new facility for the measurement of health-related quality of life. Health Policy, 16(3), 199–208.CrossRef
12.
go back to reference Murray, C. J. L., Tandon, A., Salomon, J. A., Mathers, C. D., & Sadana, R. (2002). Cross-population comparability of evidence for health policy. GPE Discussion Paper No. 46. Geneva: WHO/EIP. Murray, C. J. L., Tandon, A., Salomon, J. A., Mathers, C. D., & Sadana, R. (2002). Cross-population comparability of evidence for health policy. GPE Discussion Paper No. 46. Geneva: WHO/EIP.
13.
go back to reference Kaplan, G., & Baron-Epel, O. (2003). What lies behind the subjective evaluation of health status? Social Science and Medicine, 56(8), 1669–1676.PubMedCrossRef Kaplan, G., & Baron-Epel, O. (2003). What lies behind the subjective evaluation of health status? Social Science and Medicine, 56(8), 1669–1676.PubMedCrossRef
16.
go back to reference Lindeboom, M., & Van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics, 23(6), 1083–1099.PubMedCrossRef Lindeboom, M., & Van Doorslaer, E. (2004). Cut-point shift and index shift in self-reported health. Journal of Health Economics, 23(6), 1083–1099.PubMedCrossRef
17.
go back to reference Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of health economics, 19(3), 403–420.PubMedCrossRef Groot, W. (2000). Adaptation and scale of reference bias in self-assessments of quality of life. Journal of health economics, 19(3), 403–420.PubMedCrossRef
18.
go back to reference Baron-Epel, O., Kaplan, G., Haviv-Messika, A., Tarabeia, J., Green, M. S., & Nitzan Kaluski, D. (2005). Self-reported health as a cultural health determinant in Arab and Jewish Israelis: MABAT—National Health and Nutrition Survey 1999–2001. Social Science and Medicine, 61(6), 1256–1266.PubMedCrossRef Baron-Epel, O., Kaplan, G., Haviv-Messika, A., Tarabeia, J., Green, M. S., & Nitzan Kaluski, D. (2005). Self-reported health as a cultural health determinant in Arab and Jewish Israelis: MABAT—National Health and Nutrition Survey 1999–2001. Social Science and Medicine, 61(6), 1256–1266.PubMedCrossRef
19.
go back to reference Wiseman, V. L. (1999). Culture, self-rated health and resource allocation decision-making. Health Care Analysis, 7(3), 207–223.PubMedCrossRef Wiseman, V. L. (1999). Culture, self-rated health and resource allocation decision-making. Health Care Analysis, 7(3), 207–223.PubMedCrossRef
20.
go back to reference Kerkhofs, M., & Lindeboom, M. (1995). Subjective health measures and state dependent reporting errors. Health Economics, 4(3), 221–235.PubMedCrossRef Kerkhofs, M., & Lindeboom, M. (1995). Subjective health measures and state dependent reporting errors. Health Economics, 4(3), 221–235.PubMedCrossRef
21.
go back to reference Sadana, R., Mathers, C. D., Lopez, A. D., Murray, C. J. L., & Iburg, K. (2000). Comparative analyses of more than 50 household surveys on health status. GPE Discussion Paper No. 15. Geneva: World Health Organization. Sadana, R., Mathers, C. D., Lopez, A. D., Murray, C. J. L., & Iburg, K. (2000). Comparative analyses of more than 50 household surveys on health status. GPE Discussion Paper No. 15. Geneva: World Health Organization.
22.
go back to reference Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: The issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.PubMedCrossRef Shmueli, A. (2003). Socio-economic and demographic variation in health and in its measures: The issue of reporting heterogeneity. Social Science and Medicine, 57(1), 125–134.PubMedCrossRef
24.
go back to reference Humphries, K. H., & Van Doorslaer, E. (2000). Income-related health inequality in Canada. Social Science and Medicine, 50(5), 663–671.PubMedCrossRef Humphries, K. H., & Van Doorslaer, E. (2000). Income-related health inequality in Canada. Social Science and Medicine, 50(5), 663–671.PubMedCrossRef
27.
go back to reference Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale NJ: Lawrence Erlbaum. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale NJ: Lawrence Erlbaum.
28.
go back to reference King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 98(01), 191–207.CrossRef
29.
go back to reference Shmueli, A. (2002). Reporting heterogeneity in the measurement of health and health-related quality of life. Pharmacoeconomics, 20(6), 405–412.PubMedCrossRef Shmueli, A. (2002). Reporting heterogeneity in the measurement of health and health-related quality of life. Pharmacoeconomics, 20(6), 405–412.PubMedCrossRef
31.
go back to reference Baker, M., Stabile, M., & Deri, C. (2004). What do self-reported, objective, measures of health measure? Journal of Human Resources, 39(4), 1067–1093.CrossRef Baker, M., Stabile, M., & Deri, C. (2004). What do self-reported, objective, measures of health measure? Journal of Human Resources, 39(4), 1067–1093.CrossRef
32.
go back to reference Kapteyn, A., Smith, J. P., & Van Soest, A. (2007). Vignettes and self-reports of work disability in the United States and the Netherlands. The American Economic Review, 97(1), 461–473.CrossRef Kapteyn, A., Smith, J. P., & Van Soest, A. (2007). Vignettes and self-reports of work disability in the United States and the Netherlands. The American Economic Review, 97(1), 461–473.CrossRef
33.
go back to reference Kapteyn, A., Smith, J., & Van Soest, A. (2011). Are Americans really less happy with their incomes? RAND Working Paper Series WR-858. Kapteyn, A., Smith, J., & Van Soest, A. (2011). Are Americans really less happy with their incomes? RAND Working Paper Series WR-858.
34.
go back to reference Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social Behavior, 52(2), 246.PubMedCentralPubMedCrossRef Grol-Prokopczyk, H., Freese, J., & Hauser, R. M. (2011). Using anchoring vignettes to assess group differences in general self-rated health. Journal of Health and Social Behavior, 52(2), 246.PubMedCentralPubMedCrossRef
35.
go back to reference Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? [Article]. Health Economics, 17(3), 351–375. doi:10.1002/hec.1269.PubMedCrossRef Bago D’Uva, T., Van Doorslaer, E., Lindeboom, M., & O’Donnell, O. (2008). Does reporting heterogeneity bias the measurement of health disparities? [Article]. Health Economics, 17(3), 351–375. doi:10.​1002/​hec.​1269.PubMedCrossRef
36.
go back to reference Salomon, J. A., Tandon, A., & Murray, C. J. L. (2004). Comparability of self rated health: Cross sectional multi-country survey using anchoring vignettes. British Medical Journal, 328(7434), 258.PubMedCentralPubMedCrossRef Salomon, J. A., Tandon, A., & Murray, C. J. L. (2004). Comparability of self rated health: Cross sectional multi-country survey using anchoring vignettes. British Medical Journal, 328(7434), 258.PubMedCentralPubMedCrossRef
38.
go back to reference Bago d’Uva, T., Lindeboom, M., O’Donnell, O., & van Doorslaer, E. (2011). Slipping anchor? Testing the vignettes approach to identification and correction of reporting heterogeneity. Journal of Human Resources, 46(4), 875–906.CrossRef Bago d’Uva, T., Lindeboom, M., O’Donnell, O., & van Doorslaer, E. (2011). Slipping anchor? Testing the vignettes approach to identification and correction of reporting heterogeneity. Journal of Human Resources, 46(4), 875–906.CrossRef
39.
go back to reference Van Soest, A., Delaney, L., Harmon, C., Kapteyn, A., & Smith, J. P. (2011). Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions. Journal of the Royal Statistical Society. Series A: Statistics in Society, 174(3), 575–595.PubMedCentralCrossRef Van Soest, A., Delaney, L., Harmon, C., Kapteyn, A., & Smith, J. P. (2011). Validating the use of anchoring vignettes for the correction of response scale differences in subjective questions. Journal of the Royal Statistical Society. Series A: Statistics in Society, 174(3), 575–595.PubMedCentralCrossRef
40.
go back to reference König, H.-H., Bernert, S., Angermeyer, M. C., Matschinger, H., Martinez, M., Vilagut, G., et al. (2009). Comparison of population health status in six European countries: Results of a representative survey using the EQ-5D Questionnaire. Medical Care, 47(2), 255–261. doi:10.1097/MLR.0b013e318184759e.PubMedCrossRef König, H.-H., Bernert, S., Angermeyer, M. C., Matschinger, H., Martinez, M., Vilagut, G., et al. (2009). Comparison of population health status in six European countries: Results of a representative survey using the EQ-5D Questionnaire. Medical Care, 47(2), 255–261. doi:10.​1097/​MLR.​0b013e318184759e​.PubMedCrossRef
41.
go back to reference Lubetkin, E., Jia, H., Franks, P., & Gold, M. (2005). Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: Examining the EQ-5D in the U.S. general population. Quality of Life Research, 14(10), 2187–2196. doi:10.1007/s11136-005-8028-5.PubMedCrossRef Lubetkin, E., Jia, H., Franks, P., & Gold, M. (2005). Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: Examining the EQ-5D in the U.S. general population. Quality of Life Research, 14(10), 2187–2196. doi:10.​1007/​s11136-005-8028-5.PubMedCrossRef
42.
go back to reference Sun, S., Chen, J., Johannesson, M., Kind, P., Xu, L., Zhang, Y., et al. (2011). Population health status in China: EQ-5D results, by age, sex and socio-economic status, from the National Health Services Survey 2008. Quality of Life Research, 20(3), 309–320.PubMedCentralPubMedCrossRef Sun, S., Chen, J., Johannesson, M., Kind, P., Xu, L., Zhang, Y., et al. (2011). Population health status in China: EQ-5D results, by age, sex and socio-economic status, from the National Health Services Survey 2008. Quality of Life Research, 20(3), 309–320.PubMedCentralPubMedCrossRef
43.
go back to reference Maheswaran, H., Petrou, S., Rees, K., & Stranges, S. (2012). Estimating EQ-5D utility values for major health behavioural risk factors in England. Journal of Epidemiology and Community Health, 67(2), 172–180. doi:10.1136/jech-2012-201019.PubMedCrossRef Maheswaran, H., Petrou, S., Rees, K., & Stranges, S. (2012). Estimating EQ-5D utility values for major health behavioural risk factors in England. Journal of Epidemiology and Community Health, 67(2), 172–180. doi:10.​1136/​jech-2012-201019.PubMedCrossRef
44.
go back to reference Søltoft, F., Hammer, M., & Kragh, N. (2009). The association of body mass index and health-related quality of life in the general population: Data from the 2003 Health Survey of England. Quality of Life Research, 18(10), 1293–1299.PubMedCentralPubMedCrossRef Søltoft, F., Hammer, M., & Kragh, N. (2009). The association of body mass index and health-related quality of life in the general population: Data from the 2003 Health Survey of England. Quality of Life Research, 18(10), 1293–1299.PubMedCentralPubMedCrossRef
47.
go back to reference Marmot, M., Banks, J., Blundell, R., Lessof, C., & Nazroo, J. (2003). Health, wealth and lifestyles of the older population in England: ELSA 2002. London: Institute for Fiscal Studies. Marmot, M., Banks, J., Blundell, R., Lessof, C., & Nazroo, J. (2003). Health, wealth and lifestyles of the older population in England: ELSA 2002. London: Institute for Fiscal Studies.
48.
go back to reference Börsch-Supan, A., Hank, K., & Jürges, H. (2005). A new comprehensive and international view on ageing: Introducing the ‘Survey of Health, Ageing and Retirement in Europe’. European Journal of Ageing, 2(4), 245–253.CrossRef Börsch-Supan, A., Hank, K., & Jürges, H. (2005). A new comprehensive and international view on ageing: Introducing the ‘Survey of Health, Ageing and Retirement in Europe’. European Journal of Ageing, 2(4), 245–253.CrossRef
Metagegevens
Titel
Anchoring vignettes for health comparisons: an analysis of response consistency
Auteurs
Nicole Au
Paula K. Lorgelly
Publicatiedatum
01-08-2014
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 6/2014
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-013-0615-2

Andere artikelen Uitgave 6/2014

Quality of Life Research 6/2014 Naar de uitgave