Abstract
The objective of this article was to review the methods used to obtain quality-of-life (utility) weights reported in assessments carried out for the National Institute for Health and Clinical Excellence (NICE).
The design of the review was a cross-sectional survey. Health technology assessment (HTA) reports published on the NICE website up to May 2003 were reviewed. Data were extracted on the following: the approach to utility estimation (direct or indirect), how health states were described for indirect estimation, valuation techniques used (standard gamble [SG], time trade-off [TTO], visual analogue scale [VAS], etc.), whether uncertainty in utility estimates was explored in cost-utility analyses, and whether utility values were identified as a priority for further research by assessment authors.
Fifty-six assessments were reviewed, of which 28 reported 45 cost-utility analyses. There was striking variation in the values used to describe different health states. Data from patients were used in 15 (33%) analyses, from the general public in 10 (22%) and from clinicians in 4 (9%). In 16 (36%) cases, the source for utility estimates was unclear. Health states were described using a range of generic and disease-specific measures, although the EQ-5D was used most frequently. In 25 analyses (56%), the valuation technique used was not reported. TTO was used in 11 (24%), SG in 3 (7%), magnitude estimation in 5 (11%) and VAS in 1 (2%). Sensitivity analyses based on utility values were reported in 25 cases (56%), more commonly in reports of analyses carried out by independent teams than technology sponsors although this may be subject to reporting bias. Further research into quality of life was recommended in 17 (61%) of the 28 assessment reports that contained at least one cost-utility analysis.
Greater transparency and consistency are required in reporting the methods used to obtain quality-of-life weights in cost-utility analyses, and better sources of data are required. Methodological variation results in important differences in values. Therefore, caution must be exercised when comparing the results of different cost-utility analyses.
Similar content being viewed by others
References
National Institute for Clinical Excellence (NICE). Guide to the methods of technology appraisal. London: NICE, 2003
Warren E, Weatherley-Jones E, Chilcott J, et al. The clinical and cost-effectiveness of long-acting insulin analogue, insulin glargine. Sheffield: School of Health and Related Research, 2002
Kaltenthaler E, Shackley P, Stevens K, et al. Computerised cognitive behaviour therapy for depression and anxiety. Sheffield: ScHARR Rapid Reviews Group, School of Health and Related Research, University of Sheffield, 2002
Vale L, Wyness L, McCormack K, et al. Systematic review of the effectiveness and cost effectiveness of metal on metal hip resurfacing for treatment of hip disease. Aberdeen: Health Services Research Unit, University of Aberdeen, 2001
Jobanputra P, Barton P, Bryan S, et al. The clinical effectiveness and cost-effectiveness of new drug treatments for rheumatoid arthritis: etanercept and infliximab. Birmingham: West Midlands Development and Evaluation Service, University of Birmingham, 2001 Sep 3
Stewart A, Sandercock J, Bryan S, et al. The clinical effectiveness and cost-effectiveness of riluzole for motor neurone disease. Birmingham: West Midlands Development and Evaluation Service, 2000 Aug 1
Turner D, Wailoo A, Nicholson K, et al. Systematic review and economic decision modelling for the prevention and treatment of influenza A and B. Leicester: University of Leicester/ScHARR, University of Sheffield, 2002 Apr 29
Clark W, Burls A, Song F, et al. Infliximab for the treatment of Crohn’s disease. Birmingham: West Midlands Development and Evaluation Service, University of Birmingham, 2001 Jul 10
Thomas S, Prince A, Humphries C, et al. Assessment of interferon-beta and glatiramer for the treatment of multiple sclerosis. Newcastle upon Tyne: Regional Drug and Therapeutics Centre, 2000
Bagnall A-M, Jones L, Ginnelly L, et al. A rapid and systematic review of atypical antipsychotics in schizophrenia. York: NHS Centre for Reviews and Dissemination, 2001 Sep 21
Wake B, Bryan S, Barton P, et al. Rituximab as third line treatment for refractory or recurrent stage III or IV follicular non-Hodgkin’s lymphoma. Birmingham: Department of Public Health and Epidemiology, University of Birmingham, 2001 Jan 1
Lloyd Jones M, Hummel S, Bansback N. A review of the evidence for the clinical and cost-effectiveness of irinotecan, oxaliplatin and raltitrexed for the treatment of advanced colorectal cancer. Sheffield: The University of Sheffield School of Health and Related Research, 2001 Jan 15
Shepherd J, Waugh N, Hewitson P. Combination therapy (interferon alfa and ribavirin) in the treatment of chronic hepatitis C. Southampton: Wessex Institute for Health Research & Development, 2000
Cody J, Wyness L, Wallace S, et al. Systematic review of the clinical effectiveness and cost-effectiveness of tension-free vaginal tape (TVT) for treatment of urinary stress incontinence. Aberdeen: Health Services Research Unit, 2002 Aug 12
Kind P, Hardman G, Macran S. UK population norms for EQ-5D [CHE discussion paper 172]. York: University of York, 1999
Cummins C, Connock M, Fry-Smith A, et al. A rapid review of new drug treatments for juvenile idiopathic arthritis: etanercept. Birmingham: West Midlands Development and Evaluation Service, University of Birmingham, 2001 Jun 8
Dinnes J, Cave C, Hunag S, et al. The effectiveness and cost-effectiveness of temozolomide for the treatment of recurrent malignant glioma. Southampton: Wessex Institute for Health Research and Development, University of Southampton, 2000 Nov 27
Parkes J, Bryant J, Milne R. Arrhythmias: implantable cardioverter defibrillators. Southampton: National Coordinating Centre for Health Technology Assessments (NCCHTA), University of Southampton, 2000 Nov 9
Rosser R, Cottee M, Rabin R, et al. Index of health related quality of life. In: Hopkins A, editor. Measures of the quality of life and the uses to which such measures may be put. London: Royal College of Physicians, 1992
O’Meara S, Riemsma R, Shirran L, et al. A systematic review of the clinical effectiveness and cost-effectiveness of sibutramine in the management of obesity. York: NHS Centre for Reviews and Dissemination, University of York, 2000 Dec 7
Brazier J, Usherwood T, Harper R, et al. Deriving a preference-based single index from the UK SF-36 Health Survey. J Clin Epidemiol 1998; 51: 1115–28
Deverill M, Brazier J, Green C, et al. The use of QALY and non-QALY measures of health-related quality of life. Pharmacoeconomics 1998; 13: 411–20
Hawthorne G. The effect of different methods of collecting data: mail, telephone and filter data collection issues in utility measurement. Quality 2000; 12: 1081–8
Brooks R. EuroQol: the current state of play. Health Policy 1996; 37: 53–72
Brazier J, Deverill M, Green C, et al. A review of the use of health status measures in economic evaluation. Health Technol Assess 1999; 3(9): i–iv, 1-164
Burls A, Clark W, Stewart T, et al. Zanamivir for the treatment of influenza in adults. Birmingham: West Midlands Development and Evaluation Service, University of Birmingham, 2000 Jun 30
Dolan P, Gudex C, Kind P, et al. The time trade-off method: results from a general population study. Health Econ 1996; 5: 141–54
Ubel PA, Loewenstein G, Jepson C. Whose quality of life? A commentary exploring discrepancies between health state evaluations of patients and the general public. Qual Life Res 2003; 12: 599–607
Boland A, Bagust A, Hill R, et al. Early thrombolysis for the treatment of acute myocardial infarction. Liverpool: Liverpool Reviews and Implementation Group, 2002 Apr 11
The National Institute for Clinical Excellence (NICE) Appraisal Team. The clinical effectiveness and cost effectiveness of celecoxib, rofecoxib, meloxicam and etodolac (COX-II inhibitors) for rheumatoid arthritis and osteoarthritis. London: NICE, 2000 Nov 1
Gold MR, Siegel JE, Russell LB, et al. Cost-effectiveness in health and medicine. Oxford: Oxford University Press, 1996
Dolan P. Valuing health-related quality of life: issues and controversies. Pharmacoeconomics 1998; 15: 119–27
Rosser R, Kind P. A scale of valuations of states of illness: is there a social consensus? Int J Epidemiol 1978; 7: 347–58
Neumann PJ, Zinner DE, Wright JC. Are methods for estimating QALYs in cost-effectiveness analyses improving? Med Decis Making 1997; 17: 402–8
Drummond M, O’Brien B, Stoddart G, et al. Methods for the economic evaluation of health care programmes. 2nd ed. Oxford: Oxford University Press, 1997
Stalmeier PFM, Goldstein MK, Holmes AM, et al. What should be reported in a methods section on utility assessment? Med Decis Making 2001; 21: 200–7
Acknowledgements
Contributions:
Ken Stein conceived the study, wrote the protocol, checked data extraction, drafted the report and is guarantor. Alison Fry contributed to the protocol, collected data and helped to draft the report. Ali Round contributed to the protocol and helped to draft the report. John Brazier contributed to the protocol and helped to draft the report. Ruairidh Milne contributed to the protocol and helped to draft the report. The authors are grateful to Joanne Perry for help in preparation of the manuscript.
Statement of competing interests:
Ken Stein and John Brazier hold grants from the NHS HTA Programme to produce HTAs on behalf of national policy makers, including NICE.
Ken Stein, John Brazier, Ruairidh Milne and Ali Round have contributed to HTA reports submitted to NICE.
John Brazier has been a member of a NICE Appraisal Committee and Ken Stein and Ruairidh Milne are members.
Ken Stein and Alison Fry’s involvement in this study was supported by a grant from NHS R&D with co-funding from the NICE and NHS Quality Improvement Scotland.
The views expressed are those of the authors and are not necessarily those of the funding bodies.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
See table AI.
Rights and permissions
About this article
Cite this article
Stein, K., Fry, A., Round, A. et al. What value health?. Appl Health Econ Health Policy 4, 219–228 (2005). https://doi.org/10.2165/00148365-200504040-00004
Published:
Issue Date:
DOI: https://doi.org/10.2165/00148365-200504040-00004