Skip to main content

Advertisement

Log in

Patient-Reported Outcomes: Understanding Surgical Efficacy and Quality from the Patient’s Perspective

  • Health Services Research and Global Oncology
  • Published:
Annals of Surgical Oncology Aims and scope Submit manuscript

Abstract

In surgery, quality assessment encourages improved care delivery, better outcomes, and helps determine surgical efficacy. Quality is important from a patient, provider, payer, and policy maker standpoint. However, given the growth of outpatient procedures, expansion of surgical indications to enhance function, and the decline of perioperative morbidity and mortality, many traditional quality metrics, such as mortality, readmissions, and complications, may not fully capture quality. As such, patient-reported outcomes (PROs) can be used to complement the established clinical outcomes and describe surgical efficacy and quality from the patient’s point of view. Generic and disease-specific PRO measures capture health-related quality of life, functional status, and pain. These measures permit a more holistic understanding of how surgery affects different aspects of a patient’s health, augment other clinical outcomes, and are commonly used to determine efficacy in clinical trials. Moreover, our national reimbursement structure is currently evolving to include PROs for certain surgical conditions in measures of quality and with direct linkage to payments. Even so, there continues to be challenges in the implementation of PRO measures in everyday surgical practice, with questions of optimal administration and how to integrate these measures into provider work flow. Despite these challenges, PROs provide vital information regarding surgical efficacy and quality and are critical in the delivery of patient-centered care.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

References

  1. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. Washington, DC: The National Academies Press; 2001.

    Google Scholar 

  2. Centers of Medicare and Medicaid. Quality payment program. 2016. https://qpp.cms.gov. Accessed 25 Feb 2019.

  3. Waljee JF, Ghaferi A, Finks JF, et al. Variation in patient-reported outcomes across hospitals following surgery. Med Care. 2015;53(11):960–966.

    PubMed  Google Scholar 

  4. Birkmeyer JD. Progress and challenges in improving surgical outcomes. Br J Surg. 2012;99(11):1467–1469.

    CAS  PubMed  Google Scholar 

  5. Ibrahim AM, Dimick JB. What metrics accurately reflect surgical quality? Annu Rev Med. 2018;69:481–491.

    CAS  PubMed  Google Scholar 

  6. Waljee JF, Ghaferi A, Cassidy R, et al. Are patient-reported outcomes correlated with clinical outcomes after surgery? A population-based study. Ann Surg. 2016;264(4):682–689.

    PubMed  Google Scholar 

  7. Birkmeyer JD, Dimick JB, Birkmeyer NJ. Measuring the quality of surgical care: structure, process, or outcomes? J Am Coll Surg. 2004;198(4):626–632.

    PubMed  Google Scholar 

  8. Rolfson O, Rothwell A, Sedrakyan A, et al. Use of patient-reported outcomes in the context of different levels of data. J Bone Joint Surg Am. 2011;93(Suppl 3):66–71.

    PubMed  PubMed Central  Google Scholar 

  9. Pucciarelli S, Del Bianco P, Toppan P, et al. Health-related quality of life outcomes in disease-free survivors of mid-low rectal cancer after curative surgery. Ann Surg Oncol. 2008;15(7):1846–1854.

    PubMed  Google Scholar 

  10. Wu AW, Snyder C, Clancy CM, Steinwachs DM. Adding the patient perspective to comparative effectiveness research. Health Aff (Millwood). 2010;29(10):1863–1871.

    PubMed  Google Scholar 

  11. Keszei AP, Novak M, Streiner DL. Introduction to health measurement scales. J Psychosom Res. 2010;68(4):319–323.

    PubMed  Google Scholar 

  12. Resnick B, Nahm ES. Reliability and validity testing of the revised 12-item short-form health survey in older adults. J Nurs Meas. 2001;9(2):151–161.

    CAS  PubMed  Google Scholar 

  13. Ware J Jr, Kosinski M, Keller SD. A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity. Med Care. 1996;34(3):220–233.

    PubMed  Google Scholar 

  14. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Medical Care. 1992;30(6):473–483.

    PubMed  Google Scholar 

  15. Weinberger M, Samsa GP, Hanlon JT, et al. An evaluation of a brief health status measure in elderly veterans. J Am Geriatr Soc. 1991;39(7):691–694.

    CAS  PubMed  Google Scholar 

  16. Singleton N, Turner A. Measuring patients’ views of their health. SF 36 is suitable for elderly patients. BMJ. 1993;307(6896):126–127.

    CAS  PubMed  PubMed Central  Google Scholar 

  17. Nerenz DR, Repasky DP, Whitehouse FW, Kahkonen DM. Ongoing assessment of health status in patients with diabetes mellitus. Med Care. 1992;30(5 Suppl):MS112–124.

    Google Scholar 

  18. Mahler DA, Mackowiak JI. Evaluation of the short-form 36-item questionnaire to measure health-related quality of life in patients with COPD. Chest. 1995;107(6):1585–1589.

    CAS  PubMed  Google Scholar 

  19. Kantz ME, Harris WJ, Levitsky K, Ware JE, Jr., Davies AR. Methods for assessing condition-specific and generic functional status outcomes after total knee replacement. Med Care. 1992;30(5 Suppl):MS240–252.

    CAS  PubMed  Google Scholar 

  20. Lacey KO, Meier GH, Krumholz HM, Gusberg RJ. Outcomes after major vascular surgery: the patients’ perspective. J Vasc Nurs. 1995;13(1):8–13.

    CAS  PubMed  Google Scholar 

  21. McCarthy MJ Jr, Shroyer AL, Sethi GK, et al. Self-report measures for assessing treatment outcomes in cardiac surgery patients. Med Care. 1995;33(10 Suppl):OS76–85.

    PubMed  Google Scholar 

  22. Anderson C, Laubscher S, Burns R. Validation of the Short Form 36 (SF-36) health survey questionnaire among stroke patients. Stroke. 1996;27(10):1812–1816.

    CAS  PubMed  Google Scholar 

  23. Bullinger M. German translation and psychometric testing of the SF-36 Health Survey: preliminary results from the IQOLA Project. International Quality of Life Assessment. Soc Sci Med. 1995;41(10):1359–1366.

    CAS  PubMed  Google Scholar 

  24. Perneger TV, Leplege A, Etter JF, Rougemont A. Validation of a French-language version of the MOS 36-Item Short Form Health Survey (SF-36) in young healthy adults. J Clin Epidemiol. 1995;48(8):1051–1060.

    CAS  PubMed  Google Scholar 

  25. Nguyen TH, Han HR, Kim MT, Chan KS. An introduction to item response theory for patient-reported outcome measurement. Patient. 2014;7(1):23–35.

    PubMed  PubMed Central  Google Scholar 

  26. Hambleton RK, Swaminathan H, Rogers WH. Fundamentals of item response theory. Newbury Park, CA: Sage Publications; 1991.

    Google Scholar 

  27. National Institute of Health. PROMIS. Dynamic tools to measure health outcomes from the patient perspective. Instrument overview. 2011. http://www.nihpromis.org/measures/instrumentoverview. Accessed 19 Feb 2019.

  28. Gonin R, Lloyd S, Cella D, Gray G. Establishing equivalence between scaled measures of quality of life. Qual Life Res. 1996;5(1):20–26.

    CAS  PubMed  Google Scholar 

  29. Cella D, Gershon R, Lai JS, Choi S. The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res. 2007;16(Suppl 1):133–141.

    PubMed  Google Scholar 

  30. Ranganathan K, Vercler CJ, Warschausky SA, MacEachern MP, Buchman SR, Waljee JF. Comparative effectiveness studies examining patient-reported outcomes among children with cleft lip and/or palate: a systematic review. Plast Reconstr Surg. 2015;135(1):198–211.

    CAS  PubMed  Google Scholar 

  31. Aaronson NK, Ahmedzai S, Bergman B, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–376.

    CAS  PubMed  Google Scholar 

  32. Cella DF, Tulsky DS, Gray G, et al. The functional assessment of cancer therapy scale: development and validation of the general measure. J Clin Oncol. 1993;11(3):570–579.

    CAS  Google Scholar 

  33. Chung KC, Hamill JB, Walters MR, Hayward RA. The Michigan hand outcomes questionnaire (MHQ): assessment of responsiveness to clinical change. Ann Plast Surg. 1999;42(6):619–622.

    CAS  PubMed  Google Scholar 

  34. Chung KC, Pillsbury MS, Walters MR, Hayward RA. Reliability and validity testing of the Michigan Hand Outcomes Questionnaire. J Hand Surg Am. 1998;23(4):575–587.

    CAS  PubMed  Google Scholar 

  35. Waljee JF, Dimick JB. Do patient-reported outcomes correlate with clinical outcomes following surgery? Adv Surg. 2017;51(1):141–150.

    PubMed  Google Scholar 

  36. Montazeri A. Quality of life data as prognostic indicators of survival in cancer patients: an overview of the literature from 1982 to 2008. Health Qual Life Outcomes. 2009;7:102.

    PubMed  PubMed Central  Google Scholar 

  37. Sharma A, Walker LG, Monson JR. Baseline quality of life factors predict long term survival after elective resection for colorectal cancer. Int J Surg Oncol. 2013;2013:269510.

    PubMed  PubMed Central  Google Scholar 

  38. Basch E, Deal AM, Dueck AC, et al. Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA. 2017;318(2):197–198.

    PubMed  PubMed Central  Google Scholar 

  39. Saxton A, Velanovich V. Preoperative frailty and quality of life as predictors of postoperative complications. Ann Surg. 2011;253(6):1223–1229.

    Google Scholar 

  40. Brummett CM, Janda AM, Schueller CM, et al. Survey criteria for fibromyalgia independently predict increased postoperative opioid consumption after lower-extremity joint arthroplasty: a prospective, observational cohort study. Anesthesiology. 2013;119(6):1434–1443.

    CAS  PubMed  Google Scholar 

  41. Janda AM, As-Sanie S, Rajala B, et al. Fibromyalgia survey criteria are associated with increased postoperative opioid consumption in women undergoing hysterectomy. Anesthesiology. 2015;122(5):1103–1111.

    CAS  PubMed  Google Scholar 

  42. Harris RE, Clauw DJ, Scott DJ, McLean SA, Gracely RH, Zubieta JK. Decreased central mu-opioid receptor availability in fibromyalgia. J Neurosci. 2007;27(37):10000–10006.

    CAS  PubMed  PubMed Central  Google Scholar 

  43. Fitzcharles MA, Ste-Marie PA, Gamsa A, Ware MA, Shir Y. Opioid use, misuse, and abuse in patients labeled as fibromyalgia. Am J Med. 2011;124(10):955–960.

    PubMed  Google Scholar 

  44. Bingener J, Sloan JA, Novotny PJ, Pockaj BA, Nelson H. Perioperative patient-reported outcomes predict serious postoperative complications: a secondary analysis of the COST trial. J Gastrointest Surg. 2015;19(1):65–71 (discussion 71)

    PubMed  Google Scholar 

  45. Cella D, Traina S, Li T, et al. Relationship between patient-reported outcomes and clinical outcomes in metastatic castration-resistant prostate cancer: post hoc analysis of COU-AA-301 and COU-AA-302. Ann Oncol. 2018;29(2):392–397.

    CAS  PubMed  Google Scholar 

  46. Basch E, Geoghegan C, Coons SJ, et al. Patient-reported outcomes in cancer drug development and US regulatory review: perspectives from industry, the food and drug administration, and the patient. JAMA Oncol. 2015;1(3):375–379.

    PubMed  Google Scholar 

  47. Rock EP, Kennedy DL, Furness MH, Pierce WF, Pazdur R, Burke LB. Patient-reported outcomes supporting anticancer product approvals. J Clin Oncol. 2007;25(32):5094–5099.

    CAS  PubMed  Google Scholar 

  48. Liu JB, Pusic AL, Temple LK, Ko CY. Patient-reported outcomes in surgery: listening to patients improves quality of care. Bull Am Coll Surg. 2017;102(3):19–23.

    PubMed  Google Scholar 

  49. Hamdy FC, Donovan JL, Lane JA, et al. 10-year outcomes after monitoring, surgery, or radiotherapy for localized prostate cancer. N Engl J Med. 2016;375(15):1415–1424.

    PubMed  Google Scholar 

  50. Donovan JL, Hamdy FC, Lane JA, et al. Patient-reported outcomes after monitoring, surgery, or radiotherapy for prostate cancer. N Engl J Med. 2016;375(15):1425–1437.

    CAS  PubMed  PubMed Central  Google Scholar 

  51. Forsth P, Olafsson G, Carlsson T, et al. A randomized, controlled trial of fusion surgery for lumbar spinal stenosis. N Engl J Med. 2016;374(15):1413–1423.

    PubMed  Google Scholar 

  52. Shirley ED, Sanders JO. Measuring quality of care with patient satisfaction scores. J Bone Joint Surg Am. 2016;98(19):e83.

    PubMed  Google Scholar 

  53. CAHPS Hospital Survey. HCAHPS Fact Sheet. November 2017. https://www.hcahpsonline.org/globalassets/hcahps/facts/hcahps_fact_sheet_november_2017.pdf. Accessed 20 Feb 2019.

  54. Goldstein E, Farquhar M, Crofton C, Darby C, Garfinkel S. Measuring hospital care from the patients’ perspective: an overview of the CAHPS hospital survey development process. Health Serv Res. 2005;40(6 Pt 2):1977–1995.

    PubMed  PubMed Central  Google Scholar 

  55. Centers of Medicare and Medicaid. Hospital Compare. https://www.medicare.gov/hospitalcompare/search.html? Accessed 28 Feb 2019.

  56. Jha AK, Orav EJ, Zheng J, Epstein AM. Patients’ perception of hospital care in the United States. N Engl J Med. 2008;359(18):1921–1931.

    CAS  PubMed  Google Scholar 

  57. Sacks GD, Lawson EH, Dawes AJ, et al. Relationship between hospital performance on a patient satisfaction survey and surgical quality. JAMA Surg. 2015;150(9):858–864.

    PubMed  Google Scholar 

  58. Sheetz KH, Waits SA, Girotti ME, Campbell DA, Jr., Englesbe MJ. Patients’ perspectives of care and surgical outcomes in Michigan: an analysis using the CAHPS hospital survey. Ann Surg. 2014;260(1):5–9.

    PubMed  PubMed Central  Google Scholar 

  59. Kyte D, Cockwell P, Lencioni M, et al. Reflections on the national patient-reported outcome measures (PROMs) programme: where do we go from here? J R Soc Med. 2016;109(12):441–445.

    PubMed  PubMed Central  Google Scholar 

  60. Black N. Patient reported outcome measures could help transform healthcare. BMJ. 2013;346:f167.

    PubMed  Google Scholar 

  61. Gutacker N, Bojke C, Daidone S, Devlin N, Street A. Hospital variation in patient-reported outcomes at the level of EQ-5D dimensions: evidence from England. Med Decis Making. 2013;33(6):804–818.

    PubMed  Google Scholar 

  62. National Health Service. The National Patient Reported Outcome Measures (PROMs) Programme. 2018. https://www.england.nhs.uk/wp-content/uploads/2018/08/proms-guide-aug-18-v3.pdf. Accessed 27 Feb 2019.

  63. Porter I, Goncalves-Bradley D, Ricci-Cabello I, et al. Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities. J Comp Eff Res. 2016;5(5):507–519.

    PubMed  Google Scholar 

  64. Health and Social Care Information Centre. PROMS benefits case study: Patient Reported Outcome Measures (PROMs) outputs. 2018. https://webarchive.nationalarchives.gov.uk/20180307181536/http://content.digital.nhs.uk/benefitscasestudies/proms. Accessed 27 Feb 2019.

  65. Hutchings A, Neuburger J, Grosse Frie K, Black N, van der Meulen J. Factors associated with non-response in routine use of patient reported outcome measures after elective surgery in England. Health Qual Life Outcomes. 2012;10:34.

    PubMed  PubMed Central  Google Scholar 

  66. Gutacker N, Street A, Gomes M, Bojke C. Should English healthcare providers be penalised for failing to collect patient-reported outcome measures? A retrospective analysis. J R Soc Med. 2015;108(8):304–316.

    PubMed  PubMed Central  Google Scholar 

  67. Gomes M, Gutacker N, Bojke C, Street A. Addressing missing data in patient-reported outcome measures (PROMS): implications for the use of PROMS for comparing provider performance. Health Econ. 2016;25(5):515–528.

    PubMed  Google Scholar 

  68. Basch E, Torda P, Adams K. Standards for patient-reported outcome-based performance measures. JAMA. 2013;310(2):139–140.

    CAS  PubMed  Google Scholar 

  69. Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477–2481.

    CAS  PubMed  Google Scholar 

  70. Centers of Medicare and Medicaid. Oncology Care Model. https://innovation.cms.gov/initiatives/oncology-care/. Accessed 17 May 2019.

  71. Aviki EM, Schleicher SM, Mullangi S. The oncology care model and other value-based payment models in cancer care. JAMA Oncol. 2019;5(3):298–299.

    PubMed  Google Scholar 

  72. Centers of Medicare and Medicaid. 2018 Quality Measures. 2018. https://qpp.cms.gov/mips/explore-measures/quality-measures?py=2018#measures. Accessed 20 Feb 2019.

  73. Centers of Medicare and Medicaid. CMS Quality Measure Development Plan 2018 Annual Report. 2018. https://www.cms.gov/Medicare/Quality-Payment-Program/Measure-Development/2018-MDP-annual-report.PDF. Accessed 20 Feb 2019.

  74. Reeve BB, Mitchell SA, Dueck AC, et al. Recommended patient-reported core set of symptoms to measure in adult cancer treatment trials. J Natl Cancer Inst. 2014;106(7). https://doi.org/10.1093/jnci/dju129.

    PubMed  PubMed Central  Google Scholar 

  75. Bilimoria KY, Cella D, Butt Z. Current challenges in using patient-reported outcomes for surgical care and performance measurement: everybody wants to hear from the patient, but Are we ready to listen? JAMA Surg. 2014;149(6):505–506.

    PubMed  Google Scholar 

  76. Franklin PD, Harrold L, Ayers DC. Incorporating patient-reported outcomes in total joint arthroplasty registries: challenges and opportunities. Clin Orthop Relat Res. 2013;471(11):3482–3488.

    PubMed  PubMed Central  Google Scholar 

  77. Lavallee DC, Chenok KE, Love RM, et al. Incorporating patient-reported outcomes into health care to engage patients and enhance care. Health Aff (Millwood). 2016;35(4):575–582.

    PubMed  Google Scholar 

Download references

Funding

Dr. Jennifer F. Waljee received funding from the American College of Surgeons and the American Foundation for Surgery of the Hand. Dr. Erika D. Sears is supported by Career Development Award Number IK2 HX002592 from the US Department of Veterans Affairs Health Services R&D (HSRD) Service. The content of this article is the sole responsibility of the authors and does not represent the views of the Department of Veterans Affairs or the United States Government.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jennifer F. Waljee MD, MPH, MS.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Billig, J.I., Sears, E.D., Travis, B.N. et al. Patient-Reported Outcomes: Understanding Surgical Efficacy and Quality from the Patient’s Perspective. Ann Surg Oncol 27, 56–64 (2020). https://doi.org/10.1245/s10434-019-07748-3

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1245/s10434-019-07748-3

Navigation