Skip to main content

Validity and reliability of EQ-5D-3L for breast cancer patients in Korea

Abstract

Background

Recently, breast cancer incidence and prevalence has been increasing. Patients' health related quality of life is important considerations in the treatment of breast cancer. The EQ-5D-3L is one of most popular instruments to measure health related quality of life. This study was aimed to evaluate the validity and reliability of EQ-5D-3L in post-operative breast cancer patients from Korea.

Methods

A total of 827 patients visiting the ambulatory cancer center of 1 tertiary hospital after breast cancer surgery self-administered the EQ-5D-3L and Functional Assessment of Cancer Therapy-Breast Cancer (FACT-B). We evaluated known-group validity using differences in the EQ-5D-3L index and EQ-VAS score according to demographic and clinical data. The discriminatory ability of the EQ-5D-3L was determined by comparing the mean FACT-B subscale scores between subjects with no problems and subjects with moderate or severe problems in each EQ-5D-3L dimension. Construct validity was evaluated by Pearson correlation coefficients among the EQ-5D-3L index and FACT-B subscales, respectively. Reliability was assessed in terms of test-retest reliability using Cohen’s kappa value and intra-class correlation coefficient (ICC).

Results

The EQ-5D-3L index and EQ-VAS score were higher in the educated, current radiotherapy and unmarried groups. The correlation of EQ-5D-3L index and subscales for the FACT-B was highest in physical well-being (r = 0.553) and lowest in social well-being (r = 0.199). For reliability, the Kappa values’ range was from 0.32 to 0.70, and ICCs of the EQ-5D-3L index and EQ-VAS scores were 0.70 and 0.48, respectively.

Conclusions

This study indicated that the EQ-5D-3L could be a valid health related quality of life instrument for postoperative breast cancer patients.

Background

Breast cancer is the most frequently diagnosed cancer in females and the leading cause of cancer-related deaths in both economically developed and developing countries [1]. In Korea, the crude breast cancer incidence rate was 63.7 per 100,000 persons in 2011 and has been increasing since 1999 [2]. The 5-year survival rate for breast cancer patients has improved, with 91.3 % reported between 2007 and 2011 in Korea [2]. Recent years have led to a range of treatments for breast cancer, and development of additional therapeutics is continually in progress.

Health-related quality of life (HRQoL) and traditional clinical outcomes (i.e., survival rate or tumor responses) are considered as significant outcomes of cancer care [3]. Tools to assess HRQoL are classified into disease-specific instruments and generic instruments. Preference-based instruments (the Health Utility Index [4, 5], the EuroQol 5D (EQ-5D-3L) [6], or the Short Form 6D [7]) are generic instrument generating utilities that yield a measure that combines both the length and quality of life [8]. Disease-specific instruments can be more sensitive for detecting clinically important differences or changes in specific disease groups in general, although general instrument is occasionally not inferior to disease-specific instrument [9]. However, they do not compare HRQoL of patients with other diseases [8]. Resource allocation for health care has been a critical issue, not only for its effectiveness, but also for efficiency of care; hence, it is important for guiding healthcare policy.

The EQ-5D-3L, a generic preference-based instrument that is widely used to measure HRQoL, can be used to assign preference values to various health states [10]. Additionally, EQ-5D-3L is a unique instrument with quality weight tariffs for use in Korean populations [11]. The psychometric properties of the Korean EQ-5D-3L have been studied for rheumatic disease [12] and colon cancer [13] patients. However, studies on validity and reliability of the EQ-5D-3L in breast cancer patients in Korea are scarce [14]. Hence, we evaluated the validity and reliability of the EQ-5D-3L to measure the HRQoL in post-operative breast cancer patients from Korea.

Methods

Subjects and settings

A consecutive series of breast cancer patients who had surgery as a primary treatment at the ambulatory cancer center of 1 tertiary hospital in Seoul, Korea from February 2012 to May 2012, participated in this study. All participants provided informed written consent prior to taking our survey and a total of 1,002 subjects were consecutively recruited. The initial 150 recruited subjects were requested to complete an EQ-5D-3L questionnaire 1 week later via mail to assess the test-retest reliability of each patient. The survey was self-administered in the waiting room at the center with or without research nurse assistance. The Institutional Review Board of Asan Medical Center approved the study (IRB approval number: 2012–0010).

Information

Our questionnaire included requests for demographic information (age, sex, level of education, marital status, and occupation) and 2 HRQOL instruments (EQ-5D-3L and Functional Assessment of Cancer Therapy-Breast Cancer [FACT-B] version 4). Clinical information (the type of surgery, American Joint Committee on Cancer [AJCC] 7th stage at diagnosis, duration of disease since diagnosis, and current treatment for breast cancer), was obtained from the cancer registry database of the center.

The EQ-5D-3L is an instrument widely used to measure and evaluate the general health status of a patient in 5 dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) with 3 levels as follows: 1, no problems; 2, some or moderate problems; and 3, extreme problems. The EQ-5D-3L provides a simple descriptive profile and a single index of health status [10]. The EQ-VAS records the respondent’s self-rated health on a vertical, visual analogue scale where the endpoints are classified as follows: ‘best imaginable health state’ =100 and ‘worst imaginable health state’ =0 [10].

The FACT-B is a validated multi-dimensional self-reported questionnaire with a 36-item questionnaire that measures both the 27-item general QoL associated with cancer (Functional Assessment of Cancer Therapy - General [FACT-G]) and an additional 9-item breast cancer-related QOL. The FACT-B includes the following subscales that measure physical well-being (PWB), functional well-being (FWB), emotional well-being (EWB), social/family well-being (SWB), and the breast cancer subscale (BCS). FACT-B total scores were calculated as the sum of the 5 subscales. FACT-G scores were calculated as the sum of the PWB, FWB, EWB, and SWB scores and FACT-B Trial Outcome Index (TOI) was calculated as the addition of the PWB, FWB and BCS scores [15, 16]. This study used the Korean FACT-B version 4 that is validated [17] and a higher score indicated a better state.

Analyses

The proportion of patients reporting any problems in each EQ-5D-3L dimension and EQ-5D-3L index were presented. The EQ-5D-3L index was calculated using a Korean valuation set [11]. The EQ-5D-3L index ranged from −0.171 to 1, and higher values indicated better health status. The FACT-B subscale scores were calculated in accordance with a scoring guideline provided by the Functional Assessment of Chronic Illness Therapy (FACIT) measurement system (www.facit.org/FACITOrg).

Differences in the EQ-5D-3L index and EQ-VAS score according to demographic and clinical data were compared using the Student’s t-test or analysis of variance (ANOVA). In aspects of known group validity, we expected that the EQ-5D-3L index and EQ VAS would be lower for the following conditions: worse stage at diagnosis [18], current treatment group [1820], shorter duration of disease since diagnosis [19, 2124], older age group [16, 22], and lower education group [16, 18, 22].

The discriminatory ability of the EQ-5D-3L was determined by comparing the mean FACT-B subscale scores between subjects with no problems and subjects with moderate or severe problems in each EQ-5D-3L dimension. It was expected that the FACT-B subscale scores of subjects with no problem would be higher than those of subjects with any problem. The mean differences in the FACT-B subscale were compared using the Student’s t-test. Discriminatory ability of the EQ-5D-5 L was considered acceptable when all hypothesized differences were significant.

Construct validity was evaluated by Pearson correlation coefficients among the EQ-5D-3L index, EQ-VAS, and FACT-B subscales. EQ-5D-3L index and FACT-G total scores were expected to be moderately or strongly correlated, because both instruments measured HRQoL. It was expected that the correlations between the EQ-5D-3L index and SWB subscale would be weaker than those of the other FACT-B subscales, because the EQ-5D-3L does not contain a social dimension. Construct validity was considered as acceptable when the hypotheses were satisfied.

Cohen’s kappa statistic was used to assess the test-retest reliability of each dimension for the EQ-5D-3L instrument. The kappa statistic calculates the degree of agreement in classification over that which would be expected by chance. There is no universally agreed-upon criteria of significant kappa value. We considered test-retest reliability of EQ-5D-5 L as acceptable if kappa value was higher than 0.4 in each dimension [25]. The intraclass correlation coefficient (ICC) [26] was used to assess the reliability of the EQ-5D-3L index and EQ-VAS score. We considered that > 0.5 ICC was acceptable.

Results

Among 1,002 recruited patients with breast cancer, 175 patients were excluded from this analysis: 13 duplicated, 2 with missing EQ-5D-3L data, and 160 patients who did not merge into the cancer registry data. Thus, a total of 827 patients were included in the study cohort. Among 150 participants who completed a second survey 1 week later, 67 participants replied and 54 subjects were used for test-retest reliability after excluding 13 participants for whom clinical information was not available. Demographic characteristics of the survey participants were shown in Table 1. All study participants were female with a mean age of 52.1 years. Most patients were married. The number of participants who had undergone breast-conserving surgery was 524 (63.4 %).

Table 1 General and clinical characteristics of the study subjects

The proportion of patients reporting any problems of the EQ-5D-3L and the FACT-B subscale score distribution in the study participants was shown in Table 2. The proportion of patients reporting any problems was relatively higher in the pain/discomfort and anxiety/depression dimensions at 43.5 % and 41.5 %, respectively. The mean FACT-G score was 78.7 (SD 15.8) and mean TOI was 66.7 (12.3). The EQ-5D-3L index and VAS score according to demographic and clinical features were shown in Table 3. In the highly educated and unmarried group, and not in current radiotherapy group, the EQ-5D-3L index scores were higher than corresponding scores of the other groups. A worse stage at the time of diagnosis was associated with lower HRQoL scores; however, this trend did not reach the threshold for statistical significance. By post-hoc analysis, individuals with < 1 year since the time of diagnosis had a significantly lower EQ-5D-3L index as compared with those who had > 4 years since their diagnosis. The EQ-VAS score were not significantly different according to demographic and clinical characteristics.

Table 2 Distribution of EQ-5D-3L problem reporting and FACT-B scores
Table 3 EQ-5D-3L scores according to general and clinical characteristics of the study patients

FACT-B subscale scores and summary measurements by dimension and level of the EQ-5D-3L were shown in Table 4. All FACT-B subscale scores and combined index of subjects with no problem were significantly higher than those of subjects with any problem in all EQ-5D-3L dimensions. Difference in PWB scores was larger than other FACT-B subscales in mobility dimension, whereas difference in PWB scores was larger in self-care and usual activities dimensions. Difference in EWB scores was the largest in the anxiety/depression dimension. Table 5 showed correlation coefficients among the EQ-5D-3L index, EQ-VAS score, and FACT-B scores. TOI scores showed the highest correlation with both the EQ-5D-3L index and EQ-VAS scores at 0.557 and 0.456, respectively, and the SWB scores showed the lowest correlation with the EQ-5D-3L index. Rates of agreements in the EQ-5D-3L dimensions ranged from 85.2 to 96.3 % across dimensions. Kappa statistics ranged from 0.32 in mobility to 0.70 in pain/discomfort and anxiety/depression dimensions. ICCs of the EQ-5D-3L index and EQ-VAS scores were 0.70 and 0.48, respectively (Table 6).

Table 4 FACT-B scales and summary measurements by EQ-5D-3L dimension and level
Table 5 Correlations between the EQ-5D-3L index, EQ-VAS score, and FACT-B scores
Table 6 Test-retest reliability of the EQ-5D-3L

Discussion

In this study, we aimed to assess the validity and reliability of EQ-5D-3L for measuring HRQoL in post-operative breast cancer patients. Our findings supported the validity of the EQ-5D-3L index. Values for this index were lower in the current radiation therapy, shorter duration of disease since diagnosis, and low education groups. Most of known-group validity features fulfilled our hypothesis. EQ-5D-3L indexes were lower for progressive stages at diagnosis and in the current chemotherapy group, although the differences in the EQ-5D-3L index between groups were not statistically significant. Our results corroborated the findings of Chae and Seo that patients who are younger, more highly educated, and with a longer time since diagnosis have a higher HRQoL [22]. HRQoL score differences by age group were not consistent with previous reports of HRQoL measurements in breast cancer patients [16, 22, 23]. Age has different impacts on HRQoL domains. Ahn et al’s study on breast cancer survivors showed better social and emotional function but poorer physical function with increasing age [24].

The FACT-B subscale scores for problem reporting in each EQ-5D-3L dimension were significantly different in the current analysis. The EQ-5D-3L index was moderately correlated with FACT-B subscale scores, ranging from 0.377 at FWB to 0.553 at PWB subscales, except for SWB. This finding was similar to those of Lee et al. who studied patients with breast cancer in Singapore [26]. In that study, a correlation between the EQ-5D-3L index and FACT-B subscales was the lowest at 0.11 on the SWB subscales and the highest at 0.66 on the PWB subscales [26].

Reliability of EQ-5D-3L in this study was inconclusive. Kappa values for EQ-5D-3L dimensions varied depending on domain and confidence intervals of kappa values were wide in mobility, self-care and usual activities. The ICCs of the EQ-5D-3L index was reasonable but EQ-VAS were somewhat low. Kappa values on mobility dimensions were the lowest at 0.32, but showed some agreement with the Landis and Koch criteria [25] at an agreement rate of 94.4 %. Low reliability statistics could be due to small sample size, change of health states between 2 time periods, and high proportion of no problem in mobility, self-care and usual activities dimensions. In the previous Singapore study, ICCs for the EQ-5D-3L index were reported to as 0.81 in the English version and 0.69 in the Chinese version [27]. Similarly, another Korean study of colorectal cancer patients reported kappa values for the EQ-5D-3L dimensions ranging from 0.32 to 0.56 and the ICC of the EQ-5D-3L index of 0.55 [13]. Compared to our present study, an earlier Taiwan study on cervical cancer patients reported somewhat higher kappa values for the EQ-5D-3L dimensions and the ICC of the EQ-5D-3L index [28].

The findings of the present study cannot be generalized since only postoperative breast cancer patients at 1 tertiary hospital were enrolled. Another limitation was that we did not investigate patient recurrence status, time since treatment completion, performance status at the visit day, or comorbidity. Because these parameters could affect the HRQoL, more comprehensive data are needed in the future to assess the psychometric properties of the HRQoL instruments. In addition, we did not assess the responsiveness of the EQ-5D-3L in breast cancer interventions; hence, further studies are warranted. Lastly, we did not reassess physical status at retest period, thus evidence on test-retest reliability was inconclusive.

Conclusion

In conclusion, we showed that the EQ-5D-3L could be a valid instrument for measuring the HRQoL of post-operative breast cancer patients in South Korea. However, reliability of the EQ-5D-3L is not conclusive and needs further research.

Abbreviations

ANOVA:

analysis of variance

BCS:

breast CANCER subscale

EWB:

emotional well-being

FACT-B:

Functional Assessment of Cancer Therapy-Breast Cancer

FACT-G:

Functional Assessment of Cancer Therapy - General

FWB:

Functional well-being

HRQoL:

health-related quality of life

ICC:

intra-class correlation coefficient

PWB:

physical well-being

SWB:

social/family well-being

References

  1. Jemal A, Bray F, Center MM, Ferlay J, Ward E, Forman D. Global cancer statistics. CA Cancer J Clin. 2011;61:69–90.

    Article  PubMed  Google Scholar 

  2. The Korea Central Cancer Registry, National Cancer Center, Ministry of Health and Welfare. Annual report of cancer statistics in Korea in 2011. Seoul: Ministry of Health and Welfare; 2013.

    Google Scholar 

  3. Nayfield SG, Ganz PA, Moinpour CM, Cella DF, Hailey BJ. Report from a National Cancer Institute (USA) workshop on quality of life assessment in cancer clinical trials. Qual Life Res. 1992;1:203–10.

    Article  PubMed  CAS  Google Scholar 

  4. Torrance GW, Feeny DH, Furlong WJ, Barr RD, Zhang Y, Wang Q. Multiattribute utility function for a comprehensive health status classification system. Health Utilities Index Mark 2. Med Care. 1996;34:702–22.

    Article  PubMed  CAS  Google Scholar 

  5. Feeny D, Furlong W, Torrance GW, Goldsmith CH, Zhu Z, DePauw S, et al. Multiattribute and single-attribute utility functions for the health utilities index mark 3 system. Med Care. 2002;40:113–28.

    Article  PubMed  Google Scholar 

  6. Brooks R. EuroQol: the current state of play. Health Policy. 1996;37:53–72.

    Article  PubMed  CAS  Google Scholar 

  7. Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–92.

    Article  PubMed  Google Scholar 

  8. Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddart GL. Methods for the Economic Evaluation of Health Care Programme. New York: Oxford University Press; 2005.

    Google Scholar 

  9. Lee CF, Luo N, Ng R, Wong NS, Yap YS, Lo SK, et al. Comparison of the measurement properties between a short and generic instrument, the 5-level EuroQoL Group's 5-dimension (EQ-5D-5 L) questionnaire, and a longer and disease-specific instrument, the Functional Assessment of Cancer Therapy-Breast (FACT-B), in Asian breast cancer patients. Qual Life Res. 2013;22:1745–51.

    Article  PubMed  Google Scholar 

  10. Brooks R, Rabin R, de Charro F. The Measurement and Valuation of Health Status Using Eq-5D: A European Perspective: Evidence from the Euroqol Biomed Research Programme. Dordrecht, The Netherlands. London: Kluwer Academic Publishers; 2003.

    Google Scholar 

  11. Lee YK, Nam HS, Chuang LH, Kim KY, Yang HK, Kwon IS, et al. South Korean time trade-off values for EQ-5D health states: modeling with observed values for 101 health states. Value Health. 2009;12:1187–93.

    Article  PubMed  Google Scholar 

  12. Kim MH, Cho YS, Uhm WS, Kim S, Bae SC. Cross-cultural adaptation and validation of the Korean version of the EQ-5D in patients with rheumatic diseases. Qual Life Res. 2005;14:1401–6.

    Article  PubMed  Google Scholar 

  13. Kim SH, Hwang JS, Kim TW, Hong YS, Jo MW. Validity and reliability of the EQ-5D for cancer patients in Korea. Support Care Cancer. 2012;20:3155–60.

    Article  PubMed  Google Scholar 

  14. Kim SH, Kim HJ, Lee SI, Jo MW. Comparing the psychometric properties of the EQ-5D-3L and EQ-5D-5 L in cancer patients in Korea. Qual Life Res. 2012;21:1065–73.

    Article  PubMed  Google Scholar 

  15. Brady MJ, Cella DF, Mo F, Bonomi AE, Tulsky DS, Lloyd SR, et al. Reliability and validity of the Functional Assessment of Cancer Therapy-Breast quality-of-life instrument. J Clin Oncol. 1997;15:974–86.

    PubMed  CAS  Google Scholar 

  16. Park BW, Lee S, Lee AR, Lee KH, Hwang SY. Quality of Life Differences between Younger and Older Breast Cancer Patients. J Breast Cancer. 2011;14:112–8.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Yoo HJ, Ahn SH, Eremenco S, Kim H, Kim WK, Kim SB, et al. Korean translation and validation of the functional assessment of cancer therapy-breast (FACT-B) scale version 4. Qual Life Res. 2005;14:1627–32.

    Article  PubMed  Google Scholar 

  18. Lu W, Cui Y, Zheng Y, Gu K, Cai H, Li Q, et al. Impact of newly diagnosed breast cancer on quality of life among Chinese women. Breast Cancer Res Treat. 2007;102:201–10.

    Article  PubMed  Google Scholar 

  19. Lu W, Cui Y, Chen X, Zheng Y, Gu K, Cai H, et al. Changes in quality of life among breast cancer patients three years post-diagnosis. Breast Cancer Res Treat. 2009;114:357–69.

    Article  PubMed  Google Scholar 

  20. Janz NK, Mujahid M, Chung LK, Lantz PM, Hawley ST, Morrow M, et al. Symptom experience and quality of life of women following breast cancer treatment. J Womens Health (Larchmt). 2007;16(9):1348–61.

    Article  Google Scholar 

  21. Nissen MJ, Swenson KK, Ritz LJ, Farrell JB, Sladek ML, Lally RM. Quality of life after breast carcinoma surgery: a comparison of three surgical procedures. Cancer. 2001;1(91):1238–46.

    Article  Google Scholar 

  22. Chae YR, Seo K. Health-related quality of life in women with breast cancer in Korea: do sociodemographic characteristics and time since diagnosis make a difference? Oncol Nurs Forum. 2010;37:E295–303.

    Article  PubMed  Google Scholar 

  23. Park JH, Jun EY, Kang MY, Joung YS, Kim GS. Symptom experience and quality of life in breast cancer survivors. J Korean Acad Nurs. 2009;39:613–21.

    Article  PubMed  Google Scholar 

  24. Ahn SH, Park BW, Noh DY, Nam SJ, Lee ES, Lee MK, et al. Health-related quality of life in disease-free survivors of breast cancer with the general population. Ann Oncol. 2007;18:173–82.

    Article  PubMed  CAS  Google Scholar 

  25. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  PubMed  CAS  Google Scholar 

  26. Weir JP. Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231–40.

    PubMed  Google Scholar 

  27. Lee CF, Ng R, Luo N, Wong NS, Yap YS, Lo SK, et al. The English and Chinese versions of the five-level EuroQoL Group's five-dimension questionnaire (EQ-5D) were valid and reliable and provided comparable scores in Asian breast cancer patients. Support Care Cancer. 2013;21:201–9.

    Article  PubMed  Google Scholar 

  28. Lang HC, Chuang L, Shun SC, Hsieh CL, Lan CF. Validation of EQ-5D in patients with cervical cancer in Taiwan. Support Care Cancer. 2010;18:1279–86.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This study supported by Bayer Korea.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Min-Woo Jo.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

All authors contributed to the conception and design of the study and the interpretation of the results. MWJ was responsible for data acquisition. SHK analyzed the data and was involved in drafting the manuscript. MWJ, JWL and JKK were involved in revising the manuscript to ensure its critically important content. All authors have read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, SH., Jo, MW., Lee, JW. et al. Validity and reliability of EQ-5D-3L for breast cancer patients in Korea. Health Qual Life Outcomes 13, 203 (2015). https://doi.org/10.1186/s12955-015-0399-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12955-015-0399-x

Keywords