Review ArticleMethodological quality of patient-reported outcome research was low in complementary and alternative medicine in oncology
Introduction
Health-related quality of life (HRQOL) is now considered an important endpoint in cancer clinical trials and the number of trials incorporating HRQOL outcomes has increased significantly over the last decade [1]. Regulatory authorities such as the Food and Drug Administration as well as major professional organizations such as the American Society of Clinical Oncology consider HRQOL assessment in clinical trials to be a relevant endpoint in cancer clinical trials [2], [3].
At present there is no universally accepted definition of HRQOL. Nevertheless, there is a general consensus that it is multidimensional, encompassing physical, psychological, and social functioning, and that it is patient based [4], [5]. A large number of questionnaires are currently available for assessing the HRQOL of patients with cancer. One-dimensional instruments that only assess a single health domain are generally not considered to be HRQOL measures, as they are too limited in scope [6]. More recently, the term “patient-reported outcome” (PRO) has been introduced into the literature to describe a broader set of parameters that have in common their focus on assessing health outcomes from the patient's perspective [7]. PROs include a wide spectrum of measures, ranging from single-item instruments assessing a specific health domain (e.g., pain or fatigue) to multidimensional HRQOL measures. In this context HRQOL can be seen as a subset of PROs. This is important to keep in mind as this paper is concerned with any PRO, including HRQOL measures.
Although PROs have the potential to provide valuable insights into the treatment and care of patients, there is also evidence that a number of methodological issues still challenge investigators when assessing a PRO in cancer clinical trials [8]. Previous work has highlighted some of the methodological problems and challenges in HRQOL studies conducted as part of clinical trials of conventional treatments in breast, colorectal, prostate, and lung cancer [8], [9], [10], [11], [12]. To date, no such systematic methodological works are available on clinical trials of complementary and alternative medicine (CAM) interventions among cancer patients. There is no unique definition of what CAM is; however, throughout this work we adopted this commonly used acronym as a working compromise. It consists of two aspects: although “complementary” therapies allude to the additional use of these methods to mainstream cancer care, often intended to improve patients' well-being and/or control symptoms, “alternative” therapies are usually promoted for use instead of mainstream care [13], [14]. In general these practices are not considered standard medical approaches and can include a wide number of practices and interventions. Previous evidence has shown the popularity of CAM among cancer patients [15]. Key reasons to use CAM are to alleviate cancer- or therapy-related symptoms or enhance psychosocial well-being and HRQOL. Given this, the main purpose of this research is to evaluate the methodological robustness of PROs evaluation in CAM randomized controlled trials (RCTs) in oncology.
Section snippets
Systematic literature search
Studies included in this review were retrieved from systematic literature searches of CAM studies published between January 2000 and July 2005. MedLine and the Cochrane Central Register of Controlled Trials (CENTRAL) databases were searched for published manuscripts in English. Additional literature was identified via the reference lists of these articles and via contacts with experts in the field. Published conference abstracts were not included, as they typically do not provide sufficient
Results
Based on the eligibility criteria, 44 studies were selected enrolling overall 4,912 cancer patients. Six studies involved alternative medical systems [18], [19], [20], [21], [22], [23], 14 involved mind body interventions [24], [25], [26], [27], [28], [29], [30], [31], [32], [33], [34], [35], [36], [37], [38], 15 dealt with biologically based therapies [39], [40], [41], [42], [43], [44], [45], [46], [47], [48], [49], [50], [51], [52], [53], seven involved manipulative and body-based methods [54]
Discussion
Although earlier systematic reviews have highlighted a number of methodological limitations of the HRQOL components of RCTs of conventional treatments in oncology [10], [11], [12], no such work has been published in the area of CAM. Recent evidence has shown that the quality of reviews of CAM is at least as good as that of conventional medical interventions [66] and that this is particularly the case for the quality of reports of RCTs of CAM interventions [67]. Other studies in CAM have also
Acknowledgments
This research was supported by the CAM-CANCER project “Concerted Action for Complementary and Alternative Medicine Assessment in the Cancer Field” funded by the European Commission (5th Framework Program).
References (74)
- et al.
Quality of life instruments in oncology
Eur J Cancer
(1999) - et al.
Quality of life in patients undergoing systemic therapy for advanced breast cancer
Lancet Oncol
(2002) - et al.
Methodological issues in assessing health-related quality of life of colorectal cancer patients in randomized controlled trials
Eur J Cancer
(2004) - et al.
Unconventional therapies for cancer and cancer-related symptoms
Lancet Oncol
(2001) - et al.
The efficacy of acupressure and acustimulation wrist bands for the relief of chemotherapy-induced nausea and vomiting. A University of Rochester Cancer Center Community Clinical Oncology Program multicenter study
J Pain Symptom Manage
(2003) - et al.
The efficacy of a mind-body-spirit group for women with breast cancer: a randomized controlled trial
Gen Hosp Psychiatry
(2002) - et al.
The efficacy of mindfulness-based stress reduction in the treatment of sleep disturbance in women with breast cancer: an exploratory study
J Psychosom Res
(2003) - et al.
Hypnotherapy in radiotherapy patients: a randomized trial
Int J Radiat Oncol Biol Phys
(2005) - et al.
The effect of an adjuvant mistletoe treatment programme in resected head and neck cancer patients: a randomised controlled clinical trial
Eur J Cancer
(2001) - et al.
Cimicifuga racemosa for the treatment of hot flushes in women surviving breast cancer
Maturitas
(2003)
A randomized placebo-controlled crossover trial with phytoestrogens in treatment of menopause in breast cancer patients
Obstet Gynecol
Phase II double-blind randomized study comparing oral aloe vera versus placebo to prevent radiation-related mucositis in patients with head-and-neck neoplasms
Int J Radiat Oncol Biol Phys
Double-blind placebo-controlled randomised trial of vitamin E and pentoxifylline in patients with chronic arm lymphoedema and fibrosis after surgery and radiotherapy for breast cancer
Radiother Oncol
Breast cancer patients have improved immune and neuroendocrine functions following massage therapy
J Psychosom Res
Systematic reviews involving complementary and alternative medicine interventions had higher quality of reporting than conventional medicine reviews
J Clin Epidemiol
For randomized controlled trials, the quality of reports of complementary and alternative medicine was as good as reports of conventional medicine
J Clin Epidemiol
Impact of study quality on outcome in placebo-controlled trials of homeopathy
J Clin Epidemiol
Location bias in controlled clinical trials of complementary/alternative therapies
J Clin Epidemiol
The level of reporting of health-related quality of life in cancer research. Evidence from 123 randomised controlled trials enrolling 36220 cancer patients
Eur J Cancer Suppl
Reporting on quality of life in randomised controlled trials: bibliographic study
BMJ
Food and Drug Administration requirements for approval of new anticancer drugs
Cancer Treat Rep
American Society of Clinical Oncology
J Clin Oncol
Methodologic assessments of quality of life measures in clinical trials
Ann Pharmacother
Lessons learned from measuring health-related quality of life in oncology
J Clin Oncol
Patient reported outcomes as endpoints in medical research
Stat Methods Med Res
Beyond the development of health-related quality of life (HRQOL) measures. A checklist for evaluating HRQOL outcomes in cancer clinical trials-does HRQOL evaluation in prostate cancer research inform clinical decision-making?
J Clin Oncol
Health-related quality of life in prostate carcinoma patients: a systematic review of randomized controlled trials
Cancer
Health-related quality of life in non small-cell lung cancer: methodologic issues in randomized controlled trials
J Clin Oncol
Complementary and alternative therapies for cancer
Oncologist
The prevalence of complementary/alternative medicine in cancer: a systematic review
Cancer
National Center for Complementary and Alternative Medicine
Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation
JAMA
Acupressure for nausea: results of a pilot study
Oncol Nurs Forum
Analgesic effect of auricular acupuncture for cancer pain: a randomized, blinded, controlled trial
J Clin Oncol
Tai Chi Chuan, health-related quality of life and self-esteem: a randomized trial with breast cancer survivors
Support Care Cancer
Homeopathy for menopausal symptoms in breast cancer survivors: a preliminary randomized controlled trial
J Altern Complement Med
A pilot, randomized, double-blinded, placebo-controlled trial of individualized homeopathy for symptoms of estrogen withdrawal in breast-cancer survivors
J Altern Complement Med
Cited by (33)
Quality of reporting in oncology studies: A systematic analysis of literature reviews and prospects
2017, Critical Reviews in Oncology/HematologyCitation Excerpt :After title and abstract screening, 55 articles for the first author (RR) and 62 for the third author (MO) seemed potentially relevant and the full-text of these articles was screened in detail. Finally, after selection on the full text and after suppression of duplicates by the second author (AB), 58 articles were included in the literature review (Toulmonde et al., 2011; Péron et al., 2013; You et al., 2012; Arkenau et al., 2011; Bekelman and Yahalom, 2009; Blencowe et al., 2012; Blencowe et al., 2014; Bottomley et al., 2003; Burton and Altman, 2004; Bylicki et al., 2015; Cherny et al., 2009; Claassens et al., 2011; Dirven et al., 2014; Duff et al., 2010; Efficace and Bottomley, 2002; Efficace et al., 2004; Efficace et al., 2006; Efficace et al., 2007; Efficace et al., 2014a; Efficace et al., 2014b; Ghimire et al., 2014; Grellety et al., 2014; Guo et al., 2014; Hopewell and Clarke, 2005; Hui et al., 2012; Kober et al., 2006; Krzyzanowska et al., 2004; Lai et al., 2006; Le Tourneau et al., 2009; Lee and Chi, 2000; Lu et al., 2011; Lu et al., 2013; Martin et al., 2006; Mathoulin-Pelissier et al., 2008; Mhaskar et al., 2012; Mitchell et al., 2009; Papathanasiou and Zintzaras, 2010; Pat et al., 2008; Péron et al., 2012; Perrone et al., 2002; Potter et al., 2011; Riechelmann et al., 2008; Scharf and Colevas, 2006; Seruga et al., 2011; Shitara et al., 2012; Sivendran et al., 2014; Soares et al., 2004; Sorbye et al., 2007; Süt et al., 2008; Swanson and Bailar, 2002; Tanaka et al., 2012; Thezenas et al., 2004; Thoma et al., 2009; Treweek, 2011; Tuech et al., 2005; Vera-Badillo et al., 2013; Zikos et al., 2014; Ziogas and Zintzaras, 2009). The flowchart illustrates the selection process (Fig. 1).
Patient-reported outcomes in studies of complementary and alternative medicine: Problems, solutions, and future directions
2011, Explore: The Journal of Science and HealingPredictive factors for the use of complementary and alternative medicine (CAM) in radiation oncology
2009, European Journal of Integrative MedicineTraditional Chinese Medicinal Herbs in the Treatment of Patients with Esophageal Cancer: A Systematic Review
2009, Gastroenterology Clinics of North AmericaCitation Excerpt :For example, the assessment of quality of life was performed by authors who were not blinded to the trial conditions, which may lead to the increased potential for false-positive results. Valuable assessment about quality of life in a randomized controlled trial should be participant based and should include the use of a validated multidimensional questionnaire completed by the participant with an internationally evaluated minimum standard checklist.23–25 There is obviously variation in the components of the herbal medical preparations, and each is unique to Chinese traditional herbal medicine.
Quality, interpretation and presentation of European Organisation for Research and Treatment of Cancer quality of life questionnaire core 30 data in randomised controlled trials
2008, European Journal of CancerCitation Excerpt :The main failings of the papers according to the checklist were not reporting the rationale for using the EORTC QLQ-C30 or the method of administration. These issues also arose in the previous reviews.2,20–24 In our review, this could be because the EORTC QLQ-C30 is well validated in cancer patients and authors referencing the validity of the questionnaire may regard this, implicitly, as their rationale for using it but without explicitly stating this they fail on this criterion.
Health-related quality of life assessment and reported outcomes in leukaemia randomised controlled trials - A systematic review to evaluate the added value in supporting clinical decision making
2008, European Journal of CancerCitation Excerpt :The checklist score for each prospective HRQOL assessment is reported in Table 2. None of these could be considered as verylimited in terms of methodological design according to previously defined criteria.3,23 Two trials (22%) were considered limited24,27 while four (67%) where evaluated as being probably robust.25,26,28,29