Abstract
Patient-reported outcomes (PROs) represent the voice of the patient in drug and device evaluation. As such, the outcomes selected for evaluation must be relevant to the patient, and the instruments used to capture them must have sound measurement properties. This paper discusses the role of qualitative research methods in assuring PRO clarity and content validity in a clinical trial environment characterized by evolving regulatory policy, new advances in technology and increasingly diverse samples within global clinical trials. Three important PRO measurement issues influenced by these changes are addressed: (i) endpoint selection and instrument development; (ii) the adaptation of instruments for electronic administration; and (iii) conceptual equivalence of measures across diverse samples. These are viewed as interrelated issues of content validity that can be addressed through the appropriate and rigorous application of qualitative research methods. Focus groups, cognitive debriefing, user acceptance testing and translation methodologies are discussed as ways to address and document the content validity of PRO instruments and ensure the empirical data representing the voice of the patient is sound.
Similar content being viewed by others
References
US EDA, Center for Drug Evaluation and Research. Guidance for industry: patient-reported outcome measures. Use in medical product development to support labeling claims: draft guidance [online]. Available from URL: http://www.fda.gov/cber/gdlns/prolbl.htm [Accessed 2007 Aug 15]
US EDA, Center for Drug Evaluation and Research. Guidance for industry and review staff: target product profile. Strategic development process tool. 2007 [online]. Available from URL: http://www.fda.gov/CDER/GUIDANCE/6910dft.htm [Accessed 2007 Aug 15]
US EDA, Center for Drug Evaluation and Research. EDA’s critical path initiative [online]. Available from URL: http://www.fda.gov/oc/initiatives/criticalpath/ [Accessed 2007 Aug 15]
Hays RD, Anderson R, Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993 Dec; 2 (6): 441–449
Nunnally JC, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill, 1994
Revicki DA. EDA draft guidance and health-outcomes research. Lancet 2007 Feb 17; 369 (9561): 540–542
Rock EP. Conceptual framework of an instrument [presentation]. Annual Meeting of the Drug Information Association; 2006 Jun 19; Philadelphia (PA) [online]. Available from URL: http://www.fda.gov/cder/present/DIA20067Burke_Rock.ppt#418,11,Conceptual%20Framework%20of%20an%20Instrument [Accessed 2007 Aug 24]
Dicicco-Bloom B, Crabtree BF. The qualitative research interview. Med Educ 2006 Apr; 40 (4): 314–321
Draper AK. The principles and application of qualitative research. Proc Nutr Soc 2004 Nov; 63 (4): 641–646
Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs 2004 Nov; 48 (4): 388–396
Krueger RA, Casey MA. Focus groups: a practical guide for applied research. 3rd ed. Thousand Oaks (CA): Sage Publications, Inc., 2000
Morgan DL. Focus groups as qualitative research. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 1997
Stewart DW, Shamdasani PN, Rook DW. Focus groups: theory and practice. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 2006
Creswell JW. Qualitative inquiry and research design: choosing among five methods. Thousand Oaks (CA): Sage Publications, Inc., 1998
Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb; 24 (2): 105–112
Willis G. Cognitive interviewing. Thousand Oaks (CA): Sage Publications, Inc., 2005
Aquilino WS. Interview mode effects in surveys of drug and alcohol use: a field experiment. Public Opin Q 1994; 58 (2): 210–240
Dillman D. Mail and internet surveys. 2nd ed. New York: Wiley, 2000
McCabe SE, Boyd CJ, Couper MP, et al. Mode effects for collecting alcohol and other drug use data: web and US mail. J Stud Alcohol 2002 Nov; 63 (6): 755–761
Newman JC, Des Jarlais DC, Turner CF, et al. The differential effects of face-to-face and computer interview modes. Am J Public Health 2002 Feb; 92 (2): 294–297
Tourangeau R, Smith W. Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin Q 1996; 60 (2): 275–304
US Department of Health and Human Services. Usability.gov. Step-by-step usability guide [online]. Available from URL: http://www.usability.gov/ [Accessed 2007 Aug 15]
Fayers PM. Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment. Qual Life Res 2007; 16 Suppl. 1: 187–194
Holland PW, Wainer H. Differential item functioning. London: Lawrence Erlbaum, 1993
Rogers HJ, Swaminathan H, Hambleton RK. Fundamentals of item response theory. Thousand Oaks (CA): Sage Publications, Inc., 1991
Cella D, Lloyd S, Wright B. Cross-cultural instrument equating: current research and future directions. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. 2nd ed. Philadelphia (PA): Lippincott-Raven, 1996: 707–715
Flaherty JA, Gaviria FM, Pathak D, et al. Developing instruments for cross-cultural psychiatric research. J Nerv Ment Dis 1988 May; 176 (5): 257–263
Herdman M, Fox-Rushby J, Badia X. ‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res 1997 Apr; 6 (3): 237–247
Van de Vijver F. Towards a theory of bias and equivalence. ZUMA Nachrichten Spezial 1998; 42: 41–65
Zheng YP, Wei LA, GoaL G, et al. Applicability of the Chinese beck depression inventory. Compr Psychiatry 1988 Sep–Oct; 29 (5): 484–489
Willgerodt MA. Using focus groups to develop culturally relevant instruments. West J Nurs Res 2003 Nov; 25 (7): 798–814
Cull A, Sprangers M, Bjordal K, et al. EORTC Quality of Life Group translation procedure. 2nd ed. Brussels: EORTC Quality of Life Group, 2002
Eremenco SL, Cella D, Arnold BJ. A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Eval Health Prof 2005 Jun; 28 (2): 212–232
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1994; 47 (12): 1465–1466
Sartorius N, Kuyken W. Translation of health status instruments. In: Orley J, Kuyken W, editors. Quality of life assessment: international perspectives. Berlin Heidelberg: Springer Verlag, 1994: 3–18
Wild D, Grove A, Martin M, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of thelSPOR Task Force for Translation and Cultural Adaptation. Value Health 2005 Mar-Apr; 8 (2): 94–104
Hunt S. Cross-cultural issues in the use of quality of life measures in randomized controlled trials. In: Staquet M, Hays R, Fayers P, editors. Quality of life assessment in clinical trials. Oxford: Oxford University Press, 1998: 51–68
Lenderking WR. Comments on the ISPOR Task Force report on translation and adaptation of outcomes measures: guidelines and the need for more research. Value Health 2005 Mar-Apr; 8 (2): 92–93
Swaine-Verdier A, Doward LC, Hagell P, et al. Adapting quality of life instruments. Value Health 2004 Sep–Oct; 7 Suppl. 1: S27–S30
Acknowledgements
The authors are employed by the United BioSource Corporation (UBC), which provides consulting and other research services to pharmaceutical, device, government and non-government organizations. In this salaried position, the authors work with a variety of companies and organizations. They receive no payment or honoraria directly from these organizations for services rendered.
No sources of funding were used to assist in the preparation of this article.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Leidy, N.K., Vernon, M. Perspectives on Patient-Reported Outcomes. Pharmacoeconomics 26, 363–370 (2008). https://doi.org/10.2165/00019053-200826050-00002
Published:
Issue Date:
DOI: https://doi.org/10.2165/00019053-200826050-00002