Skip to main content
Top
Gepubliceerd in: Quality of Life Research 12/2016

13-06-2016

Interpretation of verbal descriptors for response options commonly used in verbal rating scales in patient-reported outcome instruments

Auteurs: Alex Mutebi, Marion Slack, Terri L. Warholak, Stacie Hudgens, Stephen Joel Coons

Gepubliceerd in: Quality of Life Research | Uitgave 12/2016

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

To assess the variation in the interpretation of common verbal descriptors (VDs) used in response scales and examine factors associated with those interpretations.

Methods

Subjects were recruited through MediGuard and they assigned interpretation scores (11-point scale; 0 = lowest possible, 10 = highest possible) to five common sets of VDs: set one (none, mild, moderate, severe, very severe); set two (never, rarely, sometimes, often, always); set three (poor, fair, good, very good, excellent); set four (not at all, a little bit, moderately, quite a bit, extremely); and set five (not at all, a little bit, somewhat, quite a bit, very much). One-sample test for proportions and T-tests examined equality of proportions (anchors) and means scores (non-anchors) with the fixed intervals (0.0, 2.5, 5.0, 7.5, and 10.0). Ordinal regression examined adjusted associations between demographic/clinical factors and VD scores.

Results

Of the 350 subjects, 68 % were females and mean (SD) age was 56.9 (12.1). Two sets had two VDs with mean (95 % CI) scores not different than the fixed intervals. Set one had mild = 2.50 (2.33; 2.66) and moderate = 5.01 (4.89; 5.13) with 98.8 % (97.3 %; 100 %) assigning none = 0. Set five had a little bit = 2.35 (2.17; 2.53) and quite a bit = 7.65 (7.43; 7.87) with 95.0 % (95 % CI 91.7; 98.2) assigning not at all = 0. Significant associations (p ≤ 0.05) included age and education with somewhat and income and comorbidities with very severe. Age, sex, and education showed associations with other VDs albeit in nonsignificant models.

Conclusions

Sets one and five yielded data closest to the fixed intervals. Demographic and clinical factors are associated with the interpretation of some VDs and should be adjusted for in analyses of non-randomized data.
Literatuur
1.
go back to reference Willke, R. J., Burke, L. B., & Erickson, P. (2004). Measuring treatment impact: A review of patient-reported outcomes and other efficacy endpoints in approved product verbal descriptors. Controlled Clinical Trials, 25, 535–552.CrossRefPubMed Willke, R. J., Burke, L. B., & Erickson, P. (2004). Measuring treatment impact: A review of patient-reported outcomes and other efficacy endpoints in approved product verbal descriptors. Controlled Clinical Trials, 25, 535–552.CrossRefPubMed
2.
go back to reference Bentley, J. (2002). Pharmaceutical marketing’s contributions to quality of life. Journal of Pharmaceutical Marketing and Management, 14(3/4), 109–127.CrossRef Bentley, J. (2002). Pharmaceutical marketing’s contributions to quality of life. Journal of Pharmaceutical Marketing and Management, 14(3/4), 109–127.CrossRef
3.
go back to reference Drummond, M. F., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005). Methods for the economics evaluation of health care programmes (3rd ed.). Oxford: Oxford University Press. Drummond, M. F., Sculpher, M. J., Torrance, G. W., O’Brien, B. J., & Stoddart, G. L. (2005). Methods for the economics evaluation of health care programmes (3rd ed.). Oxford: Oxford University Press.
4.
go back to reference Patrick, D. L., Burke, L. B., Powers, J. H., Scott, J. A., Rock, E. P., Dawisha, S., et al. (2007). Patient-reported outcomes to support medical product labeling claims: FDA perspective. Value Health, 10, S125–S137.CrossRefPubMed Patrick, D. L., Burke, L. B., Powers, J. H., Scott, J. A., Rock, E. P., Dawisha, S., et al. (2007). Patient-reported outcomes to support medical product labeling claims: FDA perspective. Value Health, 10, S125–S137.CrossRefPubMed
5.
go back to reference Dubois, D. J. (2010). Grand challenges in pharmacoeconomics and health outcomes. Frontiers in Pharmacology, 1(7), 1–2. Dubois, D. J. (2010). Grand challenges in pharmacoeconomics and health outcomes. Frontiers in Pharmacology, 1(7), 1–2.
8.
go back to reference Coons, S. J., Kothari, S., Monz, B. U., & Burke, L. B. (2011). The patient-reported outcome (PRO) consortium: Filling measurement gaps for PRO end points to support labeling claims. Clinical Pharmacology and Therapeutics, 90(5), 743–748.CrossRefPubMed Coons, S. J., Kothari, S., Monz, B. U., & Burke, L. B. (2011). The patient-reported outcome (PRO) consortium: Filling measurement gaps for PRO end points to support labeling claims. Clinical Pharmacology and Therapeutics, 90(5), 743–748.CrossRefPubMed
9.
go back to reference Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54(2), 92–105.CrossRef Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54(2), 92–105.CrossRef
10.
go back to reference Streiner, D. L., & Norman, G. R. (2008). Health measurement scales: A practical guide to their development and use (4th ed.). New York, USA: Oxford University Press.CrossRef Streiner, D. L., & Norman, G. R. (2008). Health measurement scales: A practical guide to their development and use (4th ed.). New York, USA: Oxford University Press.CrossRef
11.
go back to reference Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677–680.CrossRef Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103, 677–680.CrossRef
12.
go back to reference DeWalt, D. A., Rothrock, N., Yount, S., Stone, A. A., & on behalf of the PROMIS Cooperative Group. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Supplement 1), S12–S21.CrossRefPubMedPubMedCentral DeWalt, D. A., Rothrock, N., Yount, S., Stone, A. A., & on behalf of the PROMIS Cooperative Group. (2007). Evaluation of item candidates: The PROMIS qualitative item review. Medical Care, 45(5 Supplement 1), S12–S21.CrossRefPubMedPubMedCentral
14.
go back to reference Coons, S. J., Gwaltney, C. J., Hays, R. D., Lundy, J. J., Sloan, J. A., Revicki, D. A., et al. (2009). Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good research practices task force report. Value in Health, 12(4), 419–429.CrossRefPubMed Coons, S. J., Gwaltney, C. J., Hays, R. D., Lundy, J. J., Sloan, J. A., Revicki, D. A., et al. (2009). Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good research practices task force report. Value in Health, 12(4), 419–429.CrossRefPubMed
16.
go back to reference Lehmann, E. L. (2006). Nonparametrics: Statistical methods based on ranks. New York: Springer. Lehmann, E. L. (2006). Nonparametrics: Statistical methods based on ranks. New York: Springer.
17.
go back to reference Press, W. H., Teukolsky, S. A., Vetterling, W. T., Flannery, B. P. (2007). Numerical recipes. The art of scientific computing. (3rd ed.). Hong Kong: Cambridge University Press. ISBN: 0521880688. Press, W. H., Teukolsky, S. A., Vetterling, W. T., Flannery, B. P. (2007). Numerical recipes. The art of scientific computing. (3rd ed.). Hong Kong: Cambridge University Press. ISBN: 0521880688.
18.
go back to reference Fullerton, A. S. (2009). A conceptual framework for ordered logistic regression models. Sociological Methods Research, 38(2), 306–347.CrossRef Fullerton, A. S. (2009). A conceptual framework for ordered logistic regression models. Sociological Methods Research, 38(2), 306–347.CrossRef
20.
go back to reference Knutsson, I., Rydstrom, H., Reimer, J., Nyberg, P., Hagell, P. (2010). Interpretation of response categories in patient-reported rating scales: A controlled study among people with Parkinson’s disease. Health and Quality of Life Outcomes, 8, 61. http://www.hqlo.com/content/8/1/61. Knutsson, I., Rydstrom, H., Reimer, J., Nyberg, P., Hagell, P. (2010). Interpretation of response categories in patient-reported rating scales: A controlled study among people with Parkinson’s disease. Health and Quality of Life Outcomes, 8, 61. http://​www.​hqlo.​com/​content/​8/​1/​61.
21.
go back to reference Rennie, L. J. (1982). Detecting a response set to likert-style attitude items with the rating model. Educational Research and Perspectives, 9(1), 114–118. Rennie, L. J. (1982). Detecting a response set to likert-style attitude items with the rating model. Educational Research and Perspectives, 9(1), 114–118.
22.
go back to reference Maxwell, S., & Delaney, H. (1985). Measurement and statistics: An examination of construct validity. Psychological Bulletin, 97, 85–93.CrossRef Maxwell, S., & Delaney, H. (1985). Measurement and statistics: An examination of construct validity. Psychological Bulletin, 97, 85–93.CrossRef
23.
go back to reference Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
24.
go back to reference Schaeffer, N. C. (1991). Hardly ever or constantly? group comparisons using vague qualifier. The Public Opinion Quarterly, 55(3), 395–423.CrossRef Schaeffer, N. C. (1991). Hardly ever or constantly? group comparisons using vague qualifier. The Public Opinion Quarterly, 55(3), 395–423.CrossRef
25.
go back to reference Borgers, N., Hox, J., & Sikkel, D. (2003). Response quality in survey research with children and adolescents: The effects of the labeled response options and vague quantifiers. International Journal of Public Opinion Research, 15(1), 83–94.CrossRef Borgers, N., Hox, J., & Sikkel, D. (2003). Response quality in survey research with children and adolescents: The effects of the labeled response options and vague quantifiers. International Journal of Public Opinion Research, 15(1), 83–94.CrossRef
26.
27.
go back to reference Simpson, R. H. (1944). The specific meaning of certain terms indicating differing degrees of frequency. Quarterly Journal of Speech, 30, 328–330.CrossRef Simpson, R. H. (1944). The specific meaning of certain terms indicating differing degrees of frequency. Quarterly Journal of Speech, 30, 328–330.CrossRef
28.
go back to reference Bradburn, N. M., & Miles, C. (1979). Vague quantifiers. Public Opinion Quarterly, 43(1), 92–101.CrossRef Bradburn, N. M., & Miles, C. (1979). Vague quantifiers. Public Opinion Quarterly, 43(1), 92–101.CrossRef
29.
go back to reference Wright, D. B., Gaskell, G. D., & O’Muircheartaigh, C. A. (1994). How much is ‘Quite a bit’? mapping between numerical values and vague quantifiers. Applied Cognitive Psychology, 8, 479–496.CrossRef Wright, D. B., Gaskell, G. D., & O’Muircheartaigh, C. A. (1994). How much is ‘Quite a bit’? mapping between numerical values and vague quantifiers. Applied Cognitive Psychology, 8, 479–496.CrossRef
30.
go back to reference Wanke, M. (2002). Conversational norms and the interpretation of vague quantifiers. Applied Cognitive Psychology, 16, 301–307.CrossRef Wanke, M. (2002). Conversational norms and the interpretation of vague quantifiers. Applied Cognitive Psychology, 16, 301–307.CrossRef
31.
go back to reference Pepper, S., & Prytulak, L. S. (1974). Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressions. Journal of Research in Personality, 8, 95–101.CrossRef Pepper, S., & Prytulak, L. S. (1974). Sometimes frequently means seldom: Context effects in the interpretation of quantitative expressions. Journal of Research in Personality, 8, 95–101.CrossRef
32.
go back to reference Pohl, N. F. (1981). Scale considerations in using vague quantifiers. Journal of Experimental Education, 49(4), 235–240.CrossRef Pohl, N. F. (1981). Scale considerations in using vague quantifiers. Journal of Experimental Education, 49(4), 235–240.CrossRef
34.
go back to reference Srivastava, V. K., & Giles, D. E. A. (1987). Seemingly unrelated regression equations models. New York: Marcel Dekker. Srivastava, V. K., & Giles, D. E. A. (1987). Seemingly unrelated regression equations models. New York: Marcel Dekker.
Metagegevens
Titel
Interpretation of verbal descriptors for response options commonly used in verbal rating scales in patient-reported outcome instruments
Auteurs
Alex Mutebi
Marion Slack
Terri L. Warholak
Stacie Hudgens
Stephen Joel Coons
Publicatiedatum
13-06-2016
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 12/2016
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-016-1333-3

Andere artikelen Uitgave 12/2016

Quality of Life Research 12/2016 Naar de uitgave