Skip to main content
Top
Gepubliceerd in: Quality of Life Research 4/2013

01-05-2013

Relative importance measures for reprioritization response shift

Auteurs: Lisa M. Lix, Tolulope T. Sajobi, Richard Sawatzky, Juxin Liu, Nancy E. Mayo, Yuhui Huang, Lesley A. Graff, John R. Walker, Jason Ediger, Ian Clara, Kathryn Sexton, Rachel Carr, Charles N. Bernstein

Gepubliceerd in: Quality of Life Research | Uitgave 4/2013

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Response shift (RS), a change in the meaning of an individual’s self-evaluation of a target construct, such as health-related quality of life (HRQOL), can affect the interpretation of change in measures of the construct collected over time. This study proposes new statistical methods to test for reprioritization RS, in which the relative importance of HRQOL domains changes over time.

Methods

The methods use descriptive discriminant analysis or logistic regression models and bootstrap inference to test for change in relative importance weights (Method 1) or ranks (Method 2) for discriminating between patient groups at two occasions. The methods are demonstrated using data from the Manitoba Inflammatory Bowel Disease (IBD) Cohort Study (n = 388). Reprioritization of domains from the IBD Questionnaire (IBDQ) and SF-36 was investigated for groups with active and inactive disease symptoms.

Results

The IBDQ bowel symptoms and SF-36 bodily pain domains had the highest ranks for group discrimination. Using Method 1, there was evidence of reprioritization RS in the IBDQ social functioning domain and the SF-36 bodily pain and social functioning domains. Method 2 did not detect change for any of the domains.

Conclusions

Compared to IBD patients without active disease symptoms, those with active symptoms were likely to change the meaning of their self-evaluations of pain and social interactions. Further research is needed to compare these new RS detection methods under a variety of data analytic conditions before recommendations about the optimal method can be made.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
1.
go back to reference Schwartz, C. E., & Sprangers, M. A. G. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine, 48, 1531–1548.PubMedCrossRef Schwartz, C. E., & Sprangers, M. A. G. (1999). Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Social Science and Medicine, 48, 1531–1548.PubMedCrossRef
2.
go back to reference Dempster, M., Carney, R., & McClements, R. (2010). Response shift in the assessment of quality of life among people attending cardiac rehabilitation. British Journal of Health Psychology, 15, 307–319.PubMedCrossRef Dempster, M., Carney, R., & McClements, R. (2010). Response shift in the assessment of quality of life among people attending cardiac rehabilitation. British Journal of Health Psychology, 15, 307–319.PubMedCrossRef
3.
go back to reference Ring, L., Hofer, S., Heuston, F., Harris, D., & O’Boyle, C. A. (2005). Response shift masks the treatment impact on patient reported outcomes (PROs): The example of individual quality of life in edentulous patients. Health and Quality of Life Outcomes, 3, 55.PubMedCrossRef Ring, L., Hofer, S., Heuston, F., Harris, D., & O’Boyle, C. A. (2005). Response shift masks the treatment impact on patient reported outcomes (PROs): The example of individual quality of life in edentulous patients. Health and Quality of Life Outcomes, 3, 55.PubMedCrossRef
4.
go back to reference Razmjou, H., Yee, A., Ford, M., & Finkelsten, J. A. (2006). Response shift in outcome assessment in patients undergoing total knee arthroplasty. Journal of Bone and Joint Surgery, 88, 2590–2595.PubMedCrossRef Razmjou, H., Yee, A., Ford, M., & Finkelsten, J. A. (2006). Response shift in outcome assessment in patients undergoing total knee arthroplasty. Journal of Bone and Joint Surgery, 88, 2590–2595.PubMedCrossRef
5.
go back to reference McPhail, S., Cormans, T., & Haines, T. (2010). Evidence of disagreement between patient-perceived change and conventional longitudinal evaluation of change in health-related quality of life among older adults. Journal of Clinical Rehabilitation, 24, 1036–1044.CrossRef McPhail, S., Cormans, T., & Haines, T. (2010). Evidence of disagreement between patient-perceived change and conventional longitudinal evaluation of change in health-related quality of life among older adults. Journal of Clinical Rehabilitation, 24, 1036–1044.CrossRef
6.
go back to reference Visser, M. R., Oort, J. F., & Sprangers, M. A. (2005). Methods to detect response shift in quality of life data: A convergent validity study. Quality of Life Research, 14, 629–639.PubMedCrossRef Visser, M. R., Oort, J. F., & Sprangers, M. A. (2005). Methods to detect response shift in quality of life data: A convergent validity study. Quality of Life Research, 14, 629–639.PubMedCrossRef
7.
go back to reference McPhail, S., & Haines, T. (2010). Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients. Health and Quality of Life Outcomes, 8, 65.PubMedCrossRef McPhail, S., & Haines, T. (2010). Response shift, recall bias and their effect on measuring change in health-related quality of life amongst older hospital patients. Health and Quality of Life Outcomes, 8, 65.PubMedCrossRef
8.
go back to reference Nolte, S., Elsworth, G. R., Sinclair, A. J., & Osborne, R. H. (2009). Tests of measurement invariance failed to support the application of the “then-test”. Journal of Clinical Epidemiology, 62, 1173–1180.PubMedCrossRef Nolte, S., Elsworth, G. R., Sinclair, A. J., & Osborne, R. H. (2009). Tests of measurement invariance failed to support the application of the “then-test”. Journal of Clinical Epidemiology, 62, 1173–1180.PubMedCrossRef
9.
go back to reference Brossart, D. F., Clay, D. L., & Willson, V. L. (2002). Methodological and statistical considerations for threats to internal validity in pediatric outcome data: Response shift in self-report outcomes. Journal of Pediatric Psychology, 27, 97–107.PubMedCrossRef Brossart, D. F., Clay, D. L., & Willson, V. L. (2002). Methodological and statistical considerations for threats to internal validity in pediatric outcome data: Response shift in self-report outcomes. Journal of Pediatric Psychology, 27, 97–107.PubMedCrossRef
10.
go back to reference Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14, 587–598.PubMedCrossRef Oort, F. J. (2005). Using structural equation modeling to detect response shifts and true change. Quality of Life Research, 14, 587–598.PubMedCrossRef
11.
go back to reference Oort, F. J., Visser, M. R., & Sprangers, M. A. (2005). An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Quality of Life Research, 14, 599–609.PubMedCrossRef Oort, F. J., Visser, M. R., & Sprangers, M. A. (2005). An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Quality of Life Research, 14, 599–609.PubMedCrossRef
12.
go back to reference Barclay-Goddard, R., Lix, L. M., Tate, R., Weinberg, L., & Mayo, N. E. (2009). Response shift was identified over multiple occasions with a structural equation modeling framework. Journal of Clinical Epidemiology, 62, 1181–1188.PubMedCrossRef Barclay-Goddard, R., Lix, L. M., Tate, R., Weinberg, L., & Mayo, N. E. (2009). Response shift was identified over multiple occasions with a structural equation modeling framework. Journal of Clinical Epidemiology, 62, 1181–1188.PubMedCrossRef
13.
go back to reference Lowy, A., & Bernhard, J. (2004). Quantitative assessment of changes in patients’ constructs of quality of life: An application of multilevel models. Quality of Life Research, 13, 1177–1185.PubMedCrossRef Lowy, A., & Bernhard, J. (2004). Quantitative assessment of changes in patients’ constructs of quality of life: An application of multilevel models. Quality of Life Research, 13, 1177–1185.PubMedCrossRef
14.
go back to reference Draper, N. H., & Smith, H. (1998). Applied regression analysis (3rd ed.). New York: Wiley. Draper, N. H., & Smith, H. (1998). Applied regression analysis (3rd ed.). New York: Wiley.
15.
go back to reference Mayo, N. E., Scott, S. C., Dendukuri, N., Ahmed, S., & Wood-Dauphinee, S. (2008). Identifying response shift statistically at the individual level. Quality of Life Research, 17, 627–639.PubMedCrossRef Mayo, N. E., Scott, S. C., Dendukuri, N., Ahmed, S., & Wood-Dauphinee, S. (2008). Identifying response shift statistically at the individual level. Quality of Life Research, 17, 627–639.PubMedCrossRef
16.
go back to reference Huberty, C. J., & Olejnik, S. (2006). Applied MANOVA and discriminant analysis (2nd ed.). New Jersey: Wiley.CrossRef Huberty, C. J., & Olejnik, S. (2006). Applied MANOVA and discriminant analysis (2nd ed.). New Jersey: Wiley.CrossRef
17.
go back to reference Agresti, A. (1996). An introduction to categorical data analysis. New York: Wiley. Agresti, A. (1996). An introduction to categorical data analysis. New York: Wiley.
18.
go back to reference Press, S. J., & Wilson, S. (1978). Choosing between logistic regression and discriminant analysis. Journal of the American Statistical Association, 73, 699–705.CrossRef Press, S. J., & Wilson, S. (1978). Choosing between logistic regression and discriminant analysis. Journal of the American Statistical Association, 73, 699–705.CrossRef
19.
go back to reference Kruskal, W., & Majors, R. (1989). Concepts of relative importance in recent scientific literature. The American Statistician, 43, 2–6. Kruskal, W., & Majors, R. (1989). Concepts of relative importance in recent scientific literature. The American Statistician, 43, 2–6.
20.
go back to reference Johnson, J. W., & Lebreton, J. M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238–257.CrossRef Johnson, J. W., & Lebreton, J. M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238–257.CrossRef
21.
go back to reference Baek, S., Moon, H., Ahn, H., Kodell, R. L., Lin, C.-J., & Chen, J. J. (2008). Identifying high-dimensional biomarkers for personalized medicine via variable importance ranking. Journal of Biopharmaceutical Statistics, 18, 853–868.PubMedCrossRef Baek, S., Moon, H., Ahn, H., Kodell, R. L., Lin, C.-J., & Chen, J. J. (2008). Identifying high-dimensional biomarkers for personalized medicine via variable importance ranking. Journal of Biopharmaceutical Statistics, 18, 853–868.PubMedCrossRef
22.
go back to reference Sajobi, T. T., Lix, L. M., Clara, I., Walker, J., Graff, L. L., Rawsthorne, P., et al. (2011). Measures of relative importance for health-related quality of life. Quality of Life Research, 21, 1–11.PubMedCrossRef Sajobi, T. T., Lix, L. M., Clara, I., Walker, J., Graff, L. L., Rawsthorne, P., et al. (2011). Measures of relative importance for health-related quality of life. Quality of Life Research, 21, 1–11.PubMedCrossRef
23.
go back to reference Huberty, C. J., & Wisenbaker, J. M. (1992). Variable importance in multivariate group comparisons. Journal of Educational Statistics, 17, 75–91.CrossRef Huberty, C. J., & Wisenbaker, J. M. (1992). Variable importance in multivariate group comparisons. Journal of Educational Statistics, 17, 75–91.CrossRef
24.
go back to reference Thomas, D. R., Zumbo, B. D., Zhu, P., & Dutta, S. (2008). On measuring the relative importance of explanatory variables in a logistic regression. Journal of Modern Applied Statistical Methods, 7, 21–38. Thomas, D. R., Zumbo, B. D., Zhu, P., & Dutta, S. (2008). On measuring the relative importance of explanatory variables in a logistic regression. Journal of Modern Applied Statistical Methods, 7, 21–38.
25.
go back to reference Thomas, D. R. (1992). Interpreting discriminant functions: A data analytic approach. Multivariate Behavioral Research, 27, 323–333.CrossRef Thomas, D. R. (1992). Interpreting discriminant functions: A data analytic approach. Multivariate Behavioral Research, 27, 323–333.CrossRef
26.
go back to reference Menard, S. (2004). Six approaches to calculating standardized logistic regression coefficients. The American Statistician, 58, 218–223.CrossRef Menard, S. (2004). Six approaches to calculating standardized logistic regression coefficients. The American Statistician, 58, 218–223.CrossRef
27.
go back to reference Rencher, A. C. (1993). The contribution of individual variables to Hotelling’s T 2, Wilks’ Λ, and R 2. Biometrics, 49, 479–489.PubMedCrossRef Rencher, A. C. (1993). The contribution of individual variables to Hotelling’s T 2, Wilks’ Λ, and R 2. Biometrics, 49, 479–489.PubMedCrossRef
28.
go back to reference Bull, S. B., & Donner, A. (1987). The efficiency of multinomial logistic regression compared with multiple group discriminant analysis. Journal of the American Statistical Association, 82, 1118–1122.CrossRef Bull, S. B., & Donner, A. (1987). The efficiency of multinomial logistic regression compared with multiple group discriminant analysis. Journal of the American Statistical Association, 82, 1118–1122.CrossRef
29.
go back to reference Thomas, D. R., Hughes, E., & Zumbo, B. D. (1998). On variable importance in linear regression. Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 45, 253–275.CrossRef Thomas, D. R., Hughes, E., & Zumbo, B. D. (1998). On variable importance in linear regression. Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 45, 253–275.CrossRef
30.
go back to reference Williams, B. K., & Titus, K. (1998). Assessment of sampling stability in ecological applications of discriminant analysis. Ecology, 69, 1275–1285.CrossRef Williams, B. K., & Titus, K. (1998). Assessment of sampling stability in ecological applications of discriminant analysis. Ecology, 69, 1275–1285.CrossRef
31.
go back to reference Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996). A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology, 49, 1373–1379.PubMedCrossRef Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996). A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology, 49, 1373–1379.PubMedCrossRef
32.
go back to reference Chernick, M. R. (2008). Bootstrap methods: A guide for practitioners and researchers. New Jersey: Wiley. Chernick, M. R. (2008). Bootstrap methods: A guide for practitioners and researchers. New Jersey: Wiley.
33.
go back to reference Dalgleish, L. I. (1994). Discriminant analysis: Statistical inference using the jackknife and bootstrap procedures. Psychological Bulletin, 116, 498–508.CrossRef Dalgleish, L. I. (1994). Discriminant analysis: Statistical inference using the jackknife and bootstrap procedures. Psychological Bulletin, 116, 498–508.CrossRef
34.
go back to reference Walters, S. J., & Campbell, M. J. (2004). The use of bootstrap methods for analysing health-related quality of life outcomes (particularly the SF-36). Health and Quality of Life Outcomes, 2, 70.PubMedCrossRef Walters, S. J., & Campbell, M. J. (2004). The use of bootstrap methods for analysing health-related quality of life outcomes (particularly the SF-36). Health and Quality of Life Outcomes, 2, 70.PubMedCrossRef
35.
go back to reference Dunn, O. J. (1961). Multiple comparisons among means. Journal of the American Statistical Association, 56, 52–64.CrossRef Dunn, O. J. (1961). Multiple comparisons among means. Journal of the American Statistical Association, 56, 52–64.CrossRef
36.
go back to reference Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800–802.CrossRef Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800–802.CrossRef
37.
go back to reference Graff, L. A., Walker, J., Lix, L. M., Clara, I., Rawsthorne, P., Rogala, L., et al. (2006). The relationship of disease type and activity to psychological functioning and quality of life. Clinical Gastroenterology and Hepatology, 4, 1491–1501.PubMedCrossRef Graff, L. A., Walker, J., Lix, L. M., Clara, I., Rawsthorne, P., Rogala, L., et al. (2006). The relationship of disease type and activity to psychological functioning and quality of life. Clinical Gastroenterology and Hepatology, 4, 1491–1501.PubMedCrossRef
38.
go back to reference Lix, L. M., Graff, L. A., Walker, J. R., Clara, I., Rawsthorne, P., Rogala, L., et al. (2008). Longitudinal study of quality of life and psychological functioning for active, fluctuating, and inactive disease patterns in inflammatory bowel disease. Inflammatory Bowel Disease, 14, 1575–1584.CrossRef Lix, L. M., Graff, L. A., Walker, J. R., Clara, I., Rawsthorne, P., Rogala, L., et al. (2008). Longitudinal study of quality of life and psychological functioning for active, fluctuating, and inactive disease patterns in inflammatory bowel disease. Inflammatory Bowel Disease, 14, 1575–1584.CrossRef
39.
go back to reference Clara, I., Lix, L. M., Walker, J. R., Graff, L. A., Miller, N., Rogala, L., et al. (2009). The Manitoba IBD index: Evidence for a new and simple indicator of IBD activity over time. Gastroenterology, 104, 1754–1763. Clara, I., Lix, L. M., Walker, J. R., Graff, L. A., Miller, N., Rogala, L., et al. (2009). The Manitoba IBD index: Evidence for a new and simple indicator of IBD activity over time. Gastroenterology, 104, 1754–1763.
40.
go back to reference Guyatt, G. H., Mitchell, A., Irvine, E. J., Singer, J., Williams, N., Goodacre, R., et al. (1989). A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology, 96, 804–810.PubMed Guyatt, G. H., Mitchell, A., Irvine, E. J., Singer, J., Williams, N., Goodacre, R., et al. (1989). A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology, 96, 804–810.PubMed
41.
go back to reference Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30, 473–483.PubMedCrossRef Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Medical Care, 30, 473–483.PubMedCrossRef
42.
go back to reference Han, S. W., McColl, E., Steen, N., Barton, J. R., & Welfare, M. R. (1998). The inflammatory bowel disease questionnaire: A valid and reliable measure in ulcerative colitis patients in the North East of England. Scandinavian Journal of Gastroenterology, 33, 961–966.PubMedCrossRef Han, S. W., McColl, E., Steen, N., Barton, J. R., & Welfare, M. R. (1998). The inflammatory bowel disease questionnaire: A valid and reliable measure in ulcerative colitis patients in the North East of England. Scandinavian Journal of Gastroenterology, 33, 961–966.PubMedCrossRef
43.
go back to reference Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). SF-36 health survey: Manual and interpretation guide. Boston, MA: New England Medical Center, The Health Institute. Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). SF-36 health survey: Manual and interpretation guide. Boston, MA: New England Medical Center, The Health Institute.
44.
go back to reference Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). New Jersey: Wiley. Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). New Jersey: Wiley.
45.
go back to reference SAS Institute Inc. (2008). SAS/STAT user’s guide, version 9.2. Cary, NC: SAS Institute Inc. SAS Institute Inc. (2008). SAS/STAT user’s guide, version 9.2. Cary, NC: SAS Institute Inc.
46.
go back to reference Westfall, P. H., & Young, S. S. (1993). Resampling-based multiple testing: Examples and methods for p-value adjustment. New York: Wiley. Westfall, P. H., & Young, S. S. (1993). Resampling-based multiple testing: Examples and methods for p-value adjustment. New York: Wiley.
47.
go back to reference Urbakh, V. Y. (1971). Linear discriminant analysis: Loss of discriminating power when a variate is omitted. Biometrics, 27, 531–534.CrossRef Urbakh, V. Y. (1971). Linear discriminant analysis: Loss of discriminating power when a variate is omitted. Biometrics, 27, 531–534.CrossRef
48.
go back to reference Ludbrook, J. (1998). Multiple comparison procedures updated. Clinical and Experimental Pharmacology and Physiology, 25, 1032–1037.PubMedCrossRef Ludbrook, J. (1998). Multiple comparison procedures updated. Clinical and Experimental Pharmacology and Physiology, 25, 1032–1037.PubMedCrossRef
49.
go back to reference Jennrich, R. I. (1977). Stepwise discriminant analysis. In K. Enslein, A. Ralston, & H. S. Wilf (Eds.), Mathematical methods for digital computers (Vol. 3). New York: Wiley. Jennrich, R. I. (1977). Stepwise discriminant analysis. In K. Enslein, A. Ralston, & H. S. Wilf (Eds.), Mathematical methods for digital computers (Vol. 3). New York: Wiley.
50.
go back to reference Thomas, D. R., & Zumbo, B. D. (1996). Using a measure of variable importance to investigate the standardization of discriminant coefficients. Journal of Educational and Behavioral Statistics, 21, 110–130. Thomas, D. R., & Zumbo, B. D. (1996). Using a measure of variable importance to investigate the standardization of discriminant coefficients. Journal of Educational and Behavioral Statistics, 21, 110–130.
51.
go back to reference Razmjou, H., Yee, A., Ford, M., & Finkelstein, J. (2006). Response shift in outcome assessment in patients undergoing total knee arthroplasty. Journal of Bone and Joint Surgery, 88-A, 2590–2595.CrossRef Razmjou, H., Yee, A., Ford, M., & Finkelstein, J. (2006). Response shift in outcome assessment in patients undergoing total knee arthroplasty. Journal of Bone and Joint Surgery, 88-A, 2590–2595.CrossRef
52.
go back to reference Ahmed, S., Mayo, N., Wood-Dauphinee, S., Hanley, J., & Cohen, S. (2004). Response shift influenced estimates of change in health-related quality of life poststroke. Journal of Clinical Epidemiology, 57, 561–570.PubMedCrossRef Ahmed, S., Mayo, N., Wood-Dauphinee, S., Hanley, J., & Cohen, S. (2004). Response shift influenced estimates of change in health-related quality of life poststroke. Journal of Clinical Epidemiology, 57, 561–570.PubMedCrossRef
Metagegevens
Titel
Relative importance measures for reprioritization response shift
Auteurs
Lisa M. Lix
Tolulope T. Sajobi
Richard Sawatzky
Juxin Liu
Nancy E. Mayo
Yuhui Huang
Lesley A. Graff
John R. Walker
Jason Ediger
Ian Clara
Kathryn Sexton
Rachel Carr
Charles N. Bernstein
Publicatiedatum
01-05-2013
Uitgeverij
Springer Netherlands
Gepubliceerd in
Quality of Life Research / Uitgave 4/2013
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-012-0198-3

Andere artikelen Uitgave 4/2013

Quality of Life Research 4/2013 Naar de uitgave