Swipe om te navigeren naar een ander artikel
Response shift methods have developed substantially in the past decade, with a notable emphasis on model-based methods for response shift detection that are appropriate for the analysis of existing data sets. These secondary data analyses have yielded useful insights and motivated the continued growth of response shift methods. However, there are also challenges inherent to the successful use of secondary analysis for response shift detection. Based on our experience with a number of secondary analyses, we propose guidelines for the optimal implementation of secondary analysis for detecting response shift.
We review the definition of response shift and recent advances in response shift theory. We describe current statistical methods that have been developed for or applied to response shift detection. We then discuss lessons learned when using these methods to test specific hypotheses about response shift in existing data and of the features of a data set that could guide early decision-making about undertaking a secondary analysis.
A checklist is provided that includes guidelines for secondary analyses focusing on: (1) selecting an appropriate data set to investigate response shift; (2) prerequisites of data sets and their preparation for analysis; (3) managing missing data; (4) confirming that the data fit the requirements and assumptions of the selected response shift detection technique; (5) model fit evaluation; (6) interpreting results/response shift effect sizes; and (7) comparing findings across methods.
The guidelines-checklist has the potential to stimulate rigorous and replicable research using existing data sets and to assist investigators in assessing the appropriateness and potential of a data set and model-based methods for response shift research.
Log in om toegang te krijgen
Met onderstaand(e) abonnement(en) heeft u direct toegang:
Bernhard, J., Hurny, C., Maibach, R., Herrmann, R., & Laffer, U. (1999). Quality of life as subjective experience: Reframing of perception in patients with colon cancer undergoing radical resection with or without adjuvant chemotherapy. Swiss Group for Clinical Cancer Research (SAKK). Annals of Oncology, 10(7), 775–782. PubMedCrossRef
Ring, L. H. S., Heuston, F., Harris, D., & O’Boyle, C. A. (2005). Response shift masks the treatment impact on patient reported outcomes (PROs): The example of individual quality of life in edentulous patients. Health & Quality of Life Outcomes, 3, 55. CrossRef
Heidrich, S. M., & Ryff, C. D. (1993). The role of social comparisons processes in the psychological adaptation of elderly adults. Journal of Gerontology, 48(3), 127–136. CrossRef
Rijken, M., Komproe, I. H., Ros, W. J. G., Winnubst, J. A. M., & van Heesch, N. C. A. (1995). Subjective well-being of elderly women: Conceptual differences between cancer patients, women suffering from chronic ailments and healthy women. British Journal of Clinical Psychology, 34, 289–300. PubMedCrossRef
Rees, J., MacDonagh, R., Waldron, D., & O’Boyle, C. (2004). Measuring quality of life in patients with advanced cancer. European Journal of Palliative Care, 11(3), 104–106.
Razmjou, H., Yee, A., Ford, M., & Finkelstein, J. A. (2006). Response shift in outcome assessment in patients undergoing total knee arthroplasty. The Journal of Bone and Joint Surgery American, 88(12), 2590–2595. CrossRef
Finkelstein, J. A., Razmjou, H., & Schwartz, C. E. (2009). Response shift and outcome assessment in orthopedic surgery: Is there is a difference between complete vs. partial treatment? Journal of Clinical Epidemiology, 82, 1189–1190. CrossRef
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003). Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Medical Care, 41, 582–592. PubMed
Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979). Internal invalidity in pretest-posttest self-report evaluations and a re-evaluation of retrospective pretests. Applied Psychology Measurement, 3(1), 1–23. CrossRef
Golembiewski, R. T., Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: types of change generated by OD designs. J. Applied Behav. Sci., b 12, 133–157. CrossRef
Sprangers, M., & Hoogstraten, J. (1989). Pretesting effects in retrospective pretest-posttest designs. Journal of Applied Psychology, 74(2), 265–272. CrossRef
Schwartz, C. E., & Rapkin, B. D. (2011). Understanding appraisal processes underlying the thentest: A mixed methods investigation. Quality of Life Research, 21(3), 381–388. doi: 10.1007/s11136-011-0023-4.
Howard, G. S., & Dailey, P. R. (1979). Response shift bias: a source of contamination of self-report measures. Journal of Applied Psychology, 64(2), 144–150. CrossRef
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1993). Classification and regression trees. New York: Chapman & Hall/CRC.
Li, Y., & Schwartz, C. E. (2011). Using classification and regression tree to examine evidence of quality of life response shift in patients with multiple sclerosis. Quality of Life Research, 20(10), 1543–1553.
Boucekine, M., L’Mouaci, R., Flores, P. M., Butzkueven, H., Baumstarck, K., Ghattas, B., et al. (2012). Understanding response shift in multiple sclerosis patients: application of the Random Forest method. [Abstract]. Quality of Life Research, 21(S1), 32–33.
Lix, L. M., Sajobi, T. T., Sawatzky, R., Liu, J., Mayo, N. E., Huang, Y., et al. (2012). Relative importance measures for reprioritization response shift. Quality of Life Research. doi: 10.1007/s11136-012-0198-3.
Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.
Schmitt, N. (1982). The use of analysis of covariance structures to assess beta and gamma change. Multivariate Behavioral Research, 17, 343–358. CrossRef
King-Kallimanis, B. L., Oort, F. J., Nolte, S., Schwartz, C. E., & Sprangers, M. A. (2011). Using structural equation modeling to detect response shift in performance and health-related quality of life scores of multiple sclerosis patients. Quality of Life Research, 20(10), 1527–1540. doi: 10.1007/s11136-010-9844-9. PubMedCrossRef
Ahmed, S., Sawatzky, R., Levesque, J. F., Ehrmann-Feldman, D., & Schwartz, C. E. (2012). Minimal Evidence of Response Shift in the Absence of a Catalyst. Quality of Life Research, 21(Supplement 1), 2–3.
Sawatzky, R., Ratner, P. A., Kopec, J. A., & Zumbo, B. D. (2011). Latent variable mixture models: a promising approach for the validation of patient reported outcomes. Quality of Life Research. doi: 10.1007/s11136-011-9976-6.
Hancock, G. R., & Samuelsen, K. M. (2008). Advances in latent variable mixture models. Charlotte, NC: Information Age Pub.
Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications.
Goodkin, D. E., Reingold, S., Sibley, W., Wolinsky, J., McFarland, H., Cookfair, D., et al. (1999). Guidelines for clinical trials of new therapeutic agents in multiple sclerosis: Reporting extended results from phase III clinical trials. National Multiple Sclerosis Society Advisory Committee on Clinical Trials of New Agents in Multiple Sclerosis. [Practice Guideline]. Annals of Neurology, 46(1), 132–134. PubMedCrossRef
Goodkin, D. E., Ross, J. S., Medendorp, S. V., Konecsni, J., & Rudick, R. A. (1992). Magnetic resonance imaging lesion enlargement in multiple sclerosis. Disease-related activity, chance occurrence, or measurement artifact? [Research Support, Non-U.S. Gov’t]. Archives of Neurology, 49(3), 261–263. PubMedCrossRef
Finkelstein, J. A., Quaranto, B. R., & Schwartz, C. E. (2013). Threats to the internal validity of spinal surgery outcome assessment: Recalibration response shift or implicit theories of change? Applied Quality of Life Research. (in press).
Sawatzky, R., Gadermann, A., Ratner, P. A., Zumbo, B. D., & Lix, L. (2012). Identifying individuals with inflammatory bowel disease who experienced response shift: A latent class analysis? Quality of Life Research, 21(Supplement 1), 33.
Gandhi, P. K., Ried, L. D., Huang, I. C., Kimberlin, C. L., & Kauf, T. L. (2012). Assessment of response shift using two structural equation modeling techniques. Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation. doi: 10.1007/s11136-012-0171-1.
Tabachnick, B. G., & Fidell, L. S. (2013). Assumptions and limitations of multivariate statistical methods. In Using multivariate statistics (6th ed.). Boston: Allyn and Bacon.
Fairclough, D. L. (2010). Design and analysis of quality of life studies in clinical trials (2 ed.). Chapman & Hall/CRC Interdisciplinary Statistics Series). New York: CRC Press, Taylor & Francis Group.
Little, R. J. A., & Rubin, B. D. (2002). Statistical analysis with missing data (2nd ed.). New Jersey: Wiley.
Jackson, D. L. (2003). Revisiting Sample Size and Number of Parameter Estimates: Some Support for the N:q Hypothesis. Structural Equation Modeling: A Multidisciplinary Journal, 10(1), 128–141. CrossRef
Barrett, P. (2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42, 815–824. CrossRef
Shah, R., & Goldstein, S. M. (2006). Use of structural equation modeling in operations management research: Looking back and forward. Journal of Operations Management, 24, 148–169. CrossRef
Muthén, L., & Muthén, B. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599–620. CrossRef
Mayo, N. E., Scott, S. C., & Lix, L. (2012). Caring for a spouse with stroke: True change in QOL and response shift. Quality of Life Research, 21(Supplement 1), 2–3.
Schwartz, C. E., Sajobi, T., Lix, L., Quaranto, B. R., & Finkelstein, J. A. (2013). Changing values, changing outcomes: The influence of reprioritization response shift on outcome assessment after spine surgery. Quality of Life Research, (in press). doi: 10.1007/s11136-013-0377-x.
- Guidelines for secondary analysis in search of response shift
Carolyn E. Schwartz
Mathilde G. E. Verdam
Frans J. Oort
Mirjam A. G. Sprangers
- Springer Netherlands