Top

Gepubliceerd in:

15-06-2021 | Commentary

Between-group minimally important change versus individual treatment responders

Auteurs: Ron D. Hays, John Devin Peipert

Gepubliceerd in: Quality of Life Research | Uitgave 10/2021

Abstract

Purpose

Estimates of the minimally important change (MIC) can be used to evaluate whether group-level differences are large enough to be important. But responders to treatment have been based upon group-level MIC thresholds, resulting in inaccurate classification of change over time. This article reviews options and provides suggestions about individual-level statistics to assess whether individuals have improved, stayed the same, or declined.

Methods

Review of MIC estimation and an example of misapplication of MIC group-level estimates to assess individual change. Secondary data analysis to show how perceptions about meaningful change can be used along with significance of individual change.

Results

MIC thresholds yield over-optimistic conclusions about responders to treatment because they classify those who have not changed as responders.

Conclusions

Future studies need to evaluate the significance of individual change using appropriate individual-level statistics such as the reliable change index or the equivalent coefficient of repeatability. Supplementing individual statistical significance with retrospective assessments of change is desirable.

vorige artikel Triangulation of multiple meaningful change thresholds for patient-reported outcome scores

volgende artikel Assessing baseline dependency of anchor-based minimal important change (MIC): don’t stratify on the baseline score!

FDA. (2018). Patient-focused drug development guidance public workshop. Methods to identify what is important to patients and select, develop or modify fit-for-purpose clinical outcomes assessments. https://www.fda.gov/media/116277/download. Accessed 4 Nov 2020

Coon, C. D., & Cook, K. F. (2018). Moving from significance to real-world meaning: methods for interpreting change in clinical outcome assessment scores. Quality of Life Research, 27(1), 33–40. https://doi.org/10.1007/s11136-017-1616-3CrossRefPubMed

Schwartz, N., & Sudman, S. (1994). Autobiographical memory and the validity of retrospective reports. New York: Springer-Verlag.CrossRef

Norman, G. R., Stratford, P., & Regehr, G. (1997). Methodological problems in the retrospective computation of responsiveness to change: The lesson of Cronbach. Journal of Clinical Epidemiology, 50(8), 869–879. https://doi.org/10.1016/S0895-4356(97)00097-8CrossRefPubMed

Hays, R. D., & Reeve, B. B. (2010). Measurement and modeling of health-related quality of life. In J. Killewo, H. K. Heggenhougen, & S. R. Quah (Eds.), Epidemiology and demography in public health (pp. 195–205). Netherlands: Elsevier.

Yuan, L., Zeng, Y., Chen, Z., Li, W., Zhang, X., & Ni, J. (2020). Risk factors associated with failure to reach minimal clinically important difference after correction surgery in patients with degenerative lumbar scoliosis. Spine, 45(24), E1669–E1676. https://doi.org/10.1097/BRS.0000000000003713CrossRefPubMed

Dutmer, A. L., Reneman, M. F., Schiphorst Preuper, H. R., Wolff, A. P., Speijer, B. L., & Soer, R. (2019). The NIH minimal dataset for chronic low back pain: Responsiveness and minimal clinically important change. Spine, 44(20), E1211–E1218. https://doi.org/10.1097/BRS.0000000000003107CrossRefPubMedPubMedCentral

Borckardt, J. J., Nash, M. R., Murphy, M. D., Moore, M., Shaw, D., & O’Neil, P. (2008). Clinical practice as natural laboratory for psychotherapy research: A guide to case-based time series analysis. American Psychologist, 63(2), 77–95. https://doi.org/10.1037/0003-066X.63.2.77CrossRefPubMed

Moinpour, C. M., Donaldson, G. W., et al. (2017). The challenge of measuring intra-individual change in fatigue during cancer treatment. Quality of Life Research, 26(2), 259–271. https://doi.org/10.1007/s11136-016-1372-9CrossRefPubMed

10.

Hays, R. D., Brodsky, M., Johnson, M. F., Spritzer, K. L., & Hui, K. K. (2005). Evaluating the statistical significance of health-related quality of life change in individual patients. Evaluation and the Health Professions, 28(2), 160–171. https://doi.org/10.1177/0163278705275339CrossRefPubMed

11.

Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. https://doi.org/10.1093/arclin/acr120CrossRefPubMedPubMedCentral

12.

Bruggemans, E. F., Van de Vijver, F. J., & Huysmans, H. A. (1997). Assessment of cognitive deterioration in individual patients following cardiac surgery: Correcting for measurement error and practice effects. Journal of Clinical and Experimental Neuropsychology, 19(4), 543–559. https://doi.org/10.1080/01688639708403743CrossRefPubMed

13.

Maassen, G. H. (2000). Principles of defining reliable change indices. Journal of Clinical and Experimental Neuropsychology, 22(5), 622–632. https://doi.org/10.1076/1380-3395(200010)22:5;1-9;FT622CrossRefPubMed

14.

Jabrayilov, R., Emons, W. H. M., & Sijtsma, K. (2016). Comparison of classical test theory and item response theory in individual change assessment. Applied Psychological Measurement, 40(8), 559–572. https://doi.org/10.1177/0146621616664046CrossRefPubMedPubMedCentral

15.

Brouwer, D., Meijer, R. R., & Zevalkink, J. (2013). Measuring individual significant change on the beck depression inventory-II through IRT-based statistics. Psychotherapy Research, 23(5), 489–501. https://doi.org/10.1002/mpr.1496CrossRefPubMed

16.

Terwee, C. B., Terluin, B., Knol, D. L., & de Vet, H. C. W. (2011). Combining clinical relevance and statistical significance for evaluating quality of life changes in the individual patient. Journal of Clinical Epidemiology, 64(12), 1465–1467. https://doi.org/10.1016/j.jclinepi.2011.06.015CrossRefPubMed

17.

Ingelsrud, L. H., Roos, E. M., Terluin, B., Gromov, K., Husted, H., & Troelsen, A. (2018). Minimal important change values for the Oxford knee score and the forgotten joint score at 1 year after total knee replacement. Acta Orthopaedica, 89(5), 541–547. https://doi.org/10.1080/17453674.2018.1480739.CrossRefPubMedPubMedCentral

18.

Terluin, B., Eekhout, I., & Terwee, C. B. (2017). The anchor-based minimal important change, based on receiver operating characteristic analysis or predictive modeling, may need to be adjusted for the proportion of improved patients. Journal of Clinical Epidemiology, 83, 90–100. https://doi.org/10.1016/j.jclinepi.2016.12.015CrossRefPubMed

19.

Lord, F. M. (1963). Elementary models for measuring change. In C. W. Harris (Ed.), Problems in measuring change.Madison: University of Wisconsin Press.

20.

Donaldson, G. (2008). Patient-reported outcomes and the mandate of measurement. Quality of Life Research, 17(10), 1303–1313. https://doi.org/10.1007/s11136-008-9408-4CrossRefPubMed

21.

Kemmler, G., Zabernigg, A., Gattringer, K., Rumpold, G., Giesinger, J., Sperner-Unterweger, B., et al. (2010). A new approach to combining clinical relevance and statistical significance for evaluation of quality of life changes in the individual patient. Journal of Clinical Epidemiology, 63(2), 171–179. https://doi.org/10.1016/j.jclinepi.2009.03.016CrossRefPubMed

22.

Abu, H. O., Saczynski, J. S., Mehawej, J., Tisminetzky, M., Kiefe, C. I., Goldberg, R. J., et al. (2020). Clinically meaningful change in quality of life and associated factors among older patients with atrial fibrillation. Journal of the American Heart Association, 9(18), e016651. https://doi.org/10.1161/JAHA.120.016651CrossRefPubMedPubMedCentral

23.

Spertus, J., Dorian, P., Bubien, R., Lewis, S., Godejohn, D., Reynolds, M. R., et al. (2011). Development and validation of the Atrial fibrillation effect on QualiTy-of-Life (AFEQT) questionnaire in patients with atrial fibrillation. Circulation Arrhythmia and Electrophysiology, 4(1), 15–25. https://doi.org/10.1161/CIRCEP.110.958033CrossRefPubMed

24.

McElvaney, O. J., Hobbs, B. D., Qiao, D., McElvaney, O. F., Moll, M., McEvoy, N. L., et al. (2020). A linear prognostic score based on the ratio of interleukin-6 to interleukin-10 predicts outcomes in COVID-19. eBioMedicine, 61, 103026. https://doi.org/10.1016/j.ebiom.2020.103026CrossRefPubMedPubMedCentral

25.

King, M. T., Dueck, A. C., & Revicki, D. A. (2019). Can methods developed for interpreting group-level patient-reported outcome data be applied to individual patient management? Medical Care, 57(Suppl 51), S38–S45. https://doi.org/10.1097/MLR.0000000000001111CrossRefPubMedPubMedCentral

26.

Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037//0022-006x.59.1.12CrossRefPubMed

27.

Sil, S., Arnold, L. M., Lynch-Jordan, A., et al. (2014). Identifying treatment responders and predictors of improvement after cognitive-behavioral therapy for juvenile fibromyalgia. Pain, 155(7), 1206–1212. https://doi.org/10.1016/j.pain.2014.03.005CrossRefPubMedPubMedCentral

28.

Goertz, C. M., Long, C. R., Vining, R. D., Pohlam, K. A., Kane, B., Corber, L., et al. (2016). Assessment of chiropractic treatment for active duty, U.S. military personnel with low back pain: Study protocol for a randomized controlled trial. Trials, 17, 70. https://doi.org/10.1186/s13063-016-1193-8CrossRefPubMedPubMedCentral

29.

Deyo, R. A., Dworkin, S. F., Amtmann, D., et al. (2014). Report of the NIH Task Force on research standards for chronic low back pain. Pain Medicine, 15(6), 569–585. https://doi.org/10.1016/j.jpain.2014.03.005CrossRef

30.

de Vet, H. C. W., Terwee, C. B., Knol, D. L., & Bouter, L. M. (2006). When to use agreement versus reliability measures. Journal of Clinical Epidemiology, 59(10), 1033–1039. https://doi.org/10.1016/j.jclinepi.2005.10.015CrossRefPubMed

31.

Reeve, B. B., Wyrwich, K. W., Wu, A. W., Velikova, G., Terwee, C. B., Synder, C., et al. (2013). ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Quality of Life Research, 22(8), 1889–1905. https://doi.org/10.1007/s11136-012-0344-yCrossRefPubMed

32.

Youden, W. J. (1950). Index for rating diagnostic tests. Cancer, 3, 32–35.CrossRefPubMed

33.

Yuksel, S., Ayhan, S., Nabiyev, V., Domingo-Sabat, M., Vila-Casademunt, A., Obeid, I., et al. (2019). Minimum clinically important difference of the health-related quality of life scales in adult’s deformity calculated by latent class analysis: Is it appropriate to use the same values for surgical and nonsurgical patients? The Spine Journal, 19(1), 71–78. https://doi.org/10.1016/j.spinee.2018.07.005CrossRefPubMed

34.

Hays, R. D., Spritzer, K. L., & Reise, S. P. (in press). Using item response theory to identify responders to treatment: Examples with the patient-reported outcomes measurement information system (PROMIS®) physical functioning and emotional distress scales. Psychometrika

35.

De Vries, R., Meijer, R. R., Van Bruggen, V., & Morey, R. D. (2016). Improving the analysis of routine outcome measurement data: What a Bayesian approach can do for you. International Journal of Methods in Psychiatric Research, 25(3), 155–167. https://doi.org/10.1002/mpr.1496CrossRefPubMed

36.

Guyatt, G., Walter, S., & Norman, G. (1987). Measuring change over time: Assessing the usefulness of evaluative instruments. Journal of Chronic Diseases, 40, 171–178.CrossRefPubMed

Titel: Between-group minimally important change versus individual treatment responders
Auteurs: Ron D. Hays
John Devin Peipert
Publicatiedatum: 15-06-2021
Uitgeverij: Springer International Publishing
Gepubliceerd in: Quality of Life Research / Uitgave 10/2021
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI: https://doi.org/10.1007/s11136-021-02897-z

Andere artikelen Uitgave 10/2021

The impact of lockdown during the COVID-19 pandemic on mental and social health of children and adolescents

Open Access

Minimal important change (MIC): a conceptual clarification and systematic review of MIC estimates of PROMIS measures

Open Access
Review

Measuring capability wellbeing in adults at different stages of life for use in economic evaluation of health and care interventions: a qualitative investigation in people requiring kidney care

Open Access

Quality of life and occupational performance of children with cancer in the era of the COVID-19 pandemic in terms of rehabilitation

FABry Disease Patient-Reported Outcome-GastroIntestinal (FABPRO-GI): A new Fabry disease-specific gastrointestinal outcomes instrument

Open Access

Bohn Stafleu van Loghum

Between-group minimally important change versus individual treatment responders

Abstract

Purpose

Methods

Results

Conclusions

Andere artikelen Uitgave 10/2021

The impact of lockdown during the COVID-19 pandemic on mental and social health of children and adolescents

Minimal important change (MIC): a conceptual clarification and systematic review of MIC estimates of PROMIS measures

Measuring capability wellbeing in adults at different stages of life for use in economic evaluation of health and care interventions: a qualitative investigation in people requiring kidney care

Quality of life and occupational performance of children with cancer in the era of the COVID-19 pandemic in terms of rehabilitation

FABry Disease Patient-Reported Outcome-GastroIntestinal (FABPRO-GI): A new Fabry disease-specific gastrointestinal outcomes instrument

Health-related quality of life after first-ever acute ischemic stroke: associations with cardiovascular health metrics

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Purpose

Methods

Results

Conclusions

Log in om toegang te krijgen

The impact of lockdown during the COVID-19 pandemic on mental and social health of children and adolescents

Minimal important change (MIC): a conceptual clarification and systematic review of MIC estimates of PROMIS measures

Measuring capability wellbeing in adults at different stages of life for use in economic evaluation of health and care interventions: a qualitative investigation in people requiring kidney care

Quality of life and occupational performance of children with cancer in the era of the COVID-19 pandemic in terms of rehabilitation

FABry Disease Patient-Reported Outcome-GastroIntestinal (FABPRO-GI): A new Fabry disease-specific gastrointestinal outcomes instrument

Health-related quality of life after first-ever acute ischemic stroke: associations with cardiovascular health metrics