Skip to main content
Top
Gepubliceerd in: Quality of Life Research 5/2023

22-09-2022 | Special Section: Methodologies for Meaningful Change

Comparison of raw and regression approaches to capturing change on patient-reported outcome measures

Auteurs: David A. Andrae, Brandon Foster, J. Devin Peipert

Gepubliceerd in: Quality of Life Research | Uitgave 5/2023

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Patient-reported outcome (PRO) analyses often involve calculating raw change scores, but limitations of this approach are well documented. Regression estimators can incorporate information about measurement error and potential covariates, potentially improving change estimates. Yet, adoption of these regression-based change estimators is rare in clinical PRO research.

Methods

Both simulated and PROMIS® pain interference items were used to calculate change employing three methods: raw change scores and regression estimators proposed by Lord and Novick (LN) and Cronbach and Furby (CF). In the simulated data, estimators’ ability to recover true change was compared. Standard errors of measurement (SEM) and estimation (SEE) with associated 95% confidence limits were also used to identify criteria for significant improvement. These methods were then applied to real-world data from the PROMIS® study.

Results

In the simulation, both regression estimators reduced variability compared to raw change scores by almost half. Compared to CF, the LN regression better recovered true simulated differences. Analysis of the PROMIS® data showed similar themes, and change score distributions from the regression estimators showed less dispersion. Using distribution-based approaches to calculate thresholds for significant within-patient change, smaller changes could be detected using both regression estimators.

Conclusions

These results suggest that calculating change using regression estimates may result in more increased measurement sensitivity. Using these scores in lieu of raw differences can help better identify individuals who experience real underlying change in PROs in the course of a trial, and enhance the established methods for identifying thresholds for meaningful within-patient change in PROs.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
2.
go back to reference Coon, C. D., & Cook, K. F. (2018). Moving from significance to real-world meaning: Methods for interpreting change in clinical outcome assessment scores. Quality of Life Research, 27, 33–40.CrossRefPubMed Coon, C. D., & Cook, K. F. (2018). Moving from significance to real-world meaning: Methods for interpreting change in clinical outcome assessment scores. Quality of Life Research, 27, 33–40.CrossRefPubMed
3.
go back to reference US Food and Drug Administration. (2018). Patient-Focused Drug Development Guidance Public Workshop: Methods to identify what is important to patients select, develop or modify fit-for-purpose clinical outcomes assessments. US Food and Drug Administration. (2018). Patient-Focused Drug Development Guidance Public Workshop: Methods to identify what is important to patients select, develop or modify fit-for-purpose clinical outcomes assessments.
4.
go back to reference Kim-Kang, G., & Weiss, D. J. (2008). Adaptive measurement of individual change. Zeitschrift für Psychologie / Journal of Psychology, 216, 49–58.CrossRef Kim-Kang, G., & Weiss, D. J. (2008). Adaptive measurement of individual change. Zeitschrift für Psychologie / Journal of Psychology, 216, 49–58.CrossRef
5.
go back to reference Lord, F. M. (1958). Further problems in the measurement of growth. Educational and Psychological Measurement, 18, 437–451.CrossRef Lord, F. M. (1958). Further problems in the measurement of growth. Educational and Psychological Measurement, 18, 437–451.CrossRef
6.
go back to reference Lord, F. M. (1956). The measurement of growth. ETS Res Bull Ser, 1956, i–22. Lord, F. M. (1956). The measurement of growth. ETS Res Bull Ser, 1956, i–22.
7.
go back to reference McNemar, Q. (1958). On growth measurement. Educational and Psychological Measurement, 18, 47–55.CrossRef McNemar, Q. (1958). On growth measurement. Educational and Psychological Measurement, 18, 47–55.CrossRef
8.
go back to reference Cronbach, L. J., & Furby, L. (1970). How we should measure change–or should we? Psychological Bulletin, 74, 68–80.CrossRef Cronbach, L. J., & Furby, L. (1970). How we should measure change–or should we? Psychological Bulletin, 74, 68–80.CrossRef
9.
go back to reference Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley Pub Co, Reading. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley Pub Co, Reading.
11.
go back to reference Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., Dewalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J. S., Pilkonis, P., Revicki, D., … Hays, R. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63, 1179–1194. https://doi.org/10.1016/j.jclinepi.2010.04.011CrossRefPubMedPubMedCentral Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., Cook, K., Devellis, R., Dewalt, D., Fries, J. F., Gershon, R., Hahn, E. A., Lai, J. S., Pilkonis, P., Revicki, D., … Hays, R. (2010). The patient-reported outcomes measurement information system (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005–2008. Journal of Clinical Epidemiology, 63, 1179–1194. https://​doi.​org/​10.​1016/​j.​jclinepi.​2010.​04.​011CrossRefPubMedPubMedCentral
12.
go back to reference Segawa, E., Schalet, B., & Cella, D. (2020). A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile. Quality of Life Research, 29, 213–221.CrossRefPubMed Segawa, E., Schalet, B., & Cella, D. (2020). A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile. Quality of Life Research, 29, 213–221.CrossRefPubMed
14.
go back to reference Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., Cella, D., Rothrock, N., Keefe, F., Callahan, L., & Lai, J.-S. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150, 173–182.CrossRefPubMedPubMedCentral Amtmann, D., Cook, K. F., Jensen, M. P., Chen, W.-H., Choi, S., Revicki, D., Cella, D., Rothrock, N., Keefe, F., Callahan, L., & Lai, J.-S. (2010). Development of a PROMIS item bank to measure pain interference. Pain, 150, 173–182.CrossRefPubMedPubMedCentral
15.
go back to reference Samejima, F. (1994). Estimation of reliability coefficients using the test information function and its modifications. Applied Psychological Measurement, 18, 229–244.CrossRef Samejima, F. (1994). Estimation of reliability coefficients using the test information function and its modifications. Applied Psychological Measurement, 18, 229–244.CrossRef
18.
go back to reference der Elst, W., Molenberghs, G., Hilgers, RD., Verbeke, G., Heussen, N. (2019). CorrMixed: Estimate Correlations Between Repeatedly Measured Endpoints (Eg, Reliability) Based on Linear Mixed-Effects Models. R package version 1.0 der Elst, W., Molenberghs, G., Hilgers, RD., Verbeke, G., Heussen, N. (2019). CorrMixed: Estimate Correlations Between Repeatedly Measured Endpoints (Eg, Reliability) Based on Linear Mixed-Effects Models. R package version 1.0
20.
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioral science (2nd ed.). Taylor & Francis Group. Cohen, J. (1988). Statistical power analysis for the behavioral science (2nd ed.). Taylor & Francis Group.
Metagegevens
Titel
Comparison of raw and regression approaches to capturing change on patient-reported outcome measures
Auteurs
David A. Andrae
Brandon Foster
J. Devin Peipert
Publicatiedatum
22-09-2022
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 5/2023
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-022-03196-x

Andere artikelen Uitgave 5/2023

Quality of Life Research 5/2023 Naar de uitgave