Skip to main content
Top
Gepubliceerd in: Quality of Life Research 4/2024

31-01-2024

Assessing the interchangeability of linked scores in multivariable statistical analyses

Auteurs: Maxwell Mansolf, Courtney K. Blackwell, David Cella, Jin-Shei Lai

Gepubliceerd in: Quality of Life Research | Uitgave 4/2024

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Using the lens of classical test theory, we examine a linkage’s generalizability with respect to use in multivariable analyses, including multiple regression and structural equation modeling, rather than comparison of established subpopulations as is most common in the literature.

Methods

To aid in this evaluation, we present a structural-equation-modeling based statistical method to examine the suitability of a given linkage for use cases involving continuous and categorical variables external to the linkage itself.

Results

Using the PROMIS® Parent Proxy and Early Childhood Global Health measures, we show that, although a high correlation between the scores (here, r = .829) may imply a general suitability for linking, a more detailed investigation of content, measurement structure, and results of the proposed methodology reveal important differences between the measures which can compromise interchangeability in certain use cases.

Conclusion

In addition to the statistical quality of a linkage, users of linking methodology should also assess the question of whether the linkage is appropriate to apply to particular use cases of interest.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Voetnoten
1
The actual item parameters used for PROMIS scoring are proprietary and could not be included. To obtain these parameters, contact HealthMeasures.net. Perturbation was conducted to mask the actual values by adding noise generated, separately for each item, from a random uniform distribution with limits of − .25 and .25.
 
Literatuur
1.
go back to reference Dorans, N. J., Pommerich, M., & Holland, P. W. (2007). Linking and aligning scores and scales. Springer.CrossRef Dorans, N. J., Pommerich, M., & Holland, P. W. (2007). Linking and aligning scores and scales. Springer.CrossRef
2.
go back to reference Feuer, M. J. (2005). E pluribus Unum: Linking tests and democratic education. Measurement and research in the accountability era (pp. 173–192). Routledge. Feuer, M. J. (2005). E pluribus Unum: Linking tests and democratic education. Measurement and research in the accountability era (pp. 173–192). Routledge.
3.
go back to reference Huggins, A. C., & Penfield, R. D. (2012). An NCME instructional module on population invariance in linking and equating. Educational Measurement: Issues and Practice, 31(1), 27–40.CrossRef Huggins, A. C., & Penfield, R. D. (2012). An NCME instructional module on population invariance in linking and equating. Educational Measurement: Issues and Practice, 31(1), 27–40.CrossRef
4.
5.
go back to reference Choi, S. W., Schalet, B., Cook, K. F., & Cella, D. (2014). Establishing a common metric for depressive symptoms: Linking the BDI, CESD, and PHQ9 to PROMIS depression. Psychological Assessment, 26(2), 513.CrossRefPubMedPubMedCentral Choi, S. W., Schalet, B., Cook, K. F., & Cella, D. (2014). Establishing a common metric for depressive symptoms: Linking the BDI, CESD, and PHQ9 to PROMIS depression. Psychological Assessment, 26(2), 513.CrossRefPubMedPubMedCentral
6.
go back to reference Kaat, A. J., Newcomb, M. E., Ryan, D. T., & Mustanski, B. (2017). Expanding a common metric for depression reporting: Linking two scales to PROMIS® depression. Quality of Life Research, 26(5), 1119–1128.CrossRefPubMed Kaat, A. J., Newcomb, M. E., Ryan, D. T., & Mustanski, B. (2017). Expanding a common metric for depression reporting: Linking two scales to PROMIS® depression. Quality of Life Research, 26(5), 1119–1128.CrossRefPubMed
7.
go back to reference Blackwell, C. K., Tang, X., Elliott, A. J., Thomes, T., Louwagie, H., Gershon, R., & Cella, D. (2021). Developing a common metric for depression across adulthood: Linking PROMIS depression with the Edinburgh Postnatal Depression Scale. Psychological Assessment, 33(7), 610.CrossRefPubMedPubMedCentral Blackwell, C. K., Tang, X., Elliott, A. J., Thomes, T., Louwagie, H., Gershon, R., & Cella, D. (2021). Developing a common metric for depression across adulthood: Linking PROMIS depression with the Edinburgh Postnatal Depression Scale. Psychological Assessment, 33(7), 610.CrossRefPubMedPubMedCentral
8.
go back to reference Holland, P. W. (2007). A framework and history for score linking. Linking and aligning scores and scales (pp. 5–30). Springer.CrossRef Holland, P. W. (2007). A framework and history for score linking. Linking and aligning scores and scales (pp. 5–30). Springer.CrossRef
9.
go back to reference Bentler, P. M. (2017). Specificity-enhanced reliability coefficients. Psychological Methods, 22(3), 527.CrossRefPubMed Bentler, P. M. (2017). Specificity-enhanced reliability coefficients. Psychological Methods, 22(3), 527.CrossRefPubMed
10.
go back to reference Kallen, M. A., Lai, J. S., Blackwell, C. K., Schuchard, J. R., Forrest, C. B., Wakschlag, L. S., & Cella, D. (2022). Measuring PROMIS® global health in early childhood. Journal of Pediatric Psychology, 47(5), 523–533.CrossRefPubMedPubMedCentral Kallen, M. A., Lai, J. S., Blackwell, C. K., Schuchard, J. R., Forrest, C. B., Wakschlag, L. S., & Cella, D. (2022). Measuring PROMIS® global health in early childhood. Journal of Pediatric Psychology, 47(5), 523–533.CrossRefPubMedPubMedCentral
11.
go back to reference Forrest, C. B., Bevans, K. B., Pratiwadi, R., Moon, J., Teneralli, R. E., Minton, J. M., & Tucker, C. A. (2014). Development of the PROMIS® pediatric global health (PGH-7) measure. Quality of Life Research, 23, 1221–1231.CrossRefPubMed Forrest, C. B., Bevans, K. B., Pratiwadi, R., Moon, J., Teneralli, R. E., Minton, J. M., & Tucker, C. A. (2014). Development of the PROMIS® pediatric global health (PGH-7) measure. Quality of Life Research, 23, 1221–1231.CrossRefPubMed
12.
go back to reference Cella, D., Blackwell, C. K., & Wakschlag, L. S. (2022). Bringing PROMIS to early childhood: Introduction and qualitative methods for the development of early childhood parent report instruments. Journal of Pediatric Psychology, 47(5), 500–509.CrossRefPubMedPubMedCentral Cella, D., Blackwell, C. K., & Wakschlag, L. S. (2022). Bringing PROMIS to early childhood: Introduction and qualitative methods for the development of early childhood parent report instruments. Journal of Pediatric Psychology, 47(5), 500–509.CrossRefPubMedPubMedCentral
13.
go back to reference Lai, J.-S., Kallen, M. A., Blackwell, C. K., Wakschlag, L. S., & Cella, D. (2022). Psychometric considerations in developing PROMIS® measures for early childhood. Journal of Pediatric Psychology, 47(5), 510–522.CrossRefPubMedPubMedCentral Lai, J.-S., Kallen, M. A., Blackwell, C. K., Wakschlag, L. S., & Cella, D. (2022). Psychometric considerations in developing PROMIS® measures for early childhood. Journal of Pediatric Psychology, 47(5), 510–522.CrossRefPubMedPubMedCentral
15.
go back to reference R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
16.
go back to reference Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. Proceedings of the fifth Berkeley symposium on mathematical statistics and probability. University of California Press. Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. Proceedings of the fifth Berkeley symposium on mathematical statistics and probability. University of California Press.
19.
go back to reference Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70.CrossRef Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3(1), 4–70.CrossRef
20.
go back to reference Dorans, N. J., & Holland, P. W. (2000). Population invariance and the equitability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37, 281–306.CrossRef Dorans, N. J., & Holland, P. W. (2000). Population invariance and the equitability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37, 281–306.CrossRef
21.
go back to reference Dorans, N. J., & Feigenbaum, M. D. (1994). Equating issues engendered by changes to the new SAT and PSAT/NMSQT. In I. M. Lawrence, N. J. Dorans, M. D. Feigenbaum, N. J. Feryok, A. P. Schmitt, & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT (ETS Research Memorandum No. RM-94-10). Educational Testing Service. Dorans, N. J., & Feigenbaum, M. D. (1994). Equating issues engendered by changes to the new SAT and PSAT/NMSQT. In I. M. Lawrence, N. J. Dorans, M. D. Feigenbaum, N. J. Feryok, A. P. Schmitt, & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT (ETS Research Memorandum No. RM-94-10). Educational Testing Service.
22.
go back to reference Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863.CrossRefPubMedPubMedCentral Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863.CrossRefPubMedPubMedCentral
23.
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge Academic. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge Academic.
Metagegevens
Titel
Assessing the interchangeability of linked scores in multivariable statistical analyses
Auteurs
Maxwell Mansolf
Courtney K. Blackwell
David Cella
Jin-Shei Lai
Publicatiedatum
31-01-2024
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 4/2024
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-023-03592-x

Andere artikelen Uitgave 4/2024

Quality of Life Research 4/2024 Naar de uitgave