ArticleScore comparability of short forms and computerized adaptive testing: simulation study with the activity measure for post-acute care 1☆,
Section snippets
Participants
This study included a sample of 485 participants who were receiving rehabilitation services from 6 health provider networks in the greater Boston area for neurologic (eg, stroke, Parkinson’s disease), orthopedic (eg, hip fracture), or complex medical conditions. Further details of the sample are provided elsewhere on the AM-PAC short forms.15
AM-PAC item pools
Three distinct activity item pools were developed from a combination of new items and items from existing functional instruments currently used in
Score comparability
Correlations between simulated score estimates of the CATs and the total item pools indicate a high degree of correspondence. The 10-item CATs all performed exceedingly well across the 3 activity domains, with an r range of correlations between .96 and .98. The correlations between scores from the 4- to 6-item CATs and the total item pool scores (r) were all greater than or equal to .90. The applied cognition CAT correlations were slightly lower than the physical & mobility and personal care &
Discussion
The results of these simulation analyses suggest that, using the 1-parameter Rasch model to score persons, both the short forms and CAT applications yield good estimates of the underlying functional domain scores with various subsets of the total item pool. The ability of either the short forms or the CAT to perform in this manner, however, depends largely on how well the range of difficulty of the total item pool corresponds to the functioning ability of the sample. As reported previously, the
Conclusions
Score comparability and precision of simulated short forms and CAT applications were compared with scores generated from the entire item pool across 3 domains of functional activities. We demonstrated good to excellent short-form and CAT score comparability with the entire item pool. Short forms were less precise than CATs for estimation of individual scores. Future research should examine how these short forms and CAT programs work in practice to monitor functional recovery over time, in order
Acknowledgements
We thank all the clinical sites who participated in our study: Boston Medical Center, Spaulding Rehabilitation Hospital Network, New England Baptist Hospital, Northeast Rehabilitation Health Network, HealthSouth/New England Rehabilitation Hospital, and Jewish Memorial Hospital and Rehabilitation Center.
References (23)
- et al.
The tools of disability outcomes research functional status measures
Arch Phys Med Rehabil
(2000) - et al.
Short-form Activity Measure for Post-Acute Care
Arch Phys Med Rehabil
(2004) Classifying and reporting functional status
(2002)- et al.
A comparison of functional outcome instruments used in postacute care
Health Care Serv Rev
(2003) - et al.
RRTC for measuring rehabilitation outcomesextending the frontier of rehabilitation outcome measurement and research
J Rehabil Outcome Meas
(2000) Development for MDS-module for postacute care
(1999)- et al.
Clinical program monitoring systemscurrent capability and future directions
- et al.
The use of Rasch analysis to produce scale-free measurement of functional ability
Am J Occup Ther
(1999) - et al.
Outcomes research in medical rehabilitationfoundations from the past and directions for the future
Physical disability construct convergence across instrumentstowards a universal metric
J Outcome Meas
(1997)
Generic health measurementpast accomplishments and a measurement paradigm for the 21st century
Ann Intern Med
Cited by (82)
Test-Retest Reliability and Responsiveness of the Computerized Adaptive Testing System of the Functional Assessment of Stroke
2023, Archives of Physical Medicine and RehabilitationPrognosis of Individual-Level Mobility and Daily Activities Recovery From Acute Care to Community, Part 2: A Proof-of-Concept Single Group Prospective Cohort Study
2023, Archives of Physical Medicine and RehabilitationLong-term functional outcomes after traumatic spine fractures
2022, Surgery (United States)Developing a short-form of the Genetic Counselling Outcome Scale: The Genomics Outcome Scale
2019, European Journal of Medical Genetics
- ☆
Supported in part by the National Institute on Disability and Rehabilitation Research (grant no. H133B990005), the National Institute of Child Health and Human Development (grant no. R01 HD43568), and the Agency for Healthcare Research and Quality. The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the funders.
- 1
No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the author(s) or upon any organization with which the author(s) is/are associated.