Skip to main content
main-content
Top

Tip

Swipe om te navigeren naar een ander artikel

Gepubliceerd in: Quality of Life Research 1/2007

01-08-2007 | Original Paper

The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment

Auteurs: David Cella, Richard Gershon, Jin-Shei Lai, Seung Choi

Gepubliceerd in: Quality of Life Research | bijlage 1/2007

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The use of item banks and computerized adaptive testing (CAT) begins with clear definitions of important outcomes, and references those definitions to specific questions gathered into large and well-studied pools, or “banks” of items. Items can be selected from the bank to form customized short scales, or can be administered in a sequence and length determined by a computer programmed for precision and clinical relevance. Although far from perfect, such item banks can form a common definition and understanding of human symptoms and functional problems such as fatigue, pain, depression, mobility, social function, sensory function, and many other health concepts that we can only measure by asking people directly. The support of the National Institutes of Health (NIH), as witnessed by its cooperative agreement with measurement experts through the NIH Roadmap Initiative known as PROMIS (www.nihpromis.org), is a big step in that direction. Our approach to item banking and CAT is practical; as focused on application as it is on science or theory. From a practical perspective, we frequently must decide whether to re-write and retest an item, add more items to fill gaps (often at the ceiling of the measure), re-test a bank after some modifications, or split up a bank into units that are more unidimensional, yet less clinically relevant or complete. These decisions are not easy, and yet they are rarely unforgiving. We encourage people to build practical tools that are capable of producing multiple short form measures and CAT administrations from common banks, and to further our understanding of these banks with various clinical populations and ages, so that with time the scores that emerge from these many activities begin to have not only a common metric and range, but a shared meaning and understanding across users. In this paper, we provide an overview of item banking and CAT, discuss our approach to item banking and its byproducts, describe testing options, discuss an example of CAT for fatigue, and discuss models for long term sustainability of an entity such as PROMIS. Some barriers to success include limitations in the methods themselves, controversies and disagreements across approaches, and end-user reluctance to move away from the familiar.
Literatuur
1.
go back to reference Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, N.J.: Lawrence Erlbaum Associates. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, N.J.: Lawrence Erlbaum Associates.
2.
go back to reference Lai, J. S., Cella, D., Peterman, A. et al. (2005). Anorexia/cachexia related quality of life for children with cancer: Testing the psychometric properties of the Pediatric Functional Assessment of Anorexia/Cachexia Therapy (peds-FAACT). Cancer, 104(7), 1531–1539. PubMedCrossRef Lai, J. S., Cella, D., Peterman, A. et al. (2005). Anorexia/cachexia related quality of life for children with cancer: Testing the psychometric properties of the Pediatric Functional Assessment of Anorexia/Cachexia Therapy (peds-FAACT). Cancer, 104(7), 1531–1539. PubMedCrossRef
3.
go back to reference Gershon, R., Cella, D., Dineen, K. et al. (2003). Item response theory and health-related quality of life in cancer. Expert Review of Pharmacoeconomics and Outcomes Research, 3(6), 783–791. CrossRef Gershon, R., Cella, D., Dineen, K. et al. (2003). Item response theory and health-related quality of life in cancer. Expert Review of Pharmacoeconomics and Outcomes Research, 3(6), 783–791. CrossRef
4.
go back to reference Gershon, R. (2005). Computerized adaptive testing. Journal of Applied Measurements, 6(1), 109–127. Gershon, R. (2005). Computerized adaptive testing. Journal of Applied Measurements, 6(1), 109–127.
5.
go back to reference Bunderson, V. C., Inouye, D. K., & Olsen, J. B. (1986). The four generations of computerized educational measurement. In R. L. Linn (Ed.), Educational measurement (pp. 367–407). New York: Macmillan Publishing. Bunderson, V. C., Inouye, D. K., & Olsen, J. B. (1986). The four generations of computerized educational measurement. In R. L. Linn (Ed.), Educational measurement (pp. 367–407). New York: Macmillan Publishing.
6.
go back to reference Lautenschlager, G. J., & Flaherty, V. L. (1990). Computer administration of questions: More desirable or more social desirability? Journal of Applied Psychology, 75(3), 310–314. CrossRef Lautenschlager, G. J., & Flaherty, V. L. (1990). Computer administration of questions: More desirable or more social desirability? Journal of Applied Psychology, 75(3), 310–314. CrossRef
7.
go back to reference Reckase, M. D. (1989). Adaptive testing: The evolution of a good idea. Measurement Issues and Practice, 8(3), 11–15. CrossRef Reckase, M. D. (1989). Adaptive testing: The evolution of a good idea. Measurement Issues and Practice, 8(3), 11–15. CrossRef
8.
go back to reference McHorney, C. A., & Cohen, A. S. (2000). Equating health status measures with Item Response Theory: Illustrations with functional status items. Medical Care, 38(Suppl 9), II43–II59. PubMed McHorney, C. A., & Cohen, A. S. (2000). Equating health status measures with Item Response Theory: Illustrations with functional status items. Medical Care, 38(Suppl 9), II43–II59. PubMed
9.
go back to reference Ware, J. E., Bjorner, J. B., & Kosinski, M. (2000). Practical implications of Item Response Theory and computerized adaptive testing: A brief summary of ongoing studies of widely used headache impact scales. Medical Care, 38(Suppl 9), 473–483. Ware, J. E., Bjorner, J. B., & Kosinski, M. (2000). Practical implications of Item Response Theory and computerized adaptive testing: A brief summary of ongoing studies of widely used headache impact scales. Medical Care, 38(Suppl 9), 473–483.
10.
go back to reference Cella, D., & Chang, C. H. (2000). A discussion of Item Response Theory (IRT) and its applications in health status assessment. Medical Care, 38(Suppl 9), II66–II72. PubMed Cella, D., & Chang, C. H. (2000). A discussion of Item Response Theory (IRT) and its applications in health status assessment. Medical Care, 38(Suppl 9), II66–II72. PubMed
11.
go back to reference Wolfe, F., & Pincus, T. (1999). Listening to the patient: A practical guide to self-report questionnaires in clinical care. Arthritis Rheumatism, 42(9), 1797–1808. PubMedCrossRef Wolfe, F., & Pincus, T. (1999). Listening to the patient: A practical guide to self-report questionnaires in clinical care. Arthritis Rheumatism, 42(9), 1797–1808. PubMedCrossRef
12.
go back to reference Detmar, S. B., Muller, M. J., Schornagel, J. H. et al. (2002). Health-related quality-of-life assessments and patient-physician communication: A randomized controlled trial. JAMA, 288(23), 3027–3034. PubMedCrossRef Detmar, S. B., Muller, M. J., Schornagel, J. H. et al. (2002). Health-related quality-of-life assessments and patient-physician communication: A randomized controlled trial. JAMA, 288(23), 3027–3034. PubMedCrossRef
13.
go back to reference Velikova, G., Brown, J., Booth, L., Smith, A., Bown, P., Lynch, P., & Selby, P. (2003). A randomized study of quality of life measurements in oncology practice - effects on patient well-being and process of care. Proceedings of the American society of clinical oncology, 22, 728. Velikova, G., Brown, J., Booth, L., Smith, A., Bown, P., Lynch, P., & Selby, P. (2003). A randomized study of quality of life measurements in oncology practice - effects on patient well-being and process of care. Proceedings of the American society of clinical oncology, 22, 728.
14.
go back to reference Jacobsen, P. B., Davis, K., & Cella, D. (2002). Assessing quality of life in research and clinical practice. Oncology, 16(Suppl 9), 133–139. PubMed Jacobsen, P. B., Davis, K., & Cella, D. (2002). Assessing quality of life in research and clinical practice. Oncology, 16(Suppl 9), 133–139. PubMed
15.
go back to reference Bode, R. K., Cella, D., Lai, J. -S. et al. (2003). Developing an initial physical function item bank from existing sources. Journal of Applied Measurements, 4(2), 124–136. Bode, R. K., Cella, D., Lai, J. -S. et al. (2003). Developing an initial physical function item bank from existing sources. Journal of Applied Measurements, 4(2), 124–136.
16.
go back to reference Bode, R., Lai, J. -S., Heinemann, A. et al. (2006). Expansion of a physical function item bank and development of an abbreviated form for clinical research. Journal of Applied Measurements, 7(1), 1–15. Bode, R., Lai, J. -S., Heinemann, A. et al. (2006). Expansion of a physical function item bank and development of an abbreviated form for clinical research. Journal of Applied Measurements, 7(1), 1–15.
17.
go back to reference Lai, J. -S., Cella, D., Chang, C. -H. et al. (2003). Item banking to improve, shorten and computerize self-reported fatigue: An illustration of steps to create a core item bank from the FACIT-Fatigue Scale. Quality of Life Research, 12, 485–501. PubMedCrossRef Lai, J. -S., Cella, D., Chang, C. -H. et al. (2003). Item banking to improve, shorten and computerize self-reported fatigue: An illustration of steps to create a core item bank from the FACIT-Fatigue Scale. Quality of Life Research, 12, 485–501. PubMedCrossRef
18.
go back to reference Lai, J. -S., Cella, D., Dineen, K. et al. (2005). An item bank was created to improve the measurement of cancer-related fatigue. Journal of Clinical Epidemiology, 58(2), 190–197. PubMedCrossRef Lai, J. -S., Cella, D., Dineen, K. et al. (2005). An item bank was created to improve the measurement of cancer-related fatigue. Journal of Clinical Epidemiology, 58(2), 190–197. PubMedCrossRef
19.
go back to reference Lai, J. -S., Dineen, K., Reeve, B. et al. (2005). An item response theory based pain item bank can enhance measurement precision. Journal of Pain and Symptomology Management, 30(3), 278–288. CrossRef Lai, J. -S., Dineen, K., Reeve, B. et al. (2005). An item response theory based pain item bank can enhance measurement precision. Journal of Pain and Symptomology Management, 30(3), 278–288. CrossRef
20.
go back to reference MSP for Windows (Version 5) [computer program]. (2000). MSP for Windows (Version 5) [computer program]. (2000).
21.
go back to reference Bode, R. K., Lai, J. -S., Cella, D. et al. (2003). Issues in the development of an item bank. Archives of Physical Medicine and Rehabiitation, 84(4 Suppl 2), S52–S60. CrossRef Bode, R. K., Lai, J. -S., Cella, D. et al. (2003). Issues in the development of an item bank. Archives of Physical Medicine and Rehabiitation, 84(4 Suppl 2), S52–S60. CrossRef
22.
go back to reference Carlson, L. E., Speca, M., Hagen, N. et al. (2001). Computerized quality-of-life screening in a cancer pain clinic. Journal of Palliative Care, 17(1), 46–52. PubMed Carlson, L. E., Speca, M., Hagen, N. et al. (2001). Computerized quality-of-life screening in a cancer pain clinic. Journal of Palliative Care, 17(1), 46–52. PubMed
23.
go back to reference Chang, C. H., Cella, D., Fernandez, O. et al. (2002). Quality of life in multiple sclerosis patients in Spain. Multiple Sclerosis, 8(6), 527–531. PubMedCrossRef Chang, C. H., Cella, D., Fernandez, O. et al. (2002). Quality of life in multiple sclerosis patients in Spain. Multiple Sclerosis, 8(6), 527–531. PubMedCrossRef
24.
go back to reference Detmar, S. B., & Aaronson, N. K. (1998). Quality of life assessment in daily clinical oncology practice: A feasibility study. European Journal of Cancer, 34(8), 1181–1186. PubMedCrossRef Detmar, S. B., & Aaronson, N. K. (1998). Quality of life assessment in daily clinical oncology practice: A feasibility study. European Journal of Cancer, 34(8), 1181–1186. PubMedCrossRef
25.
go back to reference Taenzer, P., Bultz, B. D., Carlson, L. E. et al. (2000). Impact of computerized quality of life screening on physician behavior and patient satisfaction in lung cancer outpatients. Psycho-Oncology, 9(3), 203–213. PubMedCrossRef Taenzer, P., Bultz, B. D., Carlson, L. E. et al. (2000). Impact of computerized quality of life screening on physician behavior and patient satisfaction in lung cancer outpatients. Psycho-Oncology, 9(3), 203–213. PubMedCrossRef
26.
go back to reference Velikova, G., Wright, P., Smith, A. B. et al. (2001) Self-reported quality of life of individual cancer patients: Concordance of results with disease course and medical records. Journal of Clinical Oncology, 19(7), 2064–2073. PubMed Velikova, G., Wright, P., Smith, A. B. et al. (2001) Self-reported quality of life of individual cancer patients: Concordance of results with disease course and medical records. Journal of Clinical Oncology, 19(7), 2064–2073. PubMed
27.
go back to reference Velikova, G., Brown, J. M., Smith, A. B. et al. (2002) Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. British Journal of Cancer, 86(1), 51–59. PubMedCrossRef Velikova, G., Brown, J. M., Smith, A. B. et al. (2002) Computer-based quality of life questionnaires may contribute to doctor-patient interactions in oncology. British Journal of Cancer, 86(1), 51–59. PubMedCrossRef
28.
go back to reference Velikova G., Booth L., Smith A. B. et al. (2004). Measuring quality of life in routine oncology practice improves communication and patient well-being: A randomized controlled trial. Journal of Clinical Oncology, 22(4), 714–724. PubMedCrossRef Velikova G., Booth L., Smith A. B. et al. (2004). Measuring quality of life in routine oncology practice improves communication and patient well-being: A randomized controlled trial. Journal of Clinical Oncology, 22(4), 714–724. PubMedCrossRef
29.
go back to reference Yount, S., Davis, K., Cella, D. et al. (2003). Brief patient symptom assessment: Research and clinical applications. To be presented at the 10th World Conference on Lung Cancer. Yount, S., Davis, K., Cella, D. et al. (2003). Brief patient symptom assessment: Research and clinical applications. To be presented at the 10th World Conference on Lung Cancer.
30.
go back to reference Hahn, E. A., Cella, D., Dobrez, D. G. et al. (2003). Quality of life assessment for low literacy Latinos: A new multimedia program for self-administration. Journal of Oncology Management, 12(5), 9–12. PubMed Hahn, E. A., Cella, D., Dobrez, D. G. et al. (2003). Quality of life assessment for low literacy Latinos: A new multimedia program for self-administration. Journal of Oncology Management, 12(5), 9–12. PubMed
31.
go back to reference Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. BMJ, 322(7297), 1297–1300. PubMedCrossRef Higginson, I. J., & Carr, A. J. (2001). Measuring quality of life: Using quality of life measures in the clinical setting. BMJ, 322(7297), 1297–1300. PubMedCrossRef
32.
go back to reference Buxton, J., White, M., & Osoba, D. (1998). Patients’ experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life. Quality of Life Research, 7(6), 513–519. PubMedCrossRef Buxton, J., White, M., & Osoba, D. (1998). Patients’ experiences using a computerized program with a touch-sensitive video monitor for the assessment of health-related quality of life. Quality of Life Research, 7(6), 513–519. PubMedCrossRef
33.
go back to reference Davis, K. M., Chang, C. -H., Lai, J. -S., & Cella, D. (2002). Feasibility and acceptability of computerized adaptive testing (CAT) for fatigue monitoring in clinical practice. Quality of Life Research, 11(7), 134. Davis, K. M., Chang, C. -H., Lai, J. -S., & Cella, D. (2002). Feasibility and acceptability of computerized adaptive testing (CAT) for fatigue monitoring in clinical practice. Quality of Life Research, 11(7), 134.
34.
go back to reference Bergstrom, B. A., & Lunz, M. E. (1999). CAT for certification and licensure. In F. Drasgow & J. B. Olson-Buchanan (Eds.), Innovations in computerized assessment (pp. 67–92). Mahwah, NJ: Lawrence Erlbaum Associates Publishers. Bergstrom, B. A., & Lunz, M. E. (1999). CAT for certification and licensure. In F. Drasgow & J. B. Olson-Buchanan (Eds.), Innovations in computerized assessment (pp. 67–92). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
35.
go back to reference Gershon, R. C. (2004) The ABCs of Computerized Adaptive Testing. In T. M. Wood & W. Zhi (Eds.), Measurement issues and practice in physical activity. Champaign, IL: Human kinetics. Gershon, R. C. (2004) The ABCs of Computerized Adaptive Testing. In T. M. Wood & W. Zhi (Eds.), Measurement issues and practice in physical activity. Champaign, IL: Human kinetics.
36.
go back to reference Ware, J. E. Jr., Kosinski, M., Bjorner, J. B. et al. (2003) Applications of computerized adaptive testing (CAT) to the assessment of headache impact. Quality of Life Research, 12(8), 935–952. PubMedCrossRef Ware, J. E. Jr., Kosinski, M., Bjorner, J. B. et al. (2003) Applications of computerized adaptive testing (CAT) to the assessment of headache impact. Quality of Life Research, 12(8), 935–952. PubMedCrossRef
37.
go back to reference Bergstrom, B., & Cline, A. (2003). Beyond multiple choice: Innovations in professional testing. CLEAR Exam Review. Summer. Bergstrom, B., & Cline, A. (2003). Beyond multiple choice: Innovations in professional testing. CLEAR Exam Review. Summer.
38.
go back to reference van der Linden, W. J., & Pashley, P. J. (2000) Item selection and ability estimation in adaptive testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: theory and practice. Norwell, MA: Kluwer. van der Linden, W. J., & Pashley, P. J. (2000) Item selection and ability estimation in adaptive testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: theory and practice. Norwell, MA: Kluwer.
Metagegevens
Titel
The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment
Auteurs
David Cella
Richard Gershon
Jin-Shei Lai
Seung Choi
Publicatiedatum
01-08-2007
Uitgeverij
Springer Netherlands
Gepubliceerd in
Quality of Life Research / Uitgave bijlage 1/2007
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-007-9204-6

Andere artikelen bijlage 1/2007

Quality of Life Research 1/2007 Naar de uitgave