Skip to main content
Top
Gepubliceerd in: Quality of Life Research 9/2012

01-11-2012

Development of an item bank and computer adaptive test for role functioning

Auteurs: Milena D. Anatchkova, Matthias Rose, John E. Ware Jr., Jakob B. Bjorner

Gepubliceerd in: Quality of Life Research | Uitgave 9/2012

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Objectives

Role functioning (RF) is a key component of health and well-being and an important outcome in health research. The aim of this study was to develop an item bank to measure impact of health on role functioning.

Methods

A set of different instruments including 75 newly developed items asking about the impact of health on role functioning was completed by 2,500 participants. Established item response theory methods were used to develop an item bank based on the generalized partial credit model. Comparison of group mean bank scores of participants with different self-reported general health status and chronic conditions was used to test the external validity of the bank.

Results

After excluding items that did not meet established requirements, the final item bank consisted of a total of 64 items covering three areas of role functioning (family, social, and occupational). Slopes in the bank ranged between .93 and 4.37; the mean threshold range was −1.09 to −2.25. Item bank-based scores were significantly different for participants with and without chronic conditions and with different levels of self-reported general health.

Conclusions

An item bank assessing health impact on RF across three content areas has been successfully developed. The bank can be used for development of short forms or computerized adaptive tests to be applied in the assessment of role functioning as one of the common denominators across applications of generic health assessment.
Literatuur
1.
go back to reference World Health Organization (2002). Towards a common language for functioning, disability and health: ICF—The international classification of functioning, disability and health. Geneva: World Health Organization (WHO). World Health Organization (2002). Towards a common language for functioning, disability and health: ICFThe international classification of functioning, disability and health. Geneva: World Health Organization (WHO).
2.
go back to reference Merikangas, K. R., Ames, M., Cui, L., et al. (2007). The impact of comorbidity of mental and physical conditions on role disability in the US adult household population. Archives of General Psychiatry, 64(10), 1180–1188.PubMedCrossRef Merikangas, K. R., Ames, M., Cui, L., et al. (2007). The impact of comorbidity of mental and physical conditions on role disability in the US adult household population. Archives of General Psychiatry, 64(10), 1180–1188.PubMedCrossRef
3.
go back to reference Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 95–108.PubMedCrossRef Bjorner, J. B., Chang, C. H., Thissen, D., & Reeve, B. B. (2007). Developing tailored instruments: Item banking and computerized adaptive assessment. Quality of Life Research, 16(Suppl 1), 95–108.PubMedCrossRef
4.
go back to reference Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33.PubMedCrossRef Rose, M., Bjorner, J. B., Becker, J., Fries, J. F., & Ware, J. E. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33.PubMedCrossRef
5.
go back to reference Anatchkova, M. D., & Bjorner, J. B. (2010). Health and role functioning: The use of focus groups in the development of an item bank. Quality of Life Research, 19(1), 111–123.PubMedCrossRef Anatchkova, M. D., & Bjorner, J. B. (2010). Health and role functioning: The use of focus groups in the development of an item bank. Quality of Life Research, 19(1), 111–123.PubMedCrossRef
6.
go back to reference Anatchkova, M. D., Ware, J. E., & Bjorner, J. B. (2011). Assessing the factor structure of a role functioning item bank. Quality of Life Research, 20, 745–758. Anatchkova, M. D., Ware, J. E., & Bjorner, J. B. (2011). Assessing the factor structure of a role functioning item bank. Quality of Life Research, 20, 745–758.
7.
go back to reference Gandek, B., Sinclair, S. J., Jette, A. M., & Ware, J. E., Jr. (2007). Development and initial psychometric evaluation of the participation measure for post-acute care (PM-PAC). American Journal of Physical Medicine & Rehabilitation, 86(0894-9115; 1), 57–71. Gandek, B., Sinclair, S. J., Jette, A. M., & Ware, J. E., Jr. (2007). Development and initial psychometric evaluation of the participation measure for post-acute care (PM-PAC). American Journal of Physical Medicine & Rehabilitation, 86(0894-9115; 1), 57–71.
8.
go back to reference Haley, S. M., Gandek, B., Siebens, H., et al. (2008). Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes. Archives of Physical Medicine and Rehabilitation, 89(2), 275–283. Haley, S. M., Gandek, B., Siebens, H., et al. (2008). Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: II. Participation outcomes. Archives of Physical Medicine and Rehabilitation, 89(2), 275–283.
9.
go back to reference Mulcahey, M. J., Haley, S. M., Duffy, T., Pengsheng, N., & Betz, R. R. (2008). Measuring physical functioning in children with spinal impairments with computerized adaptive testing. Journal of Pediatric Orthopaedics, 28(0271-6798; 3), 330–335. Mulcahey, M. J., Haley, S. M., Duffy, T., Pengsheng, N., & Betz, R. R. (2008). Measuring physical functioning in children with spinal impairments with computerized adaptive testing. Journal of Pediatric Orthopaedics, 28(0271-6798; 3), 330–335.
10.
go back to reference Wilkie, D. J., Judge, M. K., Berry, D. L., Dell, J., Zong, S., & Gilespie, R. (2003). Usability of a computerized PAINReportIt in the general public with pain and people with cancer pain. Journal of Pain and Symptom Management, 25(0885-3924; 3), 213–224. Wilkie, D. J., Judge, M. K., Berry, D. L., Dell, J., Zong, S., & Gilespie, R. (2003). Usability of a computerized PAINReportIt in the general public with pain and people with cancer pain. Journal of Pain and Symptom Management, 25(0885-3924; 3), 213–224.
11.
go back to reference Bjorner, J. B., Kosinski, M., & Ware, J. E., Jr. (2003). Calibration of an item pool for assessing the burden of headaches: An application of item response theory to the headache impact test (HIT). Quality of Life Research, 12(8), 913–933.PubMedCrossRef Bjorner, J. B., Kosinski, M., & Ware, J. E., Jr. (2003). Calibration of an item pool for assessing the burden of headaches: An application of item response theory to the headache impact test (HIT). Quality of Life Research, 12(8), 913–933.PubMedCrossRef
12.
go back to reference Bayliss, M. S., Dewey, J. E., Dunlap, I., et al. (2003). A study of the feasibility of internet administration of a computerized health survey: The headache impact test (HIT). Quality of Life Research, 12(8), 953–961.PubMedCrossRef Bayliss, M. S., Dewey, J. E., Dunlap, I., et al. (2003). A study of the feasibility of internet administration of a computerized health survey: The headache impact test (HIT). Quality of Life Research, 12(8), 953–961.PubMedCrossRef
13.
go back to reference Ware, J. E., Jr., & Dewey, J. (2000). How to score version two of the SF-36 health survey. Lincoln, RI: QualityMetric Incorporated. Ware, J. E., Jr., & Dewey, J. (2000). How to score version two of the SF-36 health survey. Lincoln, RI: QualityMetric Incorporated.
14.
go back to reference Ramsay, J. (1995). TestGraf—A program for the graphical analysis of multiple choice test and questionnaire data. Montreal, Canada: McGill University. Ramsay, J. (1995). TestGraf—A program for the graphical analysis of multiple choice test and questionnaire data. Montreal, Canada: McGill University.
15.
go back to reference Teresi, J. A. (2006). Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Medical Care, 44(11 Suppl 3), S152–S170. Teresi, J. A. (2006). Different approaches to differential item functioning in health applications. Advantages, disadvantages and some neglected topics. Medical Care, 44(11 Suppl 3), S152–S170.
16.
go back to reference Teresi, J. A., & Fleishman, J. A. (2007). Differential item functioning and health assessment. Quality of Life Research, 16(Suppl 1), 33–42.PubMedCrossRef Teresi, J. A., & Fleishman, J. A. (2007). Differential item functioning and health assessment. Quality of Life Research, 16(Suppl 1), 33–42.PubMedCrossRef
17.
go back to reference Crane, P. K., Gibbons, L. E., Ocepek-Welikson, K., et al. (2007). A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Quality of Life Research, 16(Suppl 1), 69–84.PubMedCrossRef Crane, P. K., Gibbons, L. E., Ocepek-Welikson, K., et al. (2007). A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression. Quality of Life Research, 16(Suppl 1), 69–84.PubMedCrossRef
18.
go back to reference Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (Ordinal) item scores. Ottawa, Ontario: Directorate of Human Resources Research and Evaluation, Department of National Defense. Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (Ordinal) item scores. Ottawa, Ontario: Directorate of Human Resources Research and Evaluation, Department of National Defense.
19.
go back to reference Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78, 691–692.CrossRef Nagelkerke, N. J. (1991). A note on a general definition of the coefficient of determination. Biometrika, 78, 691–692.CrossRef
20.
go back to reference Muraki, E. (1997). Generalized partial credit model. In V. D. Linden & R. K. Hambleton (Eds.), Handbook of item response theory (pp. 153–164). New York, NY: Springer. Muraki, E. (1997). Generalized partial credit model. In V. D. Linden & R. K. Hambleton (Eds.), Handbook of item response theory (pp. 153–164). New York, NY: Springer.
21.
go back to reference Muraki, E., & Bock, R. (1996). Parscale—IRT based test scoring and item analysis for graded open-ended exercises and performance tasks. Chicago, IL: Scientific Software, Inc. Muraki, E., & Bock, R. (1996). Parscale—IRT based test scoring and item analysis for graded open-ended exercises and performance tasks. Chicago, IL: Scientific Software, Inc.
22.
go back to reference Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(Suppl 1), 5–18.PubMedCrossRef Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(Suppl 1), 5–18.PubMedCrossRef
23.
go back to reference Bjorner, J. B., Smith, K., Stone, C., & Sun. X. (2007). IRTFIT: A macro for item fit and local dependence tests under IRT models. Bjorner, J. B., Smith, K., Stone, C., & Sun. X. (2007). IRTFIT: A macro for item fit and local dependence tests under IRT models.
24.
go back to reference Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24(1), 50–64.CrossRef Orlando, M., & Thissen, D. (2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24(1), 50–64.CrossRef
25.
go back to reference Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289–298.CrossRef Orlando, M., & Thissen, D. (2003). Further examination of the performance of S-X2, an item fit index for dichotomous item response theory models. Applied Psychological Measurement, 27(4), 289–298.CrossRef
26.
go back to reference Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.CrossRef Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.CrossRef
27.
go back to reference Stewart, A. L., Greenfield, S., Hays, R. D., et al. (1989). Functional status and well-being of patients with chronic conditions. Results from the medical outcomes study. JAMA, 262(7), 907–913. Stewart, A. L., Greenfield, S., Hays, R. D., et al. (1989). Functional status and well-being of patients with chronic conditions. Results from the medical outcomes study. JAMA, 262(7), 907–913.
28.
go back to reference Sprangers, M. A., de Regt, E. B., Andries, F., et al. (2000). Which chronic conditions are associated with better or poorer quality of life? Journal of Clinical Epidemiology, 53(9), 895–907.PubMedCrossRef Sprangers, M. A., de Regt, E. B., Andries, F., et al. (2000). Which chronic conditions are associated with better or poorer quality of life? Journal of Clinical Epidemiology, 53(9), 895–907.PubMedCrossRef
29.
go back to reference Kempen, G. I., Sanderman, R., Miedema, I., Meyboom-de Jong, B., & Ormel, J. (2000). Functional decline after congestive heart failure and acute myocardial infarction and the impact of psychological attributes. A prospective study. Quality of Life Research, 9(4), 439–450. Kempen, G. I., Sanderman, R., Miedema, I., Meyboom-de Jong, B., & Ormel, J. (2000). Functional decline after congestive heart failure and acute myocardial infarction and the impact of psychological attributes. A prospective study. Quality of Life Research, 9(4), 439–450.
30.
go back to reference McHorney, C. A., Ware, J. E., Jr., & Raczek, A. E. (1993). The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31, 247–263.PubMedCrossRef McHorney, C. A., Ware, J. E., Jr., & Raczek, A. E. (1993). The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31, 247–263.PubMedCrossRef
31.
go back to reference Hahn, E. A., Cella, D., Bode, R. K., & Hanrahan, R. T. (2010). Measuring social well-being in people with chronic illness. Social Indicators Research, 96(3), 381–401.CrossRef Hahn, E. A., Cella, D., Bode, R. K., & Hanrahan, R. T. (2010). Measuring social well-being in people with chronic illness. Social Indicators Research, 96(3), 381–401.CrossRef
32.
go back to reference Hahn, E. A., Devellis, R. F., Bode, R. K., et al. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Quality of Life Research, 19(7), 1035–1044.PubMedCrossRef Hahn, E. A., Devellis, R. F., Bode, R. K., et al. (2010). Measuring social health in the patient-reported outcomes measurement information system (PROMIS): Item bank development and testing. Quality of Life Research, 19(7), 1035–1044.PubMedCrossRef
33.
go back to reference Reeve, B. B., Hays, R. D., Bjorner, J. B., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5), S22–S31.PubMedCrossRef Reeve, B. B., Hays, R. D., Bjorner, J. B., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-reported outcomes measurement information system (PROMIS). Medical Care, 45(5), S22–S31.PubMedCrossRef
Metagegevens
Titel
Development of an item bank and computer adaptive test for role functioning
Auteurs
Milena D. Anatchkova
Matthias Rose
John E. Ware Jr.
Jakob B. Bjorner
Publicatiedatum
01-11-2012
Uitgeverij
Springer Netherlands
Gepubliceerd in
Quality of Life Research / Uitgave 9/2012
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-011-0076-4

Andere artikelen Uitgave 9/2012

Quality of Life Research 9/2012 Naar de uitgave