Skip to main content
Top
Gepubliceerd in: Quality of Life Research 6/2021

21-02-2021

Demographic and functional differences among social security disability claimants

Auteurs: Molly Marino, Pengsheng Ni, Lewis Kazis, Diane Brandt, Alan Jette

Gepubliceerd in: Quality of Life Research | Uitgave 6/2021

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Purpose

Sociodemographic characteristics may influence responses on self-reported measures. Differential item functioning (DIF) is when individuals expected to have the same ability level on a construct of interest have a different probability of endorsing an item on an item response theory (IRT) scale due to population characteristics. The goal of this study was to identify DIF for items in an outcome instrument by sociodemographic factors and, one controlling for DIF, assess true differences in function by those same factors.

Methods

The Work Disability Functional Assessment Battery 2.0 (WD-FAB 2.0) is an IRT-based self-reported measure of activity limitations relevant to work. Two samples from WD-FAB developed were used: 3793 SSA disability claimants randomly drawn from a pool of 16,500 claimants and a general sample if 2100 working age adults. We used a two-step IRT-based DIF method for three pairs of respondent characteristics: age, gender, and race/ethnicity, and calculated the weighted absolute difference between item characteristic curves. Independent two-group T-tests assessed differences in scores across groups.

Results

Seventeen items displayed DIF. Men had higher scores than women on two physical and two mental function scales. Older respondents had lower physical and higher mental function scores. The lower education group had lower mental function scores.

Conclusion

DIF impacts function measurement and is important when assessing psychometric characteristics of instruments. Self-report measures should include diverse samples to conduct similar analyses. WD-FAB 2.0 scores are now reflections of function with reduced bias related to gender, race/ethnicity, or age.
Literatuur
1.
go back to reference Social Security Administration. (2017). Annual statistical report on the social security disability insurance program. Social Security Administration. (2017). Annual statistical report on the social security disability insurance program.
3.
go back to reference Lord, F. M. (1980). Applications of item response theory to practical testing problems. Abingdon: Routledge. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Abingdon: Routledge.
4.
go back to reference Rivers D. (2006). Sample matching: Representative sampling from internet panels. Polimetrix White Paper Series. Rivers D. (2006). Sample matching: Representative sampling from internet panels. Polimetrix White Paper Series.
6.
go back to reference Norris, J. M. (2001). Computer-adaptive testing: A primer. Language Learning & Technology., 5(2), 23–27. Norris, J. M. (2001). Computer-adaptive testing: A primer. Language Learning & Technology., 5(2), 23–27.
7.
go back to reference Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika., 54(3), 427–450.CrossRef Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika., 54(3), 427–450.CrossRef
8.
go back to reference Wang, S., & Wang, T. (2001). Precision of warm’s weighted likelihood estimates for a polytomous model in computerized adaptive testing. Applied Psychological Measurement, 25(4), 317–331.CrossRef Wang, S., & Wang, T. (2001). Precision of warm’s weighted likelihood estimates for a polytomous model in computerized adaptive testing. Applied Psychological Measurement, 25(4), 317–331.CrossRef
9.
go back to reference Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement.
10.
go back to reference Hambleton, R., & Pitoniak, M. (2002). Testing and measurement: Advances in item response theory and selected testing practices. Hambleton, R., & Pitoniak, M. (2002). Testing and measurement: Advances in item response theory and selected testing practices.
12.
go back to reference Ni, P., McDonough, C. M., Jette, A. M., et al. (2013). Development of a computer-adaptive physical function instrument for social security administration disability determination. Arch Phys Med Rehabil., 94(9), 1661–1669.PubMedPubMedCentralCrossRef Ni, P., McDonough, C. M., Jette, A. M., et al. (2013). Development of a computer-adaptive physical function instrument for social security administration disability determination. Arch Phys Med Rehabil., 94(9), 1661–1669.PubMedPubMedCentralCrossRef
13.
go back to reference Marfeo, E. E., Ni, P., Haley, S. M., et al. (2013). Development of an instrument to measure behavioral health function for work disability: Item pool construction and factor analysis. Archives of Physical Medicine and Rehabilitation, 94(9), 1670–1678.PubMedPubMedCentralCrossRef Marfeo, E. E., Ni, P., Haley, S. M., et al. (2013). Development of an instrument to measure behavioral health function for work disability: Item pool construction and factor analysis. Archives of Physical Medicine and Rehabilitation, 94(9), 1670–1678.PubMedPubMedCentralCrossRef
14.
go back to reference McDonough, C. M., Ni, P., Peterik, K., Marfeo, E. E., Marino, M. E., Meterko, M., … & Chan, L. (2017). Improving measures of work-related physical functioning. Quality of life research, 26(3), 789–798. McDonough, C. M., Ni, P., Peterik, K., Marfeo, E. E., Marino, M. E., Meterko, M., … & Chan, L. (2017). Improving measures of work-related physical functioning. Quality of life research26(3), 789–798.
15.
go back to reference Marfeo, E. E., Ni, P., McDonough, C., Peterik, K., Marino, M., Meterko, M., … & Jette, A. M. (2018). Improving assessment of work related mental health function using the work disability functional assessment battery (WD-FAB). Journal of Occupational Rehabilitation, 28(1), 190–199. Marfeo, E. E., Ni, P., McDonough, C., Peterik, K., Marino, M., Meterko, M., … & Jette, A. M. (2018). Improving assessment of work related mental health function using the work disability functional assessment battery (WD-FAB). Journal of Occupational Rehabilitation28(1), 190–199.
16.
go back to reference Meterko, M., Marino, M., Ni, P., Marfeo, E., McDonough, C. M., Jette, A., … & Chan, L. (2019). Psychometric evaluation of the improved work-disability functional assessment battery. Archives of Physical Medicine and Rehabilitation, 100(8), 1442–1449. Meterko, M., Marino, M., Ni, P., Marfeo, E., McDonough, C. M., Jette, A., … & Chan, L. (2019). Psychometric evaluation of the improved work-disability functional assessment battery. Archives of Physical Medicine and Rehabilitation100(8), 1442–1449.
17.
go back to reference Jette, A. M., Ni, P., Rasch, E., Marfeo, E., McDonough, C., Brandt, D., … & Chan, L. (2019). The Work Disability Functional Assessment Battery (WD-FAB). Physical Medicine and Rehabilitation Clinics. Jette, A. M., Ni, P., Rasch, E., Marfeo, E., McDonough, C., Brandt, D., … & Chan, L. (2019). The Work Disability Functional Assessment Battery (WD-FAB). Physical Medicine and Rehabilitation Clinics.
18.
go back to reference Coe, N. B., Haverstick, K., Munnell, A. H., & Webb, A. (2011). What explains state variation in SSDI application rates? Center for Retirement Research at Boston College Working Paper. (2011-23). Coe, N. B., Haverstick, K., Munnell, A. H., & Webb, A. (2011). What explains state variation in SSDI application rates? Center for Retirement Research at Boston College Working Paper. (2011-23).
19.
go back to reference Coe, N. B., Haverstick, K., Munnell, A. H., & Webb, A. (2012). Why do state disability application rates vary over time? Center for Retirement Research at Boston College Working Paper. 2012(12-2). Coe, N. B., Haverstick, K., Munnell, A. H., & Webb, A. (2012). Why do state disability application rates vary over time? Center for Retirement Research at Boston College Working Paper. 2012(12-2).
20.
go back to reference Von Wachter, T., Song, J., & Manchester, J. (2011). Trends in employment and earnings of allowed and rejected applicants to the social security disability insurance program. American Economic Review, 107, 3308–3329.CrossRef Von Wachter, T., Song, J., & Manchester, J. (2011). Trends in employment and earnings of allowed and rejected applicants to the social security disability insurance program. American Economic Review, 107, 3308–3329.CrossRef
21.
go back to reference Wilson, K. B. (2000). Predicting vocational rehabilitation acceptance based on race, education, work status, and source of support at application. Rehabilitation Counseling Bulletin, 43(2), 97–105.CrossRef Wilson, K. B. (2000). Predicting vocational rehabilitation acceptance based on race, education, work status, and source of support at application. Rehabilitation Counseling Bulletin, 43(2), 97–105.CrossRef
22.
go back to reference Langer, M. M. (2008). A reexamination of Lord's Wald test for differential item functioning using item response theory and modern error estimation. Langer, M. M. (2008). A reexamination of Lord's Wald test for differential item functioning using item response theory and modern error estimation.
23.
go back to reference Woods, C. M., Cai, L., & Wang, M. (2013). The langer-improved wald test for DIF testing with multiple groups evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532–547.CrossRef Woods, C. M., Cai, L., & Wang, M. (2013). The langer-improved wald test for DIF testing with multiple groups evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532–547.CrossRef
24.
go back to reference Edelen, M. O., Stucky, B. D., & Chandra, A. (2013). Quantifying ‘problematic’ DIF within an IRT framework: Application to a cancer stigma index. Quality of Life Research, 24, 1–9. Edelen, M. O., Stucky, B. D., & Chandra, A. (2013). Quantifying ‘problematic’ DIF within an IRT framework: Application to a cancer stigma index. Quality of Life Research, 24, 1–9.
25.
go back to reference Oshima, T., Kushubar, S., Scott, J., & Raju, N. (2009). DFIT8 for window user’s manual: Differential functioning of items and tests. St. Paul, MN: Assessment Systems Corporation. Oshima, T., Kushubar, S., Scott, J., & Raju, N. (2009). DFIT8 for window user’s manual: Differential functioning of items and tests. St. Paul, MN: Assessment Systems Corporation.
26.
go back to reference Rice, M. E., & Harris, G. T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen’s d, and r. Law and Human Behavior, 29(5), 615.PubMedCrossRef Rice, M. E., & Harris, G. T. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen’s d, and r. Law and Human Behavior, 29(5), 615.PubMedCrossRef
28.
go back to reference Autor, D. (2010). The polarization of job opportunities in the US labor market: Implications for employment and earnings. Center for American Progress and The Hamilton Project. Autor, D. (2010). The polarization of job opportunities in the US labor market: Implications for employment and earnings. Center for American Progress and The Hamilton Project.
29.
go back to reference Lin, S., Beck, A. N., Finch, B. K., Hummer, R. A., & Master, R. K. (2012). Trends in US older adult disability: Exploring age, period, and cohort effects. American Journal of Public Health, 102(11), 2157–2163.PubMedPubMedCentralCrossRef Lin, S., Beck, A. N., Finch, B. K., Hummer, R. A., & Master, R. K. (2012). Trends in US older adult disability: Exploring age, period, and cohort effects. American Journal of Public Health, 102(11), 2157–2163.PubMedPubMedCentralCrossRef
30.
go back to reference Loprest, P., & Maag, E. (2007). The relationship between early disability onset and education and employment. Journal of Vocational Rehabilitation, 26(1), 49–62. Loprest, P., & Maag, E. (2007). The relationship between early disability onset and education and employment. Journal of Vocational Rehabilitation, 26(1), 49–62.
31.
go back to reference Hopman, W., Harrison, M., Coo, H., Friedberg, E., Buchanan, M., & Van Den Kerkhof, E. (2009). Associations between chronic disease, age and physical and mental health status. Chronic Diseases in Canada, 29(3), 108–116.PubMedCrossRef Hopman, W., Harrison, M., Coo, H., Friedberg, E., Buchanan, M., & Van Den Kerkhof, E. (2009). Associations between chronic disease, age and physical and mental health status. Chronic Diseases in Canada, 29(3), 108–116.PubMedCrossRef
33.
go back to reference Haveman, R., & Wolfe, B. (2000). The economics of disability and disability policy. Handbook of Health Economics, 1, 995–1051.CrossRef Haveman, R., & Wolfe, B. (2000). The economics of disability and disability policy. Handbook of Health Economics, 1, 995–1051.CrossRef
34.
go back to reference Duggan, M, & Imberman, S. A. (2009). Why are the disability rolls skyrocketing? The contribution of population characteristics, economic conditions, and program generosity. In: Health at older ages: The causes and consequences of declining disability among the elderly. Chicago: University of Chicago Press, pp. 337–379. Duggan, M, & Imberman, S. A. (2009). Why are the disability rolls skyrocketing? The contribution of population characteristics, economic conditions, and program generosity. In: Health at older ages: The causes and consequences of declining disability among the elderly. Chicago: University of Chicago Press, pp. 337–379.
35.
go back to reference Hendley, A. A., & Bilimoria, N. F. (1999). Minorities and social security: An analysis of ethnic differences in the current program. Social Security Bulletin, 62, 59.PubMed Hendley, A. A., & Bilimoria, N. F. (1999). Minorities and social security: An analysis of ethnic differences in the current program. Social Security Bulletin, 62, 59.PubMed
36.
go back to reference Kington, R. S., & Smith, J. P. (1997). Socioeconomic status and racial and ethnic differences in functional status associated with chronic diseases. American Journal of Public Health, 87(5), 805–810.PubMedPubMedCentralCrossRef Kington, R. S., & Smith, J. P. (1997). Socioeconomic status and racial and ethnic differences in functional status associated with chronic diseases. American Journal of Public Health, 87(5), 805–810.PubMedPubMedCentralCrossRef
37.
go back to reference Williams, D. R. (1999). Race, socioeconomic status, and health the added effects of racism and discrimination. Annals of the New York Academy Sciences, 896(1), 173–188.CrossRef Williams, D. R. (1999). Race, socioeconomic status, and health the added effects of racism and discrimination. Annals of the New York Academy Sciences, 896(1), 173–188.CrossRef
38.
go back to reference Nichols, A. & Simms, M. (2012). Racial and ethnic differences in receipt of unemployment insurance benefits during the great recession. Unemployment and Recovery Project Brief. Nichols, A. & Simms, M. (2012). Racial and ethnic differences in receipt of unemployment insurance benefits during the great recession. Unemployment and Recovery Project Brief.
39.
go back to reference Kao, G., & Thompson, J. S. (2003). Racial and ethnic stratification in educational achievement and attainment. Annual Review of Sociology, 29(1), 417–442.CrossRef Kao, G., & Thompson, J. S. (2003). Racial and ethnic stratification in educational achievement and attainment. Annual Review of Sociology, 29(1), 417–442.CrossRef
40.
go back to reference DeBose, C. E. (1992). Codeswitching: Black English and standard English in the African-American linguistic repertoire. Journal of Multilingual & Multicultural Development, 13(1–2), 157–167.CrossRef DeBose, C. E. (1992). Codeswitching: Black English and standard English in the African-American linguistic repertoire. Journal of Multilingual & Multicultural Development, 13(1–2), 157–167.CrossRef
41.
go back to reference Fleishman, J. A., Spector, W. D., & Altman, B. M. (2002). Impact of differential item functioning on age and gender differences in functional disability. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 57(5), S275-84.CrossRef Fleishman, J. A., Spector, W. D., & Altman, B. M. (2002). Impact of differential item functioning on age and gender differences in functional disability. The Journals of Gerontology, Series B: Psychological Sciences and Social Sciences, 57(5), S275-84.CrossRef
42.
go back to reference Sullivan, O. (1997). Time waits for no (wo) man: An investigation of the gendered experience of domestic time. Sociology, 31(2), 221–239.CrossRef Sullivan, O. (1997). Time waits for no (wo) man: An investigation of the gendered experience of domestic time. Sociology, 31(2), 221–239.CrossRef
43.
go back to reference Teresi, J. A., & Fleishman, J. A. (2007). Differential item functioning and health assessment. Quality of Life Research, 16(1), 33–42.PubMedCrossRef Teresi, J. A., & Fleishman, J. A. (2007). Differential item functioning and health assessment. Quality of Life Research, 16(1), 33–42.PubMedCrossRef
44.
go back to reference Teresi, J. A., Ocepek-Welikson, K., Kleinman, M., et al. (2009). Analysis of differential item functioning in the depression item bank from the patient reported outcome measurement information system (PROMIS): An item response theory approach. Psychological Science Quarterly, 51(2), 148–180. Teresi, J. A., Ocepek-Welikson, K., Kleinman, M., et al. (2009). Analysis of differential item functioning in the depression item bank from the patient reported outcome measurement information system (PROMIS): An item response theory approach. Psychological Science Quarterly, 51(2), 148–180.
45.
go back to reference Rose, M., Bjorner, J. B., Becker, J., Fries, J., & Ware, J. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33.PubMedCrossRef Rose, M., Bjorner, J. B., Becker, J., Fries, J., & Ware, J. (2008). Evaluation of a preliminary physical function item bank supported the expected advantages of the patient-reported outcomes measurement information system (PROMIS). Journal of Clinical Epidemiology, 61(1), 17–33.PubMedCrossRef
46.
go back to reference Iwata, N., Turner, R. J., & Lloyd, D. A. (2002). Race/ethnicity and depressive symptoms in community-dwelling young adults: A differential item functioning analysis. Psychiatry Research, 110(3), 281–289.PubMedCrossRef Iwata, N., Turner, R. J., & Lloyd, D. A. (2002). Race/ethnicity and depressive symptoms in community-dwelling young adults: A differential item functioning analysis. Psychiatry Research, 110(3), 281–289.PubMedCrossRef
47.
go back to reference Gao, Y., & Zhu, W. (2011). Differential item functioning analysis of the 2003–04 NHANES physical activity questionnaire. Research Quarterly for Exercise and Sport, 82(3), 381–390.PubMedCrossRef Gao, Y., & Zhu, W. (2011). Differential item functioning analysis of the 2003–04 NHANES physical activity questionnaire. Research Quarterly for Exercise and Sport, 82(3), 381–390.PubMedCrossRef
48.
go back to reference Hafner-Eaton, C. (1993). Physician utilization disparities between the uninsured and insured: Comparisons of the chronically III, acutely III, and well nonelderly populations. JAMA, 269(6), 787–792.PubMedCrossRef Hafner-Eaton, C. (1993). Physician utilization disparities between the uninsured and insured: Comparisons of the chronically III, acutely III, and well nonelderly populations. JAMA, 269(6), 787–792.PubMedCrossRef
49.
go back to reference Williams, D. R., & Collins, C. (1995). US socioeconomic and racial differences in health: Patterns and explanations. Annual Review of Sociology, 21, 349–386.CrossRef Williams, D. R., & Collins, C. (1995). US socioeconomic and racial differences in health: Patterns and explanations. Annual Review of Sociology, 21, 349–386.CrossRef
50.
go back to reference Willimas, D., Yu, Y., & Jackson, J. (1997). Racial differences in physical and mental health. Journal of Health Psychology, 2, 335–351.CrossRef Willimas, D., Yu, Y., & Jackson, J. (1997). Racial differences in physical and mental health. Journal of Health Psychology, 2, 335–351.CrossRef
51.
go back to reference Yee, S. (2011). Health and health care disparities among people with disabilities. Washington, DC: Disability Rights Education & Defense Fund. Yee, S. (2011). Health and health care disparities among people with disabilities. Washington, DC: Disability Rights Education & Defense Fund.
52.
go back to reference Fremstad, S. (2009). Half in ten. Why taking disability into account is essential to reducing income poverty and expanding economic inclusion. Washington, DC: Center for Economic and Policy Research. Fremstad, S. (2009). Half in ten. Why taking disability into account is essential to reducing income poverty and expanding economic inclusion. Washington, DC: Center for Economic and Policy Research.
53.
go back to reference Hanmer, J., Lawrence, W. F., Anderson, J. P., Kaplan, R. M., & Fryback, D. G. (2006). Report of nationally representative values for the noninstitutionalized US adult population for 7 health-related quality-of-life scores. Medical Decision Making, 26(4), 391–400.PubMedCrossRef Hanmer, J., Lawrence, W. F., Anderson, J. P., Kaplan, R. M., & Fryback, D. G. (2006). Report of nationally representative values for the noninstitutionalized US adult population for 7 health-related quality-of-life scores. Medical Decision Making, 26(4), 391–400.PubMedCrossRef
55.
go back to reference McFarland, M. J., & Wagner, B. G. (2015). Does a college education reduce depressive symptoms in American young adults? Social Science & Medicine, 146, 75–84.CrossRef McFarland, M. J., & Wagner, B. G. (2015). Does a college education reduce depressive symptoms in American young adults? Social Science & Medicine, 146, 75–84.CrossRef
57.
go back to reference Lee, M., & Mather, M. (2008) US labor force trends. Vol 63. Population Reference Bureau. Lee, M., & Mather, M. (2008) US labor force trends. Vol 63. Population Reference Bureau.
Metagegevens
Titel
Demographic and functional differences among social security disability claimants
Auteurs
Molly Marino
Pengsheng Ni
Lewis Kazis
Diane Brandt
Alan Jette
Publicatiedatum
21-02-2021
Uitgeverij
Springer International Publishing
Gepubliceerd in
Quality of Life Research / Uitgave 6/2021
Print ISSN: 0962-9343
Elektronisch ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-021-02765-w

Andere artikelen Uitgave 6/2021

Quality of Life Research 6/2021 Naar de uitgave