Skip to main content
Top
Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment 2/2015

01-06-2015

Assessing the Straightforwardly-Worded Brief Fear of Negative Evaluation Scale for Differential Item Functioning Across Gender and Ethnicity

Auteurs: Jared K. Harpole, Cheri A. Levinson, Carol M. Woods, Thomas L. Rodebaugh, Justin W. Weeks, Patrick J. Brown, Richard G. Heimberg, Andrew R. Menatti, Carlos Blanco, Franklin Schneier, Michael Liebowitz

Gepubliceerd in: Journal of Psychopathology and Behavioral Assessment | Uitgave 2/2015

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The Brief Fear of Negative Evaluation Scale (BFNE; Leary Personality and Social Psychology Bulletin, 9, 371–375, 1983) assesses fear and worry about receiving negative evaluation from others. Rodebaugh et al. Psychological Assessment, 16, 169–181, (2004) found that the BFNE is composed of a reverse-worded factor (BFNE-R) and straightforwardly-worded factor (BFNE-S). Further, they found the BFNE-S to have better psychometric properties and provide more information than the BFNE-R. Currently there is a lack of research regarding the measurement invariance of the BFNE-S across gender and ethnicity with respect to item thresholds. The present study uses item response theory (IRT) to test the BFNE-S for differential item functioning (DIF) related to gender and ethnicity (White, Asian, and Black). Six data sets consisting of clinical, community, and undergraduate participants were utilized (N = 2,109). The factor structure of the BFNE-S was confirmed using categorical confirmatory factor analysis, IRT model assumptions were tested, and the BFNE-S was evaluated for DIF. Item nine demonstrated significant non-uniform DIF between White and Black participants. No other items showed significant uniform or non-uniform DIF across gender or ethnicity. Results suggest the BFNE-S can be used reliably with men and women and Asian and White participants. More research is needed to understand the implications of using the BFNE-S with Black participants.
Voetnoten
1
To test whether the results of the DIF analyses were dependent on anchor items were-ran the analyses for both gender and ethnicity using items three and eight which did not exhibit LD. The results from the DIF analyses for using items three and eight versus the items described above were identical.
 
Literatuur
go back to reference Adams, C. E., Myers, V. H., Barbera, B. L., & Brantley, P. J. (2011). The role of fear of negative evaluation in predicting depression and quality of life 4 years after bariatric surgery in women. Psychology, 2, 150–154. doi:10.4236/psych.2011.23024.CrossRef Adams, C. E., Myers, V. H., Barbera, B. L., & Brantley, P. J. (2011). The role of fear of negative evaluation in predicting depression and quality of life 4 years after bariatric surgery in women. Psychology, 2, 150–154. doi:10.​4236/​psych.​2011.​23024.CrossRef
go back to reference Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289–300. doi:10.2307/2346101. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57, 289–300. doi:10.​2307/​2346101.
go back to reference Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: application of an EM algorithm. Psychometrika, 46, 443–459. doi:10.1007/BF02293801.CrossRef Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: application of an EM algorithm. Psychometrika, 46, 443–459. doi:10.​1007/​BF02293801.CrossRef
go back to reference Brown, P. J., & Roose, S. P. (2011). Age and anxiety and depressive symptoms: the effect on domains of quality of life. International Journal of Geriatric Psychiatry, 26, 1260–1266.CrossRefPubMedCentralPubMed Brown, P. J., & Roose, S. P. (2011). Age and anxiety and depressive symptoms: the effect on domains of quality of life. International Journal of Geriatric Psychiatry, 26, 1260–1266.CrossRefPubMedCentralPubMed
go back to reference Cai, L. (2012). flexMIRT™ version 1.88: A numerical engine for multilevel item factor analysis and test scoring. [Computer Software]. Seattle: Vector Psychometric Group. Cai, L. (2012). flexMIRT™ version 1.88: A numerical engine for multilevel item factor analysis and test scoring. [Computer Software]. Seattle: Vector Psychometric Group.
go back to reference Cai, L., Thissen, D., & du Toit, S. H. C. (2013). IRTPRO:Flexible, multidimensional, multiple categorical IRT modeling [Computer software]. Chicago: Scientific Software International. Cai, L., Thissen, D., & du Toit, S. H. C. (2013). IRTPRO:Flexible, multidimensional, multiple categorical IRT modeling [Computer software]. Chicago: Scientific Software International.
go back to reference Carleton, N. R., Collimore, K. C., McCabe, R. E., & Antony, M. M. (2011). Addressing revisions to the brief fear of negative evaluation scale: measuring fear of negative evaluation across anxiety and mood disorders. Journal of Anxiety Disorders, 25, 822–828. doi:10.1016/j.janxdis.2011.04.002.CrossRefPubMed Carleton, N. R., Collimore, K. C., McCabe, R. E., & Antony, M. M. (2011). Addressing revisions to the brief fear of negative evaluation scale: measuring fear of negative evaluation across anxiety and mood disorders. Journal of Anxiety Disorders, 25, 822–828. doi:10.​1016/​j.​janxdis.​2011.​04.​002.CrossRefPubMed
go back to reference Chen, W.-H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265–289. doi:10.2307/1165285.CrossRef Chen, W.-H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265–289. doi:10.​2307/​1165285.CrossRef
go back to reference DiNardo, P. A., Brown, T. A., & Barlow, D. H. (1994). Anxiety disorders interview schedule for DSM-IV: Lifetime version (ADIS-IV-L). San Antonio: The Psychological Corporation. DiNardo, P. A., Brown, T. A., & Barlow, D. H. (1994). Anxiety disorders interview schedule for DSM-IV: Lifetime version (ADIS-IV-L). San Antonio: The Psychological Corporation.
go back to reference First, M.B., Spitzer, R.L., Gibbon, M., et al. Structured Clinical Interview for DSM-IV Axis I Disorders (SCID), Clinician Version: Administration Booklet. Washington, DC: American Psychiatric Press; 1996. http://www.appi.org/Home First, M.B., Spitzer, R.L., Gibbon, M., et al. Structured Clinical Interview for DSM-IV Axis I Disorders (SCID), Clinician Version: Administration Booklet. Washington, DC: American Psychiatric Press; 1996. http://​www.​appi.​org/​Home
go back to reference Gilbert, N., & Meyer, C. (2005). Fear of negative evaluation and the development of eating psychopathology: a longitudinal study among nonclinical women. International Journal of Eating Disorders, 37, 307–312. doi:10.1002/eat.20105.CrossRefPubMed Gilbert, N., & Meyer, C. (2005). Fear of negative evaluation and the development of eating psychopathology: a longitudinal study among nonclinical women. International Journal of Eating Disorders, 37, 307–312. doi:10.​1002/​eat.​20105.CrossRefPubMed
go back to reference Hambrick, J. P., Rodebaugh, T. L., Balsis, S., Woods, C. M., Mendez, J. L., & Heimberg, R. G. (2010). Cross-ethnic measurement equivalence of measures of depression, social anxiety, and worry. Assessment, 17, 155–171. doi:10.1177/1073191109350158.CrossRefPubMed Hambrick, J. P., Rodebaugh, T. L., Balsis, S., Woods, C. M., Mendez, J. L., & Heimberg, R. G. (2010). Cross-ethnic measurement equivalence of measures of depression, social anxiety, and worry. Assessment, 17, 155–171. doi:10.​1177/​1073191109350158​.CrossRefPubMed
go back to reference Harpole, J. K., & Woods, C. M. (2013). The impact of local dependence on differential item functioning. Paper presented at the annual meeting of the Psychometric Society, Arnhem, Netherlands. Harpole, J. K., & Woods, C. M. (2013). The impact of local dependence on differential item functioning. Paper presented at the annual meeting of the Psychometric Society, Arnhem, Netherlands.
go back to reference Harpole, J. K., & Woods, C. M. (2014). The impact of local dependence on differential item functioning. Manuscript submitted for publication. Harpole, J. K., & Woods, C. M. (2014). The impact of local dependence on differential item functioning. Manuscript submitted for publication.
go back to reference Heimberg, R. G., Brozovich, F. A., & Rapee, R. M. (2010). A cognitive-behavioral model of social anxiety disorder: update and extension. In S. G. Hofmann & P. M. DiBartolo (Eds.), Social anxiety: Clinical, developmental, and social perspectives. New York: Elsevier. doi:10.1016/B978-0-12-375096-9.00015-8. Heimberg, R. G., Brozovich, F. A., & Rapee, R. M. (2010). A cognitive-behavioral model of social anxiety disorder: update and extension. In S. G. Hofmann & P. M. DiBartolo (Eds.), Social anxiety: Clinical, developmental, and social perspectives. New York: Elsevier. doi:10.​1016/​B978-0-12-375096-9.​00015-8.
go back to reference Levinson, C. A., Rodebaugh, T. L., Menatti, A., & Weeks, J. W. (2013). Development and validation of the Social Exercise and Anxiety Measure (SEAM): assessing fears, avoidance, and importance of social exercise. Journal of Psychopathology and Behavioral Assessment, 35, 244–253. doi:10.1007/s10862-012-9326-1.CrossRef Levinson, C. A., Rodebaugh, T. L., Menatti, A., & Weeks, J. W. (2013). Development and validation of the Social Exercise and Anxiety Measure (SEAM): assessing fears, avoidance, and importance of social exercise. Journal of Psychopathology and Behavioral Assessment, 35, 244–253. doi:10.​1007/​s10862-012-9326-1.CrossRef
go back to reference Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale: Lawrence Erlbaum. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale: Lawrence Erlbaum.
go back to reference Lubke, G. H., & Muthén, B. O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514–534. doi:10.1207/s15328007sem1104_2.CrossRef Lubke, G. H., & Muthén, B. O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514–534. doi:10.​1207/​s15328007sem1104​_​2.CrossRef
go back to reference Maydeu-Olivares, A., & Joe, H. (2005). Limited-and full-information estimation and goodness-of-fit testing in 2n contingency tables. Journal of the American Statistical Association, 100, 1009–1020. doi:10.1198/016214504000002069.CrossRef Maydeu-Olivares, A., & Joe, H. (2005). Limited-and full-information estimation and goodness-of-fit testing in 2n contingency tables. Journal of the American Statistical Association, 100, 1009–1020. doi:10.​1198/​0162145040000020​69.CrossRef
go back to reference Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S-χ 2 : an item-fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298. doi:10.1177/0146621603027004004.CrossRef Orlando, M., & Thissen, D. (2003). Further investigation of the performance of S-χ 2 : an item-fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27, 289–298. doi:10.​1177/​0146621603027004​004.CrossRef
go back to reference Core Team, R. (2013). R: A Language and Environment for Statistical Computing [Computer Software]. Vienna: R Foundation for Statistical Computing. Core Team, R. (2013). R: A Language and Environment for Statistical Computing [Computer Software]. Vienna: R Foundation for Statistical Computing.
go back to reference Rodebaugh, T. L., Shumaker, E. A., Levinson, C. A., Fernandez, K. C., Langer, J. K., Lim, M. H., & Yarkoni, T. (2013). Interpersonal constraint conferred by generalized social anxiety disorder is evident on a behavioral economics task. Journal of Abnormal Psychology, 22, 39–44. doi:10.1037/a0030975.CrossRef Rodebaugh, T. L., Shumaker, E. A., Levinson, C. A., Fernandez, K. C., Langer, J. K., Lim, M. H., & Yarkoni, T. (2013). Interpersonal constraint conferred by generalized social anxiety disorder is evident on a behavioral economics task. Journal of Abnormal Psychology, 22, 39–44. doi:10.​1037/​a0030975.CrossRef
go back to reference Rodebaugh, T. L., Woods, C. M., Thissen, D. M., Heimberg, R. G., Chambless, D. L., & Rapee, R. M. (2004). More information from fewer questions: the factor structure and item properties of the original and brief fear of negative evaluation scale. Psychological Assessment, 16, 169–181. doi:10.1037/1040-3590.16.2.169.CrossRefPubMed Rodebaugh, T. L., Woods, C. M., Thissen, D. M., Heimberg, R. G., Chambless, D. L., & Rapee, R. M. (2004). More information from fewer questions: the factor structure and item properties of the original and brief fear of negative evaluation scale. Psychological Assessment, 16, 169–181. doi:10.​1037/​1040-3590.​16.​2.​169.CrossRefPubMed
go back to reference Smith, S. M., Stinson, F. S., Dawson, D. A., Goldstein, R., Huang, B., & Grant, B. F. (2006). Race/ethnic differences in the prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the national epidemiologic survey on alcohol and related conditions. Psychological Medicine, 36, 987–998. doi:10.1017/S0033291706007690.CrossRefPubMed Smith, S. M., Stinson, F. S., Dawson, D. A., Goldstein, R., Huang, B., & Grant, B. F. (2006). Race/ethnic differences in the prevalence and co-occurrence of substance use disorders and independent mood and anxiety disorders: results from the national epidemiologic survey on alcohol and related conditions. Psychological Medicine, 36, 987–998. doi:10.​1017/​S003329170600769​0.CrossRefPubMed
go back to reference Stark, S. (2008). MODFIT: Plot theoretical item response functions and examine the fit of dichotomous and polytomous IRT models to response data [Computer program]. Department of Psychology, University of South Florida at Tampa. Stark, S. (2008). MODFIT: Plot theoretical item response functions and examine the fit of dichotomous and polytomous IRT models to response data [Computer program]. Department of Psychology, University of South Florida at Tampa.
go back to reference Steiger, J. H., & Lind, J. (1980). Statistically-based tests for the number of common factors. Paper presented at the Annual Spring Meeting of the Psychometric Society, Iowa City, IA. http://www.statpower.net. Steiger, J. H., & Lind, J. (1980). Statistically-based tests for the number of common factors. Paper presented at the Annual Spring Meeting of the Psychometric Society, Iowa City, IA. http://​www.​statpower.​net.
go back to reference Thissen, D., Steinberg, L., & Kuang, D. (2002). Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Educational and Behavioral Statistics, 27, 77–83. doi:10.3102/10769986027001077.CrossRef Thissen, D., Steinberg, L., & Kuang, D. (2002). Quick and easy implementation of the Benjamini-Hochberg procedure for controlling the false positive rate in multiple comparisons. Journal of Educational and Behavioral Statistics, 27, 77–83. doi:10.​3102/​1076998602700107​7.CrossRef
go back to reference Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–111). Hillsdale: Lawrence Erlbaum. Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–111). Hillsdale: Lawrence Erlbaum.
go back to reference Wang, W.-C., Shih, C.-L., & Yang, C.-C. (2009). The MIMIC method with scale purification for detecting differential item functioning. Educational and Psychological Measurement, 69, 713–731. doi:10.1177/0013164409332228.CrossRef Wang, W.-C., Shih, C.-L., & Yang, C.-C. (2009). The MIMIC method with scale purification for detecting differential item functioning. Educational and Psychological Measurement, 69, 713–731. doi:10.​1177/​0013164409332228​.CrossRef
go back to reference Weeks, J. W., Heimberg, R. G., Fresco, D. M., Hart, T. A., Turk, C. L., Schneier, F. R., et al. (2005). Empirical validation and psychometric evaluation of the brief fear of negative evaluation scale in patients with social anxiety disorder. Psychological Assessment, 17, 179–190. doi:10.1037/1040-3590.17.2.179.CrossRefPubMed Weeks, J. W., Heimberg, R. G., Fresco, D. M., Hart, T. A., Turk, C. L., Schneier, F. R., et al. (2005). Empirical validation and psychometric evaluation of the brief fear of negative evaluation scale in patients with social anxiety disorder. Psychological Assessment, 17, 179–190. doi:10.​1037/​1040-3590.​17.​2.​179.CrossRefPubMed
go back to reference Weeks, J. W., Heimberg, R. G., Rodebaugh, T. L., Goldin, P. R., & Gross, J. J. (2012). Psychometric evaluation of the fear of positive evaluation scale in patients with social anxiety disorder. Psychological Assessment, 24, 301–312. doi:10.1037/a0025723.CrossRefPubMedCentralPubMed Weeks, J. W., Heimberg, R. G., Rodebaugh, T. L., Goldin, P. R., & Gross, J. J. (2012). Psychometric evaluation of the fear of positive evaluation scale in patients with social anxiety disorder. Psychological Assessment, 24, 301–312. doi:10.​1037/​a0025723.CrossRefPubMedCentralPubMed
go back to reference Woods, C. M., Cai, L., & Wang, M. (2013). The Langer-improved Wald test for DIF testing with multiple groups: evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73, 532–547. doi:10.1177/0013164412464875.CrossRef Woods, C. M., Cai, L., & Wang, M. (2013). The Langer-improved Wald test for DIF testing with multiple groups: evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73, 532–547. doi:10.​1177/​0013164412464875​.CrossRef
Metagegevens
Titel
Assessing the Straightforwardly-Worded Brief Fear of Negative Evaluation Scale for Differential Item Functioning Across Gender and Ethnicity
Auteurs
Jared K. Harpole
Cheri A. Levinson
Carol M. Woods
Thomas L. Rodebaugh
Justin W. Weeks
Patrick J. Brown
Richard G. Heimberg
Andrew R. Menatti
Carlos Blanco
Franklin Schneier
Michael Liebowitz
Publicatiedatum
01-06-2015
Uitgeverij
Springer US
Gepubliceerd in
Journal of Psychopathology and Behavioral Assessment / Uitgave 2/2015
Print ISSN: 0882-2689
Elektronisch ISSN: 1573-3505
DOI
https://doi.org/10.1007/s10862-014-9455-9

Andere artikelen Uitgave 2/2015

Journal of Psychopathology and Behavioral Assessment 2/2015 Naar de uitgave