Skip to main content
Top
Gepubliceerd in: Cognitive Therapy and Research 4/2017

25-01-2017 | Original Article

How Well Can We Measure Visual Attention? Psychometric Properties of Manual Response Times and First Fixation Latencies in a Visual Search Paradigm

Auteurs: Richard Wermes, Tania M. Lincoln, Sylvia Helbig-Lang

Gepubliceerd in: Cognitive Therapy and Research | Uitgave 4/2017

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Attentional biases are considered to be important for the development and maintenance of anxiety disorders, but despite widespread research in this area, the psychometric properties of measures targeting attentional allocation processes have rarely been evaluated. The current study assessed the reliability and validity of manual response times and first fixation latencies within a visual search paradigm, including data from one hundred twenty-two participants (n = sixty-two participants with social anxiety disorder). We found raw manual response times to be highly reliable, while raw first fixation latencies, in most cases, were not. Bias scores were neither reliable for manual responses nor for first fixation latencies. However, we found indicators of convergent validity, as raw values and also bias scores of both measures were significantly correlated. These results raise doubts about our ability to accurately measure visual attention, especially via eye-tracking procedures.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
go back to reference Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J., Burns, M., & Chen, X. (2009). Attention training in individuals with generalized social phobia: a randomized controlled trial. Journal of Consulting and Clinical Psychology, 77(5), 961–973. doi: 10.1037/a0016685.CrossRefPubMedPubMedCentral Amir, N., Beard, C., Taylor, C. T., Klumpp, H., Elias, J., Burns, M., & Chen, X. (2009). Attention training in individuals with generalized social phobia: a randomized controlled trial. Journal of Consulting and Clinical Psychology, 77(5), 961–973. doi: 10.​1037/​a0016685.CrossRefPubMedPubMedCentral
go back to reference Amir, N., Elias, J., Klumpp, H., & Przeworski, A. (2003). Attentional bias to threat in social phobia: Facilitated processing of threat or difficulty disengaging attention from threat? Behaviour Research and Therapy, 41(11), 1325–1335. doi: 10.1016/S0005-7967(03)00039-1.CrossRefPubMed Amir, N., Elias, J., Klumpp, H., & Przeworski, A. (2003). Attentional bias to threat in social phobia: Facilitated processing of threat or difficulty disengaging attention from threat? Behaviour Research and Therapy, 41(11), 1325–1335. doi: 10.​1016/​S0005-7967(03)00039-1.CrossRefPubMed
go back to reference Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychological Bulletin, 133(1), 1–24. doi: 10.1037/0033-2909.133.1.1.CrossRefPubMed Bar-Haim, Y., Lamy, D., Pergamin, L., Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2007). Threat-related attentional bias in anxious and nonanxious individuals: a meta-analytic study. Psychological Bulletin, 133(1), 1–24. doi: 10.​1037/​0033-2909.​133.​1.​1.CrossRefPubMed
go back to reference Boettcher, J., Leek, L., Matson, L., Holmes, E. A., Browning, M., MacLeod, C., Andersson, G., & Carlbring, P. (2013). Internet-based attention bias modification for social anxiety: a randomised controlled comparison of training towards negative and training towards positive cues. PLoS ONE, 8(9), 1–14. doi: 10.1371/journal.pone.0071760.CrossRef Boettcher, J., Leek, L., Matson, L., Holmes, E. A., Browning, M., MacLeod, C., Andersson, G., & Carlbring, P. (2013). Internet-based attention bias modification for social anxiety: a randomised controlled comparison of training towards negative and training towards positive cues. PLoS ONE, 8(9), 1–14. doi: 10.​1371/​journal.​pone.​0071760.CrossRef
go back to reference Bradley, B. P., Mogg, K., White, J., Groom, C., & de Bono, J. (1999). Attentional bias for emotional faces in generalized anxiety disorder. The British Journal of Clinical Psychology/The British Psychological Society, 38(3), 267–278. doi: 10.1348/014466599162845.CrossRef Bradley, B. P., Mogg, K., White, J., Groom, C., & de Bono, J. (1999). Attentional bias for emotional faces in generalized anxiety disorder. The British Journal of Clinical Psychology/The British Psychological Society, 38(3), 267–278. doi: 10.​1348/​014466599162845.CrossRef
go back to reference Brosschot, J. F., De Ruiter, C., & Kindt, M. (1999). Processing bias in anxious subjects and repressors, measured by emotional Stroop interference and attentional allocation. Personality and Individual Differences, 26(5), 777–793. doi: 10.1016/S0191-8869(98)00173-1.CrossRef Brosschot, J. F., De Ruiter, C., & Kindt, M. (1999). Processing bias in anxious subjects and repressors, measured by emotional Stroop interference and attentional allocation. Personality and Individual Differences, 26(5), 777–793. doi: 10.​1016/​S0191-8869(98)00173-1.CrossRef
go back to reference Brown, H. M., Eley, T. C., Broeren, S., MacLeod, C., Rinck, M., Hadwin, J. A., & Lester, K. J. (2014). Psychometric properties of reaction time based experimental paradigms measuring anxiety-related information-processing biases in children. Journal of Anxiety Disorders, 28(1), 97–107. doi: 10.1016/j.janxdis.2013.11.004.CrossRefPubMed Brown, H. M., Eley, T. C., Broeren, S., MacLeod, C., Rinck, M., Hadwin, J. A., & Lester, K. J. (2014). Psychometric properties of reaction time based experimental paradigms measuring anxiety-related information-processing biases in children. Journal of Anxiety Disorders, 28(1), 97–107. doi: 10.​1016/​j.​janxdis.​2013.​11.​004.CrossRefPubMed
go back to reference Chen, N. T. M., Clarke, P. J. F., Watson, T. L., MacLeod, C., & Guastella, A. J. (2014). Biased saccadic responses to emotional stimuli in anxiety: an antisaccade study. PLoS ONE, 9(2), 1–7. doi:10.1371/journal.pone.0086474. Chen, N. T. M., Clarke, P. J. F., Watson, T. L., MacLeod, C., & Guastella, A. J. (2014). Biased saccadic responses to emotional stimuli in anxiety: an antisaccade study. PLoS ONE, 9(2), 1–7. doi:10.​1371/​journal.​pone.​0086474.
go back to reference Cooper, R. M., Bailey, J. E., Diaper, A., Stirland, R., Renton, L. E., Benton, C. P., … & Munafo, M. R. (2011). Effects of 7.5% CO2 inhalation on allocation of spatial attention to facial cues of emotional expression. Cognition and Emotion, 25(4), 626–638. doi: 10.1177/0269881108096981.CrossRefPubMed Cooper, R. M., Bailey, J. E., Diaper, A., Stirland, R., Renton, L. E., Benton, C. P., … & Munafo, M. R. (2011). Effects of 7.5% CO2 inhalation on allocation of spatial attention to facial cues of emotional expression. Cognition and Emotion, 25(4), 626–638. doi: 10.​1177/​0269881108096981​.CrossRefPubMed
go back to reference Dalgleish, T., Taghavi, R., Neshat-Doost, H., Moradi, A., Canterbury, R., & Yule, W. (2003). Patterns of processing bias for emotional information across clinical disorders: a comparison of attention, memory, and prospective cognition in children and adolescents with depression, generalized anxiety, and posttraumatic stress disorder. Journal of Clinical Child and Adolescent Psychology 32(1), 10–21. doi: 10.1207/S15374424JCCP3201_02.CrossRefPubMed Dalgleish, T., Taghavi, R., Neshat-Doost, H., Moradi, A., Canterbury, R., & Yule, W. (2003). Patterns of processing bias for emotional information across clinical disorders: a comparison of attention, memory, and prospective cognition in children and adolescents with depression, generalized anxiety, and posttraumatic stress disorder. Journal of Clinical Child and Adolescent Psychology 32(1), 10–21. doi: 10.​1207/​S15374424JCCP320​1_​02.CrossRefPubMed
go back to reference Eastwood, J., Smile, D., Oakman, J., Farvolden, P., van Ameringen, M., Mancini, C., & Merikle, P. (2005). Individuals with social phobia are biased to become aware of negative faces. Visual Cognition, 12(1), 159–179. doi: 10.1080/13506280444000175.CrossRef Eastwood, J., Smile, D., Oakman, J., Farvolden, P., van Ameringen, M., Mancini, C., & Merikle, P. (2005). Individuals with social phobia are biased to become aware of negative faces. Visual Cognition, 12(1), 159–179. doi: 10.​1080/​1350628044400017​5.CrossRef
go back to reference Egloff, B., & Hock, M. (2003). Assessing attention allocation toward threat-related stimuli: A comparison of the emotional Stroop task and the attentional probe task. Personality and Individual Differences, 35(2), 475–483. doi: 10.1016/S0191-8869(02)00265-9.CrossRef Egloff, B., & Hock, M. (2003). Assessing attention allocation toward threat-related stimuli: A comparison of the emotional Stroop task and the attentional probe task. Personality and Individual Differences, 35(2), 475–483. doi: 10.​1016/​S0191-8869(02)00265-9.CrossRef
go back to reference Eide, P., Kemp, A., Silberstein, R. B., Nathan, P. J., & Stough, C. (2002). Test–retest reliability of the emotional stroop task: examining the paradox of measurement change. The Journal of Psychology, 136(5), 514–520. doi: 10.1080/00223980209605547.CrossRefPubMed Eide, P., Kemp, A., Silberstein, R. B., Nathan, P. J., & Stough, C. (2002). Test–retest reliability of the emotional stroop task: examining the paradox of measurement change. The Journal of Psychology, 136(5), 514–520. doi: 10.​1080/​0022398020960554​7.CrossRefPubMed
go back to reference Fresco, D. M., Coles, M. E., Heimberg, R. G., Liebowitz, M. R., Hami, S., Stein, M. B., & Goetz, D. (2001). The Liebowitz social anxiety scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035. doi: 10.1017/S0033291701004056.CrossRefPubMed Fresco, D. M., Coles, M. E., Heimberg, R. G., Liebowitz, M. R., Hami, S., Stein, M. B., & Goetz, D. (2001). The Liebowitz social anxiety scale: a comparison of the psychometric properties of self-report and clinician-administered formats. Psychological Medicine, 31(6), 1025–1035. doi: 10.​1017/​S003329170100405​6.CrossRefPubMed
go back to reference Gilboa-Schechtman, E., Foa, E. B., & Amir, N. (1999). Attentional biases for facial expressions in social phobia: The face-in-the-crowd paradigm. Cognition and Emotion, 13(3), 305–318. doi: 10.1080/026999399379294.CrossRef Gilboa-Schechtman, E., Foa, E. B., & Amir, N. (1999). Attentional biases for facial expressions in social phobia: The face-in-the-crowd paradigm. Cognition and Emotion, 13(3), 305–318. doi: 10.​1080/​026999399379294.CrossRef
go back to reference Gotlib, I. H., Kasch, K. L., Traill, S., Joormann, J., Arnow, B. A., & Johnson, S. L. (2004). Coherence and specificity of information-processing biases in depression and social phobia. Journal of Abnormal Psychology, 113(3), 386–398. doi: 10.1037/0021-843X.113.3.386.CrossRefPubMed Gotlib, I. H., Kasch, K. L., Traill, S., Joormann, J., Arnow, B. A., & Johnson, S. L. (2004). Coherence and specificity of information-processing biases in depression and social phobia. Journal of Abnormal Psychology, 113(3), 386–398. doi: 10.​1037/​0021-843X.​113.​3.​386.CrossRefPubMed
go back to reference Hoffman, J. E. (1998). Visual attention and eye movements. Attention, 384, 119–153. Hoffman, J. E. (1998). Visual attention and eye movements. Attention, 384, 119–153.
go back to reference Koster, E. H. W., Crombez, G., Verschuere, B., & De Houwer, J. (2006). Attention to threat in anxiety-prone individuals: Mechanisms underlying attentional bias. Cognitive Therapy and Research, 30(5), 635–643. doi: 10.1007/s10608-006-9042-9.CrossRef Koster, E. H. W., Crombez, G., Verschuere, B., & De Houwer, J. (2006). Attention to threat in anxiety-prone individuals: Mechanisms underlying attentional bias. Cognitive Therapy and Research, 30(5), 635–643. doi: 10.​1007/​s10608-006-9042-9.CrossRef
go back to reference Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the Radboud Faces Database. Cognition and Emotion, 24(8), 1377–1388. doi: 10.1080/02699930903485076.CrossRef Langner, O., Dotsch, R., Bijlstra, G., Wigboldus, D. H. J., Hawk, S. T., & van Knippenberg, A. (2010). Presentation and validation of the Radboud Faces Database. Cognition and Emotion, 24(8), 1377–1388. doi: 10.​1080/​0269993090348507​6.CrossRef
go back to reference Laux, L., Glanzmann, P., Schaffner, P., & Spielberger, C. D. (1981). State-Trait-Anxiety-Inventory (STAI). Theoretical Foundations and Instructions. Weinheim: Beltz. Laux, L., Glanzmann, P., Schaffner, P., & Spielberger, C. D. (1981). State-Trait-Anxiety-Inventory (STAI). Theoretical Foundations and Instructions. Weinheim: Beltz.
go back to reference MacLeod, J. W., Lawrence, M. A., McConnell, M. M., Eskes, G. A., Klein, R. M., & Shore, D. I. (2010). Appraising the ANT: Psychometric and theoretical considerations of the attention network test. Neuropsychology, 24(5), 637–651. doi: 10.1037/a0019803.CrossRefPubMed MacLeod, J. W., Lawrence, M. A., McConnell, M. M., Eskes, G. A., Klein, R. M., & Shore, D. I. (2010). Appraising the ANT: Psychometric and theoretical considerations of the attention network test. Neuropsychology, 24(5), 637–651. doi: 10.​1037/​a0019803.CrossRefPubMed
go back to reference Mogg, K., Bradley, B., Miles, F., & Dixon, R. (2004). Time course of attentional bias for threat scenes: testing the vigilance-avoidance hypothesis. Cognition and Emotion, 18(5), 689–700. doi: 10.1080/02699930341000158.CrossRef Mogg, K., Bradley, B., Miles, F., & Dixon, R. (2004). Time course of attentional bias for threat scenes: testing the vigilance-avoidance hypothesis. Cognition and Emotion, 18(5), 689–700. doi: 10.​1080/​0269993034100015​8.CrossRef
go back to reference Mogg, K., Bradley, B. P., Dixon, C., Fisher, S., Twelftree, H., & McWilliams, A. (2000). Trait anxiety, defensiveness and selective processing of threat: an investigation using two measures of attentional bias. Personality and Individual Differences, 28(1), 1063–1077. doi: 10.1016/S0191-8869(99)00157-9.CrossRef Mogg, K., Bradley, B. P., Dixon, C., Fisher, S., Twelftree, H., & McWilliams, A. (2000). Trait anxiety, defensiveness and selective processing of threat: an investigation using two measures of attentional bias. Personality and Individual Differences, 28(1), 1063–1077. doi: 10.​1016/​S0191-8869(99)00157-9.CrossRef
go back to reference Mogg, K., Millar, N., & Bradley, B. P. (2000). Biases in eye movements to threatening facial expressions in generalized anxiety disorder and depressive disorder. Journal of Abnormal Psychology, 109(4), 695–704. doi: 10.1037//0021-843X.CrossRefPubMed Mogg, K., Millar, N., & Bradley, B. P. (2000). Biases in eye movements to threatening facial expressions in generalized anxiety disorder and depressive disorder. Journal of Abnormal Psychology, 109(4), 695–704. doi: 10.​1037/​/​0021-843X.CrossRefPubMed
go back to reference Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: principles and applications. New Jersey: Upper Saddle River. Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: principles and applications. New Jersey: Upper Saddle River.
go back to reference Neubauer, K., von Auer, M., Murray, E., Petermann, F., Helbig-Lang, S., & Gerlach, A. L. (2013). Internet-delivered attention modification training as a treatment for social phobia: A randomized controlled trial. Behaviour Research and Therapy, 51(2), 87–97. doi: 10.1016/j.brat.2012.10.006.CrossRefPubMed Neubauer, K., von Auer, M., Murray, E., Petermann, F., Helbig-Lang, S., & Gerlach, A. L. (2013). Internet-delivered attention modification training as a treatment for social phobia: A randomized controlled trial. Behaviour Research and Therapy, 51(2), 87–97. doi: 10.​1016/​j.​brat.​2012.​10.​006.CrossRefPubMed
go back to reference Quigley, L., Nelson, A. L., Carriere, J., Smilek, D., & Purdon, C. (2012). The effects of trait and state anxiety on attention to emotional images: An eye-tracking study. Cognition and Emotion, 26, 1–22. doi: 10.1080/02699931.2012.662892.CrossRef Quigley, L., Nelson, A. L., Carriere, J., Smilek, D., & Purdon, C. (2012). The effects of trait and state anxiety on attention to emotional images: An eye-tracking study. Cognition and Emotion, 26, 1–22. doi: 10.​1080/​02699931.​2012.​662892.CrossRef
go back to reference Rinck, M., Becker, E. S., Kellermann, J., & Roth, W. T. (2003). Selective attention in anxiety: distraction and enhancement in visual search. Depression and Anxiety, 18(1), 18–28. doi: 10.1002/da.10105.CrossRefPubMed Rinck, M., Becker, E. S., Kellermann, J., & Roth, W. T. (2003). Selective attention in anxiety: distraction and enhancement in visual search. Depression and Anxiety, 18(1), 18–28. doi: 10.​1002/​da.​10105.CrossRefPubMed
go back to reference Schmidt, N. B., Richey, J. A., Buckner, J. D., & Timpano, K. R. (2009). Attention training for generalized social anxiety disorder. Journal of Abnormal Psychology, 118(1), 5–14. doi: 10.1037/a0013643.CrossRefPubMed Schmidt, N. B., Richey, J. A., Buckner, J. D., & Timpano, K. R. (2009). Attention training for generalized social anxiety disorder. Journal of Abnormal Psychology, 118(1), 5–14. doi: 10.​1037/​a0013643.CrossRefPubMed
go back to reference Sposari, J. A., & Rapee, R. M. (2007). Attentional bias toward facial stimuli under conditions of social threat in socially phobic and nonclinical participants. Cognitive Therapy and Research, 31(1), 23–37. doi: 10.1007/s10608-006-9073-2.CrossRef Sposari, J. A., & Rapee, R. M. (2007). Attentional bias toward facial stimuli under conditions of social threat in socially phobic and nonclinical participants. Cognitive Therapy and Research, 31(1), 23–37. doi: 10.​1007/​s10608-006-9073-2.CrossRef
go back to reference Stangier, U., & Heidenreich, T. (2005). Liebowitz Soziale Angst-Skala (LSAS) [Liebowitz Social Anxiety Scale]. In Collegium Internationale Psychiatriae Scalarum (Ed.), Internationale Skalen für Psychiatrie (pp. 299–305). Göttingen: Hogrefe. Stangier, U., & Heidenreich, T. (2005). Liebowitz Soziale Angst-Skala (LSAS) [Liebowitz Social Anxiety Scale]. In Collegium Internationale Psychiatriae Scalarum (Ed.), Internationale Skalen für Psychiatrie (pp. 299–305). Göttingen: Hogrefe.
go back to reference Waechter, S., Nelson, A. L., Wright, C., Hyatt, A., & Oakman, J. (2014). Measuring attentional bias to threat: Reliability of dot probe and eye movement indices. Cognitive Therapy and Research, 38(3), 313–333. doi: 10.1007/s10608-013-9588-2.CrossRef Waechter, S., Nelson, A. L., Wright, C., Hyatt, A., & Oakman, J. (2014). Measuring attentional bias to threat: Reliability of dot probe and eye movement indices. Cognitive Therapy and Research, 38(3), 313–333. doi: 10.​1007/​s10608-013-9588-2.CrossRef
go back to reference Waechter, S., & Stolz, J. A. (2015). Trait anxiety, state anxiety, and attentional bias to threat: assessing the psychometric properties of response time measures. Cognitive Therapy and Research, 39(4), 441–458. doi: 10.1007/s10608-015-9670-z.CrossRef Waechter, S., & Stolz, J. A. (2015). Trait anxiety, state anxiety, and attentional bias to threat: assessing the psychometric properties of response time measures. Cognitive Therapy and Research, 39(4), 441–458. doi: 10.​1007/​s10608-015-9670-z.CrossRef
go back to reference Wittchen, H.-U., Zaudig, M., & Fydrich, T. H. (1997). SKID - Strukturiertes Klinisches Interview für DSM-IV. Achse I und II Handanweisungen [Structured Clinical Interview for DSM-IV]. Göttingen: Hogrefe. doi: 10.1026//0084-5345.28.1.68. Wittchen, H.-U., Zaudig, M., & Fydrich, T. H. (1997). SKID - Strukturiertes Klinisches Interview für DSM-IV. Achse I und II Handanweisungen [Structured Clinical Interview for DSM-IV]. Göttingen: Hogrefe. doi: 10.​1026/​/​0084-5345.​28.​1.​68.
go back to reference Zanarini, M. C., Skodol, A. E., Bender, D., Dolan, R., Sanislow, C., Schaefer, E., … Gundersono, J. G. (2000). The collaborative longitudinal personality disorders study: Reliability of axis I and II diagnoses. Journal of Personality Disorders, 14(4), 291–299. doi: 10.1521/pedi.2000.14.4.291.CrossRefPubMed Zanarini, M. C., Skodol, A. E., Bender, D., Dolan, R., Sanislow, C., Schaefer, E., … Gundersono, J. G. (2000). The collaborative longitudinal personality disorders study: Reliability of axis I and II diagnoses. Journal of Personality Disorders, 14(4), 291–299. doi: 10.​1521/​pedi.​2000.​14.​4.​291.CrossRefPubMed
Metagegevens
Titel
How Well Can We Measure Visual Attention? Psychometric Properties of Manual Response Times and First Fixation Latencies in a Visual Search Paradigm
Auteurs
Richard Wermes
Tania M. Lincoln
Sylvia Helbig-Lang
Publicatiedatum
25-01-2017
Uitgeverij
Springer US
Gepubliceerd in
Cognitive Therapy and Research / Uitgave 4/2017
Print ISSN: 0147-5916
Elektronisch ISSN: 1573-2819
DOI
https://doi.org/10.1007/s10608-016-9830-9

Andere artikelen Uitgave 4/2017

Cognitive Therapy and Research 4/2017 Naar de uitgave