Abstract
The dot-probe task is used to measure attentional biases toward threat. However, the test–retest reliability and validity of the task have been called into question. No studies to date have included an extended number of testing sessions or tailored the task to individual participants by incorporating self-relevant stimuli—doing so may improve reliability. Here, participants provided 10 words that caused them anxiety and 10 neutral words which were incorporated into a dot-probe task for 6 sessions. The test–retest reliability of their bias indices was stronger in bottom-target trials relative to top-target trials and stronger among later relative to earlier sessions. State and trait anxiety were moderately correlated with bias indices in later sessions, but not earlier sessions. Overall reaction time in each session was moderately correlated with state and trait anxiety. These results suggest that including extended testing may facilitate dot-probe task test–retest reliability and validity.
Similar content being viewed by others
Notes
This effect was not related to changes in variance given that the overall standard deviation did not change across sessions, F(5, 23) = 2.22, p > 0.05.
References
American Psychiatric Association (2013) Diagnostic and statistical manual of mental disorders (DSM-5). American Psychiatric Pub, Washington
Bar-Haim Y (2010) Research review: attention bias modification (ABM): a novel treatment for anxiety disorders. J Child Psychol Psychiatry 51(8):859–870. https://doi.org/10.1111/j.1469-7610.2010.02251.x
Becker MW (2010) The effectiveness of a gaze cue depends on the facial expression of emotion: evidence from simultaneous competing cues. Atten Percept Psychophys 72(7):1814–1824. https://doi.org/10.3758/app.72.7.1814
Bradley MM, Lang PJ (1999) Affective norms for English words (ANEW): instruction manual and affective ratings. Technical Report C-1, The Center for Research in Psychophysiology, University of Florida
Carlson JM (2016) Facilitated orienting underlies fearful face-enhanced gaze cueing of spatial location. Cogent Psychol 3(1):1147120
Carlson JM, Aday JS (2017) In the presence of conflicting gaze cues, fearful expression and eye-size guide attention. Cogn Emot. https://doi.org/10.1080/02699931.2017.1391065
Carlson JM, Mujica-Parodi LR (2014) Facilitated Attentional orienting and delayed disengagement to conscious and nonconscious fearful faces. J Nonverbal Behav 39(1):69–77. https://doi.org/10.1007/s10919-014-0185-1
Carlson JM, Reinke KS (2008) Masked fearful faces modulate the orienting of covert spatial attention. Emotion 8(4):522–529. https://doi.org/10.1037/a0012653
Carlson JM, Reinke KS (2014) Attending to the fear in your eyes: facilitated orienting and delayed disengagement. Cogn Emot 28(8):1398–1406
Carlson JM, Fee AL, Reinke KS (2009a) Backward masked snakes and guns modulate spatial attention. Evol Psychol 7(4):147470490900700. https://doi.org/10.1177/147470490900700404
Carlson JM, Reinke KS, Habib R (2009b) A left amygdala mediated network for rapid orienting to masked fearful faces. Neuropsychologia 47(5):1386–1389. https://doi.org/10.1016/j.neuropsychologia.2009.01.026
Carlson JM, Beacher F, Reinke KS, Habib R, Harmon-Jones E, Mujica-Parodi LR, Hajcak G (2012) Nonconscious attention bias to threat is correlated with anterior cingulate cortex gray matter volume: a voxel-based morphometry result and replication. NeuroImage 59(2):1713–1718. https://doi.org/10.1016/j.neuroimage.2011.09.040
Carlson JM, Torrence RD, Vander Hyde MR (2016) Beware the eyes behind the mask: the capture and hold of selective attention by backward masked fearful eyes. Motiv Emot 40(3):498–505. https://doi.org/10.1007/s11031-016-9542-1
Fox E (2002) Processing emotional facial expressions: the role of anxiety and awareness. Cogn Affect Behav Neurosci 2(1):52–63. https://doi.org/10.3758/cabn.2.1.52
Gilboa-Schechtman E, Foa EB, Amir N (1999) Attentional biases for facial expressions in social phobia: the face-in-the-crowd paradigm. Cogn Emot 13(3):305–318
Julian LJ (2011) Measures of anxiety: state-trait anxiety inventory (STAI), beck anxiety inventory (BAI), and hospital anxiety and depression scale-anxiety (HADS-A). Arthritis Care Res 63(S11):S467–S472
Knight RG, Waal-Manning HJ, Spears GF (1983) Some norms and reliability data for the state-trait anxiety inventory and the Zung self-rating depression scale. Br J Clin Psychol 22(4):245–249
Koster EH, Crombez G, Verschuere B, De Houwer J (2004) Selective attention to threat in the dot probe paradigm: differentiating vigilance and difficulty to disengage. Behav Res Ther 42(10):1183–1192. https://doi.org/10.1016/j.brat.2003.08.001
Macleod C, Mathews A, Tata P (1986) Attentional bias in emotional disorders. J Abnorm Psychol 95(1):15–20
MacLeod C, Rutherford E, Campbell L, Ebsworthy G, Holker L (2002) Selective attention and emotional vulnerability: assessing the causal basis of their association through the experimental manipulation of attentional bias. J Abnorm Psychol 111(1):107–123. https://doi.org/10.1037//0021-843x.111.1.107
Mogg K, Bradley BP (1999) Orienting of attention to threatening facial expressions presented under conditions of restricted awareness. Cogn Emot 13(6):713–740. https://doi.org/10.1080/026999399379050
Mogg K, Bradley BP (2002) Selective orienting of attention to masked threat faces in social anxiety. Behav Res Ther 40(12):1403–1414. https://doi.org/10.1016/s0005-7967(02)00017-7
Mogg K, Bradley BP (2006) Time course of attentional bias for fear-relevant pictures in spider-fearful individuals. Behav Res Ther 44(9):1241–1250
Mogg K, Holmes A, Garner M, Bradley BP (2008) Effects of threat cues on attentional shifting, disengagement and response slowing in anxious individuals. Behav Res Ther 46(5):656–667
Mogg K, Waters AM, Bradley BP (2017) Attention bias modification (ABM): review of effects of multisession ABM training on anxiety and threat-related attention in high-anxious individuals. Clin Psychol Sci. https://doi.org/10.1177/2167702617696359
Nandi A, Beard JR, Galea S (2009) Epidemiologic heterogeneity of common mood and anxiety disorders over the lifecourse in the general population: a systematic review. BMC Psychiatry 9(1):31
Price RB, Kuckertz JM, Siegle GJ, Ladouceur CD, Silk JS, Ryan ND, Dahl RE, Amir N (2015) Empirical recommendations for improving the stability of the dot-probe task in clinical research. Psychol Assess 27(2):365–376. https://doi.org/10.1037/pas0000036
Quek KF, Low WY, Razack AH, Loh CS, Chua CB (2004) Reliability and validity of the Spielberger state-trait anxiety inventory (STAI) among urological patients: a Malaysian study. Med J Malays 59(2):258–267
Salemink E, Van den Hout MA, Kindt M (2007) Selective attention and threat: quick orienting versus slow disengagement and two versions of the dot probe task. Behav Res Ther 45(3):607–615. https://doi.org/10.1016/j.brat.2006.04.004
Schmukle SC (2005) Unreliability of the dot probe task. Eur J Pers 19(7):595–605. https://doi.org/10.1002/per.554
Spielberger CD, Gorsuch RL, Lushene RE (1970) Manual for the state-trait anxiety inventory (self-evaluation questionnaire). Consulating Psychology Press, Palo Alto
Staugaard SR (2009) Reliability of two versions of the dot-probe task using photographic faces. Psychol Sci Q 51(3):339–350
Torrence RD, Wylie E, Carlson JM (2017) The time-course for the capture and hold of visuospatial attention by fearful and happy faces. J Nonverbal Behav 41(2):139–153. https://doi.org/10.1007/s10919-016-0247-7
Van Bockstaele B, Verschuere B, Tibboel H, De Houwer J, Crombez G, Koster EH (2014) A review of current evidence for the causal impact of attentional bias on fear and anxiety. Psychol Bull 140(3):682
Waechter S, Nelson AL, Wright C, Hyatt A, Oakman J (2014) Measuring attentional bias to threat: reliability of dot probe and eye movement indices. Cogn Ther Res 38(3):313–333
Weber MA, Morrow KA, Rizer WS, Kangas KJ, Carlson JM (2016) Sustained, not habituated, activity in the human amygdala: a pilot fMRI dot-probe study of attentional bias to fearful faces. Cogent Psychol 3(1):1259881
Zvielli A, Bernstein A, Koster EH (2015) Temporal dynamics of attentional bias. Clin Psychol Sci 3(5):772–788
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interest.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Aday, J.S., Carlson, J.M. Extended testing with the dot-probe task increases test–retest reliability and validity. Cogn Process 20, 65–72 (2019). https://doi.org/10.1007/s10339-018-0886-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10339-018-0886-1