Review articleSensory neural pathways revisited to unravel the temporal dynamics of the Simon effect: A model-based cognitive neuroscience approach
Section snippets
Introducing the Simon effect and its temporal dynamics
The Simon task was first described by Simon and colleagues (Simon and Rudell, 1967, Simon and Small, 1969). It captures an intuitive phenomenon: we perform much better when the source of information and appropriate response are spatially aligned (Fitts and Deininger, 1954). In the original Simon task, participants are asked to identify tones played to their right or left ears. High and low pitch sounds are assigned to right or left keys, as instructed. The spatial location of the auditory
Dual-route models and the role of cognitive control
De Jong, Liang and Lauber (De Jong et al., 1994) proposed a dual-route model to explain the decreasing delta plots in the Simon task (see Fig. 2). They suggested that two processes take place in parallel. One process refers to a task-relevant indirect route that processes the deliberate response decision based on task demands. The other process refers to a task-irrelevant process, where the spatial code directly activates a response that corresponds with the relative location of the stimulus (
The inconsistency of the delta plots − common or separate mechanisms?
The decreasing delta plot has been a hallmark of the horizontal (left-right) visual Simon task. However, not all variations of the Simon task show this particular pattern (see Fig. 1). An increase of the Simon effect for longer RTs has been shown for other forms of the task and for other modalities, such as when hands are crossed in a horizontal visual Simon task (Wascher et al., 2001), in vertical visual Simon tasks (Töbel et al., 2014, Wiegand and Wascher, 2007, Wiegand and Wascher, 2005),
Mathematical cognitive process models of the Simon effect
Mathematical cognitive models offer a means to quantitatively formalize cognitive theories communicated verbally (i.e., qualitative). Unlike descriptive statistical models, such as delta plots, cognitive models are generative models (or “process models”), that provide an account not just of how behavioral data is structured, but also how it could potentially have been generated. One class of mathematical cognitive models particularly suited to better understand the temporal dynamics of the
How do ‘what’ and ‘where’ neural pathways subserve the Simon effect?
Functional neuroanatomy has the potential to constrain the models of the underlying mechanisms in the Simon task. We argue that cognitive models like the DMC can help us better understand the temporal dynamics of the underlying Simon task and that functional neuroanatomy can ground its assumptions in the structure of the brain. We qualitatively link the neural structure of two separate neural pathways that independently process spatial and non-spatial features of the input with mathematical
Who controls the ‘what’ and ‘where’ pathways?
Information is processed in the ‘what’ and ‘where’ pathways in a parallel manner leading to a response conflict in the non-corresponding condition. How does the decision to respond based on the ‘what’ pathway and ignore or suppress the ‘where’ pathway come about in the brain? The spatial ‘where’ pathway plays a role in guiding one’s actions (visual: Kravitz et al., 2010; auditory: Warren et al., 2005; tactile: Dijkerman and de Haan, 2007). On a portion of the trials, Servant and colleagues (
Concluding remarks
In the present review we proposed a comprehensive framework to account for the temporal dynamics of the Simon effect as measured by different variants of the Simon task. The framework brought forth in the present review links cognitive models with the neuronal pathways accountable for the processing of spatial (‘where’) and non-spatial (‘what’) information. Recent literature suggests that this organization is common among vision, audition, and somatosensory modalities. We have argued that
Acknowledgement
This research was supported by an ERC grant from the European Research Council (BUF), by a Vidi grant from the Dutch Organization for Scientific Research (BUF), and by the Israel Science Foundation (YS, grant no. 93/15).
References (86)
- et al.
Assessing the auditory dual-pathway model in humans
Neuroimage
(2004) - et al.
Time course of the Simon effect in pointing movements for horizontal, vertical, and acoustic stimuli: evidence for a common mechanism
Acta Psychol. (Amst)
(2008) - et al.
Getting in touch: segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging
Neuroimage
(2007) - et al.
The attentional selection of spatial and non-spatial attributes in touch: ERP evidence for parallel and independent processes
Biol. Psychol.
(2004) - et al.
Evidence for strategic suppression of irrelevant activation in the Simon task
Acta Psychol. (Amst.)
(2013) - et al.
The role of the right inferior frontal gyrus: inhibition and attentional control
Neuroimage
(2010) - et al.
The effects of intensity and irrelevant location of a tactile stimulation in a choice reaction time task
Neuropsychologia
(1992) - et al.
The effect of irrelevant spatial correspondences on two-choice response-time
Acta Psychol. (Amst.)
(1975) - et al.
Distinct pathways involved in sound recognition and localization: a human fMRI study
Neuroimage
(2001) - et al.
Perceptual decision neurosciences – a model-based review
Neuroscience
(2014)
Beyond mind-reading: multi-voxel pattern analysis of fMRI data
Trends Cogn. Sci.
What vs. where in touch: an fMRI study
Neuroimage
What is crossed in crossed-hand effects?
Acta Psychol. (Amst.)
Conflict tasks and the diffusion framework: insight in model constraints based on psychological laws
Cogn. Psychol.
Suppression of irrelevant activation in the horizontal and vertical Simon task differs quantitatively not qualitatively
Acta Psychol. (Amst.)
A Bayesian framework for simultaneously modeling neural and behavioral data
Neuroimage
Approaches to analysis in model-based cognitive neuroscience
J. Math. Psychol.
Automatic and controlled stimulus processing in conflict tasks: superimposed diffusion processes and delta functions
Cogn. Psychol.
What and where in the human brain
Curr. Biol.
Horizontal and vertical Simon effect: different underlying mechanisms?
Cognition
Sounds do-able: auditory-motor transformations and the posterior temporal plane
Trends Neurosci.
What and where in the human auditory system
Proc. Natl. Acad. Sci. U. S. A.
Cortical and subcortical contributions to stop signal response inhibition: role of the subthalamic nucleus
J. Neurosci.
Inhibition and the right inferior frontal cortex: one decade on Inhibition and the right inferior frontal cortex
Trends Cogn. Sci.
The neural basis of inhibition in cognitive control
Neuroscience
The what, where and how of auditory-object perception
Nat. Rev. Neurosci.
Human interaural time difference thresholds for sine tones: the high-frequency limit
J. Acoust. Soc. Am.
Effects of saccades and response type on the Simon effect: if you look at the stimulus, the Simon effect may be gone
Q. J. Exp. Psychol. (Hove)
Conditional and unconditional automaticity: a dual-process model of effects of spatial stimulus-response correspondence
J. Exp. Psychol. Hum. Percept. Perform.
Somatosensory processes subserving perception and action
Behav. Brain Sci.
Evaluating cognitive action control using eye-movement analysis: an oculomotor adaptation of the simon task
Front. Hum. Neurosci.
Distinguishing the time- and magnitude-difference accounts of the Simon effect: evidence from the reach-to-touch paradigm
Attention, Perception, Psychophys.
S-R compatibility: correspondence among paired elements within stimulus and response codes
J. Exp. Psychol.
Striatum and pre-SMA facilitate decision-making under time pressure
Proc. Natl. Acad. Sci. U. S. A.
Function and structure of the right inferior frontal cortex predict individual differences in response inhibition: a model-based approach
J. Neurosci.
Neural mechanisms, temporal dynamics, and individual differences in interference control
J. Cogn. Neurosci.
Sequential sampling models in cognitive neuroscience: advantages applications, and extensions
Annu. Rev. Psychol.
Simon in action: the effect of spatial congruency on grasping trajectories
Psychol. Res.
What is happening in the dorsal visual pathway
Trends Cogn. Sci.
Spatial and non-spatial auditory processing in the lateral intraparietal area
Exp. Brain Res.
Interaural level differences and the level-meter model
J. Acoust. Soc. Am.
Dissociation of object and spatial visual processing pathways in human extrastriate cortex
Proc. Natl. Acad. Sci. U. S. A.
Distributed and overlapping representations of faces and objects in ventral temporal cortex
Science
Cited by (14)
Impaired attention mechanisms in confabulating patients: A VLSM and DWI study
2023, CortexCitation Excerpt :Executive control was assessed through a Go-NoGo task, as well as by measuring a Simon-type stimulus-response conflict (Simon, 1990) in the lateralized tasks of alertness and spatial orienting. Simon and Go-NoGo effects have been related to stimulus-response interference and response inhibition components of executive control, respectively (Friedman & Miyake, 2004; Salzer et al., 2017). The stimuli and timing of presentation in each task are displayed in Fig. 1.
Beyond mean reaction times: Combining distributional analyses with processing stage manipulations in the Simon task
2020, Cognitive PsychologyCitation Excerpt :The exploration of these manipulation effects at the distributional level can provide further information—beyond what is available from mean RT—about the mechanisms and locus of the Simon effect (e.g., Simon, 1968). This is an important endeavor because the conflict effect observed in the Simon task is often used as a convenient experimental tool in various research areas (e.g., Dreisbach, Fröber, Berger, & Fischer, 2018; Fischer, Plessow, Dreisbach, & Goschke, 2015; Lien & Proctor, 2000; Möckel, Beste, & Wascher, 2015; Rey-Mermet, Gade, & Oberauer, 2018; Schlaghecken, Blagrove, Mantantzis, Maylor, & Watson, 2017; van Driel, Swart, Egner, Ridderinkhof, & Cohen, 2015), and many have recently scrutinized the origin of this effect in empirical studies, which has led to the development of sophisticated models (e.g., Mahani, Bausenhart, Ahmadabadi, & Ulrich, 2018; McIntosh & Mehring, 2017; Ulrich, Schröter, Leuthold, & Birngruber, 2015), although there remain healthy debates (Ellinghaus, Karlbauer, Bausenhart, & Ulrich, 2018; Hübner & Mishra, 2016; Janczyk & Leuthold, 2018; Salzer, de Hollander, & Forstmann, 2017; Scorolli, Pellicano, Nicoletti, Rubichi, & Castiello, 2015; Servant, White, Montagnini, & Burle, 2016; Valle-Inclán, 1996; Wühr & Heuer, 2018). In one common version of a visual Simon task, participants are required to make a left or right key press response to the color of a stimulus presented on the left or right side of a fixation cross (e.g., Hommel, 1994b; Miller & Roüast, 2016; Proctor, Miles, & Baroni, 2011; Seibold, Chen, & Proctor, 2016).
Cognitive machine learning model for network information safety
2019, Safety ScienceA neural substrate of early response capture during conflict tasks in sensory areas
2019, NeuropsychologiaCitation Excerpt :Within the framework of the dual-route model we propose that the strength of the stimulus’ features representations in sensory areas should account for response behaviour. The strength of the relevant and irrelevant stimulus feature representations will drive, at least to some extent, the influence of the relevant and the irrelevant route on the final response (Salzer et al., 2017). If a stimulus feature is more or less sharply encoded, this will offer more or less reliable information to downstream decision-forming areas.
Inhibitory dynamics in dual-route evidence accumulation account for response time distributions from conflict tasks
2023, Cognitive NeurodynamicsConstruction of a prediction model for individual investors’ psychology and behaviour based on cognitive neuroscience
2022, International Journal of Industrial and Systems Engineering