Review
How movements shape the perception of time

https://doi.org/10.1016/j.tics.2021.08.002Get rights and content

Highlights

  • Time perception and movement are linked through interactions with the environment.

  • Recent psychophysical studies have begun to demonstrate that movements, while previously construed as an endpoint for timing, informs and shapes the perception of time.

  • These studies demonstrate that movements can bias our perception of time, but also enhance it in some circumstances.

  • A Bayesian cue combination framework, in which movement provides its own timing signal can explain both bias and enhancement effects.

  • Cue combination effects can be mediated neurally either via feedforward or active sensing modes.

In order to keep up with a changing environment, mobile organisms must be capable of deciding both where and when to move. This precision necessitates a strong sense of time, as otherwise we would fail in many of our movement goals. Yet, despite this intrinsic link, only recently have researchers begun to understand how these two features interact. Primarily, two effects have been observed: movements can bias time estimates, but they can also make them more precise. Here we review this literature and propose that both effects can be explained by a Bayesian cue combination framework, in which movement itself affords the most precise representation of time, which can influence perception in either feedforward or active sensing modes.

Section snippets

Time and movement are intertwined

Continuous interaction with a dynamic world requires organisms to make precise temporal measurements of sensory input and directed motor output. As such, sensorimotor coupling is vital in multiple levels of organization in the nervous system, from spinal reflexes to complex motor sequences [1]. These intertwined sensorimotor processes have potential implications in the study of time perception [2]; however, the link between action and time perception has, until recently [3], been relatively

Motor systems are invoked during time perception

Given the necessity of time and movement in everyday interactions, it is not surprising that the brain areas involved in these processes greatly overlap (Figure 1A). Timing relies on several brain systems traditionally thought to be dedicated to motor control [5,6], and that are activated during timing tasks where no overtly timed motor response is required (Figure 1A). The main cortical area implicated in temporal processing is the supplementary motor area (SMA). The SMA is often split into

Concurrent movements bias time perception

Despite the involvement of motor regions in time perception, until recently movements were not specifically studied in the context of timing. Models of time perception typically set movements to represent the end-point of a timed process, with motor variance existing as a nuisance to be partialed out (Box 1). Yet, early evidence of this relationship came in the form of the chronostasis phenomenon, wherein saccading to a target induced a stereotyped expansion of visual time [30]. Post-action

Concurrent movements improve time perception

In addition to the work cited above showing the biasing effects of movement, there is also evidence that concurrent movements can enhance timing (Figure 3). This secondary finding is an essential component of Bayesian cue combination, in which greater precision leads to greater bias.

In one study [56], subjects were more precise timing auditory intervals when the stimulus onset was determined by the subject (Figure 3B). Further studies [57] found that subjects were more precise timing auditory

Pre-action and post-action effects on timing

In addition to the effects of concurrent action, there are also distinct effects on perceived duration during pre-action and post-action periods, yet with notable inconsistencies. For pre-action periods, in some cases durations are compressed [77., 78., 79.] and in others dilated [29,80,81]. Various factors lead to these differential effects, including whether the temporal stimulus is a filled interval or an empty interval [29,81] as well as the intended direction of a planned movement [79].

It

A framework for movement and time

As described above, movement effects on explicit time estimates, both perceived and produced, can lead to both biases and enhancements under particular conditions. Additionally, these effects are predicted using a Bayesian cue combination framework (Box 2). Yet, cue combination has traditionally been formulated as one in which disparate channels of sensory information are combined to a unified percept. In our framework, movement itself serves as an additional channel for duration information.

Neural implementation

If Bayesian cue combination can explain movement-related effects on time, then how are these effects implemented in the brain? We outline two possibilities (Figure 4D, Key figure). First, as described above, motor structures predominate neural timing systems, and so one possibility is that movements lead to changes within these motor circuits themselves, most notably the SMA, possibly by sharpening duration or category-tuned neurons, which are driven by sensory and motor responses, or by

Concluding remarks

In this review we have introduced a basic framework of how movement information can bias timing while improving its precision, from the overlap of neural systems to behavioral correlates. We note that this area of study is in its early stages: most movement-timing studies have examined effects of brief [53], discrete [30], or ballistic movements [80], and have tightly controlled motor variables of interest in laboratory settings. Naturally, these come with some limitations. The multi-effector

Acknowledgments

The two first authors (RD & KAG) contributed equally to this work. Funding to support this work was provided by the National Science Foundation (Award # 1849067 to MW & WMJ and #1922598 to KAG). This work was also supported in part by the National Institute Of Mental Health of the National Institutes of Health (Award T32MH112507).

Declaration of Interests

No interests are declared.

Glossary

Accuracy
refers to the closeness of measurements to a particular value and can be seen as the correctness of measurements.
Chronostasis
a temporal illusion in which the perceived duration of an event or interval is dilated immediately following a saccade (i.e., quick eye movement). Has also been shown to occur with other types of actions (i.e., arm movements) and with various types of stimuli (i.e., visual, auditory).
Empty intervals
time intervals presented as the difference between two brief

References (139)

  • K. Yamamoto

    Cue integration as a common mechanism for action and outcome bindings

    Cognition

    (2020)
  • J. Coull et al.

    Dissociating explicit timing from temporal expectation with fMRI

    Curr. Opin. Neurobiol.

    (2008)
  • G. Anobile

    A sensorimotor numerosity system

    Trends Cogn. Sci.

    (2021)
  • V. Walsh

    A theory of magnitude: common cortical metrics of time, space and quantity

    Trends Cogn. Sci.

    (2003)
  • I. Ayhan et al.

    Action-induced changes in the perceived temporal features of visual events

    Vis. Res.

    (2020)
  • S. Imaizumi et al.

    My action lasts longer: Potential link between subjective time and agency during voluntary action

    Conscious. Cogn.

    (2017)
  • H. Sgouramani et al.

    Flash dance: how speed modulates perceived duration in dancers and non-dancers

    Acta Psychol.

    (2014)
  • J.T. Coull et al.

    Explicit understanding of duration develops implicitly through action

    Trends Cogn. Sci.

    (2018)
  • M. Iwasaki

    Non-uniform transformation of subjective time during action preparation

    Cognition

    (2017)
  • H. Sohn

    Bayesian computation through cortical latent dynamics

    Neuron

    (2019)
  • J.J. Cannon et al.

    How beat perception co-opts motor neurophysiology

    Trends Cogn. Sci.

    (2021)
  • E. Brenner

    Timing the moment of impact in fast human movements

    Acta Psychol.

    (2012)
  • N.G. Hatsopoulos et al.

    Sensing with the motor cortex

    Neuron

    (2011)
  • A.A. Russo

    Neural trajectories in the supplementary motor area and motor cortex exhibit distinct geometries, compatible with different classes of computation

    Neuron

    (2020)
  • R. Balasubramaniam

    Neural encoding and representation of time for sensorimotor control and learning

    J. Neurosci.

    (2021)
  • D. Alais et al.

    Cue Combination Within a Bayesian Framework

    Multisensory Processes

    (2019)
  • A. Nani

    The neural correlates of time: a meta-analysis of neuroimaging studies

    J. Cogn. Neurosci.

    (2019)
  • P. Nachev

    Functional role of the supplementary and pre-supplementary motor areas

    Nat. Rev. Neurosci.

    (2008)
  • F. Protopapa

    Chronotopic maps in human supplementary motor area

    PLoS Biol.

    (2019)
  • F. Macar

    The supplementary motor area in motor and perceptual time processing: fMRI studies

    Cogn. Process.

    (2006)
  • J.T. Coull

    Functional anatomy of the attentional modulation of time estimation

    Science

    (2004)
  • H. Merchant

    Interval tuning in the primate medial premotor cortex as a general timing mechanism

    J. Neurosci.

    (2013)
  • G. Mendoza

    Neural basis for categorical boundaries in the primate pre-SMA during relative categorization of time intervals

    Nat. Commun.

    (2018)
  • J.T. Coull

    Dopamine precursor depletion impairs timing in healthy volunteers by attenuating activity in putamen and supplementary motor area

    J. Neurosci.

    (2012)
  • S. Soares

    Midbrain dopamine neurons control judgment of time

    Science

    (2016)
  • A. Breska et al.

    Double dissociation of single-interval and rhythmic temporal prediction in cerebellar degeneration and Parkinson’s disease

    Proc. Natl. Acad. Sci. U. S. A.

    (2018)
  • A. Breska et al.

    Context-specific control over the neural dynamics of temporal attention by the human cerebellum

    Sci. Adv.

    (2020)
  • A. Singh

    Timing variability and midfrontal 4Hz rhythms correlate with cognition in Parkinson’s disease

    NPJ Park. Dis

    (2021)
  • L. Avanzino

    Time Processing and Motor Control in Movement Disorders

    Front. Hum. Neurosci.

    (2016)
  • H. Merchant

    Interval timing and Parkinson’s disease: heterogeneity in temporal performance

    Exp. Brain Res.

    (2008)
  • C.M. Vicario

    Timing recalibration in childhood Tourette syndrome associated with persistent pimozide treatment

    J. Neuropsychol.

    (2016)
  • D.J. Pedrosa

    Time reproduction deficits in essential tremor patients

    Mov. Disord.

    (2016)
  • D. Martino

    Temporal processing of perceived body movement in cervical dystonia

    Mov. Disord.

    (2015)
  • C.M. Gooch

    Temporal discrimination of sub- and suprasecond time intervals: a voxel-based lesion mapping analysis

    Front. Integr. Neurosci.

    (2011)
  • M. Iwasaki

    Neural correlates of time distortion in a preaction period

    Hum. Brain Mapp.

    (2019)
  • K. Yarrow

    Illusory perceptions of space and time preserve cross-saccadic perceptual continuity

    Nature

    (2001)
  • D. Melcher

    The role of action intentionality and effector in the subjective expansion of temporal duration after saccadic eye movements

    Sci. Rep.

    (2020)
  • P. Haggard

    Voluntary action and conscious awareness

    Nat. Neurosci.

    (2002)
  • D. Wenke et al.

    How voluntary actions modulate time perception

    Exp. Brain Res.

    (2009)
  • K. Suzuki

    Intentional binding without intentional action

    Psychol. Sci.

    (2019)
  • Cited by (28)

    • Audition controls the flow of visual time during multisensory perception

      2022, iScience
      Citation Excerpt :

      Here we provide strong complementary evidence that audition, the more temporally precise modality, controls the flow of time in vision, the more temporally predictive modality. This raises important mechanistic and phenomenological questions about neural computational time versus experienced time, not only across sensory modalities but in sensorimotor time as well (De Kock et al., 2021). In view of the current findings, we posit that as the speech stream changes pace, the visual modality realigns its pace according to the auditory modality to reassume a leading position.

    View all citing articles on Scopus
    View full text