Top

Gepubliceerd in:

18-02-2022 | Original Article

The contribution of temporal analysis of pupillometry measurements to cognitive research

Auteurs: Ronen Hershman, Dalit Milshtein, Avishai Henik

Gepubliceerd in: Psychological Research | Uitgave 1/2023

Abstract

Reaction time (RT) is one of the most frequently used measures to detect cognitive processes. When tasks require more cognitive processes/resources, reaction is slower. However, RTs may provide only restricted information regarding the temporal characteristics of cognitive processes. Pupils respond reflexively to light but also to cognitive activation. The more cognitive resources a task requires, the more the pupil dilates. However, despite being able to use temporal changes in pupil size (advanced devices measure changes in pupil diameter with sampling rates of above 1000 samples per second), most past studies using pupil dilation have not investigated temporal changes in pupil response. In the current paper, we discuss the advantage of the temporal approach to analyze pupil changes compared to a more traditional perspective, specifically, singular value methods such as mean value and peak amplitude value. Using data from two recent studies conducted in our laboratory, we demonstrate the differences in findings arising from the various analyses. In particular, we focus on the advantage of temporal analysis in detecting hidden effects, investigating temporal characterizations of the effects, and validating the experimental manipulation.

vorige artikel Dopamine supports idea originality: the role of spontaneous eye blink rate on divergent thinking

volgende artikel Embodiment and repeated exposure do not suffice for abstract concepts acquisition: evidence from tonal music cognition

Alleen toegankelijk voor geautoriseerde gebruikers

The frequency response of the pupil is typically less than 10 Hz, and most changes are far below that frequency (Klingner et al., 2011). Thus, including high sampling rates might produce more points for analysis that can adversely affect the statistical outcome and add noise to the overall signal.

In relatively simple cognitive tasks, information about the cognitive processes (at least the peak) generally appears at most 1,100 ms post-stimulus onset (Steinhauer & Hakerem, 1992). Hence, 2,000 ms is consider to be a reasonable time window.

Methods like GCA (that use orthogonal polynomials) and cluster-based permutation (that use cluster mass) have less of an issue of alpha infusion that occurs due to multiple comparisons. Actually, also when frequentist temporal methods are used, corrections such as false discovery rate (FDR; Einhauser et al., 2008) can hold the error rate constant.

The prior probability distribution that is used for the Bayesian analysis is the existing knowledge about the hypothesis before the evidence is taken into account.

Here the baseline was defined as the average pupil size 500 ms before script offset.

Beatty, J., & Kahneman, D. (1966). Pupillary changes in two memory tasks. Psychonomic Science, 5(10), 371–372. https://doi.org/10.3758/BF03328444CrossRef

Binda, P., & Murray, S. O. (2015). Spatial attention increases the pupillary response to light changes. Journal of Vision, 15(2), 1–1. https://doi.org/10.1167/15.2.1CrossRef

Binda, P., Pereverzeva, M., & Murray, S. O. (2014). Pupil size reflects the focus of feature-based attention. Journal of Neurophysiology, 112(12), 3046–3052. https://doi.org/10.1152/jn.00502.2014CrossRef

Blaser, E., Eglington, L., Carter, A. S., & Kaldy, Z. (2014). Pupillometry reveals a mechanism for the autism spectrum disorder (ASD) advantage in visual tasks. Scientific Reports, 4, 4301. https://doi.org/10.1038/srep04301CrossRef

Bradley, M. M., Miccoli, L., Escrig, M. A., & Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45(4), 602–607. https://doi.org/10.1111/j.1469-8986.2008.00654.xCrossRef

Bradley, M. M., Sapigao, R. G., & Lang, P. J. (2017). Sympathetic ANS modulation of pupil diameter in emotional scene perception: Effects of hedonic content, brightness, and contrast. Psychophysiology, 54(10), 1419–1435. https://doi.org/10.1111/psyp.12890CrossRef

Einhauser, W., Stout, J., Koch, C., & Carter, O. (2008). Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proceedings of the National Academy of Sciences, 105(5), 1704–1709. https://doi.org/10.1073/pnas.0707727105CrossRef

Ellis, C. J. (1981). The pupillary light reflex in normal subjects. The British Journal of Ophthalmology, 65(11), 754–759. https://doi.org/10.1136/BJO.65.11.754CrossRef

Forster, K. I. (1970). Visual perception of rapidly presented word sequences of varying complexity. Perception & Psychophysics, 8(4), 215–221. https://doi.org/10.3758/BF03210208CrossRef

Geangu, E., Hauf, P., Bhardwaj, R., & Bentz, W. (2011). Infant pupil diameter changes in response to others’ positive and negative emotions. PLoS ONE, 6(11), e27132. https://doi.org/10.1371/journal.pone.0027132CrossRef

Geller, J., Landrigan, J. F., & Mirman, D. (2019). A pupillometric examination of cognitive control in taxonomic and thematic semantic memory. Journal of Cognition, 2(1), 6. https://doi.org/10.5334/JOC.56/METRICS/CrossRef

Gelman, A., Hill, J., & Yajima, M. (2012). Why we (usually) don’t have to worry about multiple comparisons. Journal of Research on Educational Effectiveness, 5(2), 189–211. https://doi.org/10.1080/19345747.2011.618213CrossRef

Goldinger, S. D., & Papesh, M. H. (2012). Pupil dilation reflects the creation and retrieval of memories. Current Directions in Psychological Science, 21(2), 90–95. https://doi.org/10.1177/0963721412436811CrossRef

Han, H. (2020). Implementation of Bayesian multiple comparison correction in the second-level analysis of fMRI data: With pilot analyses of simulation and real fMRI datasets based on voxelwise inference. Cognitive Neuroscience, 11(3), 157–169. https://doi.org/10.1080/17588928.2019.1700222CrossRef

Han, H., & Glenn, A. L. (2018). Evaluating methods of correcting for multiple comparisons implemented in SPM12 in social neuroscience fMRI studies: An example from moral psychology. Social Neuroscience, 13(3), 257–267. https://doi.org/10.1080/17470919.2017.1324521CrossRef

Hasshim, N., & Parris, B. A. (2015). Assessing stimulus–stimulus (semantic) conflict in the Stroop task using saccadic two-to-one color response mapping and preresponse pupillary measures. Attention, Perception, & Psychophysics, 77(8), 2601–2610. https://doi.org/10.3758/s13414-015-0971-9CrossRef

Hastie, T. J., & Tibshirani, R. J. (2017). Generalized additive models (1st ed.). Routledge. https://doi.org/10.1201/9780203753781 (Original work published in 1990)

Hemmati, M., Johansson, R., & Magnusson, C. E. (2017). A study on the visual illusion effects on the pupillary aperture. http://lup.lub.lu.se/luur/download?func=downloadFile&recordOId=8900434&fileOId=8900438

Henderson, R. R., Bradley, M. M., & Lang, P. J. (2018). Emotional imagery and pupil diameter. Psychophysiology, 55(6), e13050. https://doi.org/10.1111/psyp.13050CrossRef

Hershman, R., & Henik, A. (2019). Dissociation between reaction time and pupil dilation in the Stroop task. Journal of Experimental Psychology: Learning Memory and Cognition, 45(10), 1899–1909. https://doi.org/10.1037/xlm0000690CrossRef

Hershman, R., & Henik, A. (2020). Pupillometric contributions to deciphering Stroop conflicts. Memory and Cognition, 77(8), 2601–2610. https://doi.org/10.3758/s13421-019-00971-zCrossRef

Hershman, R., Henik, A., & Cohen, N. (2018). A novel blink detection method based on pupillometry noise. Behavior Research Methods, 50(1), 107–114. https://doi.org/10.3758/s13428-017-1008-1CrossRef

Hershman, R., Henik, A., & Cohen, N. (2019). CHAP: Open-source software for processing and analyzing pupillometry data. Behavior Research Methods, 51(3), 1059–1074. https://doi.org/10.3758/s13428-018-01190-1CrossRef

Hershman, R., Levin, Y., Tzelgov, J., & Henik, A. (2021). Neutral stimuli and pupillometric task conflict. Psychological Research Psychologische Forschung, 85(3), 1084–1092. https://doi.org/10.1007/s00426-020-01311-6CrossRef

Hess, E. H., & Polt, J. M. (1960). Pupil size as related to interest value of visual stimuli. Science, 132(3423), 349–350. https://doi.org/10.1126/science.132.3423.349CrossRef

Hess, E. H., & Polt, J. M. (1964). Pupil size in relation to mental activity during simple problem-solving. Science, 143(3611), 1190–1192. https://doi.org/10.1126/science.143.3611.1190CrossRef

Hofmann, D. (1997). An overview of the logic and rationale of hierarchical linear models. Journal of Management, 23(6), 723–744. https://doi.org/10.1016/s0149-2063(97)90026-xCrossRef

Jeffreys, H. (1961). Theory of probability (3rd ed.). Oxford University.

Johnson, E. L., Miller Singley, A. T., Peckham, A. D., Johnson, S. L., & Bunge, S. A. (2014). Task-evoked pupillometry provides a window into the development of short-term memory capacity. Frontiers in Psychology, 5, 218. https://doi.org/10.3389/fpsyg.2014.00218CrossRef

Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90(430), 773–795. https://doi.org/10.1080/01621459.1995.10476572CrossRef

Klingner, J., Tversky, B., & Hanrahan, P. (2011). Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks. Psychophysiology, 48(3), 323–332. https://doi.org/10.1111/j.1469-8986.2010.01069.xCrossRef

Kloosterman, N. A., Meindertsma, T., van Loon, A. M., Lamme, V. A. F., Bonneh, Y. S., & Donner, T. H. (2015). Pupil size tracks perceptual content and surprise. European Journal of Neuroscience, 41(8), 1068–1078. https://doi.org/10.1111/ejn.12859CrossRef

Knapen, T., de Gee, J. W., Brascamp, J., Nuiten, S., Hoppenbrouwers, S., & Theeuwes, J. (2016). Cognitive and ocular factors jointly determine pupil responses under equiluminance. PLoS ONE, 11(5), e0155574. https://doi.org/10.1371/journal.pone.0155574CrossRef

Koelewijn, T., de Kluiver, H., Shinn-Cunningham, B. G., Zekveld, A. A., & Kramer, S. E. (2015). The pupil response reveals increased listening effort when it is difficult to focus attention. Hearing Research, 323, 81–90. https://doi.org/10.1016/J.HEARES.2015.02.004CrossRef

Kret, M. E., Roelofs, K., Stekelenburg, J. J., & de Gelder, B. (2013). Emotional signals from faces, bodies and scenes influence observers’ face expressions, fixations and pupil-size. Frontiers in Human Neuroscience, 7, 810. https://doi.org/10.3389/fnhum.2013.00810CrossRef

Kuchinke, L., Võ, M.L.-H., Hofmann, M., & Jacobs, A. M. (2007). Pupillary responses during lexical decisions vary with word frequency but not emotional valence. International Journal of Psychophysiology, 65(2), 132–140. https://doi.org/10.1016/J.IJPSYCHO.2007.04.004CrossRef

Kuchinsky, S. E., Ahlstrom, J. B., Vaden, K. I., Cute, S. L., Humes, L. E., Dubno, J. R., & Eckert, M. A. (2013). Pupil size varies with word listening and response selection difficulty in older adults with hearing loss. Psychophysiology, 50(1), 23–34. https://doi.org/10.1111/j.1469-8986.2012.01477.xCrossRef

Laeng, B., Ørbo, M., Holmlund, T., & Miozzo, M. (2011). Pupillary Stroop effects. Cognitive Processing, 12(1), 13–21. https://doi.org/10.1007/s10339-010-0370-zCrossRef

Libby, W. L., Lacey, B. C., & Lacey, J. I. (1973). Pupillary and cardiac activity during visual attention. Psychophysiology, 10(3), 270–294. https://doi.org/10.1111/j.1469-8986.1973.tb00526.xCrossRef

Ludbrook, J., & Dudley, H. (2012). Why permutation tests are superior to t and F tests in biomedical research. The American Statician, 52(2), 127–132. https://doi.org/10.1080/00031305.1998.10480551CrossRef

Ly, A., Verhagen, J., & Wagenmakers, E.-J. (2016). Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology. Journal of Mathematical Psychology, 72, 19–32. https://doi.org/10.1016/j.jmp.2015.06.004CrossRef

Mathot, S., Dalmaijer, E., Grainger, J., & Van der Stigchel, S. (2014). The pupillary light response reflects exogenous attention and inhibition of return. Journal of Vision, 14(14), 7–7. https://doi.org/10.1167/14.14.7CrossRef

Mathôt, S., Fabius, J., Van Heusden, E., & Van der Stigchel, S. (2018). Safe and sensible preprocessing and baseline correction of pupil-size data. Behavior Research Methods, 50(1), 94–106. https://doi.org/10.3758/s13428-017-1007-2CrossRef

McTeague, L. M., & Lang, P. J. (2012). The anxiety spectrum and the reflex physiology of defense: From circumscribed fear to broad distress. Depression and Anxiety, 29(4), 264–281. https://doi.org/10.1002/da.21891CrossRef

Milshtein, D., & Henik, A. (2020). I read, I imagine, I feel: Feasibility, imaginability and intensity of emotional experience as fundamental dimensions for norming scripts. Basic and Applied Social Psychology, 42(6), 432–459. https://doi.org/10.1080/01973533.2020.1796670CrossRef

Monsell, S., Taylor, T. J., & Murphy, K. (2001). Naming the color of a word: Is it responses or task sets that compete? Memory & Cognition, 29(1), 137–151. https://doi.org/10.3758/BF03195748CrossRef

Moresi, S., Adam, J. J., Rijcken, J., Van Gerven, P. W. M., Kuipers, H., & Jolles, J. (2008). Pupil dilation in response preparation. International Journal of Psychophysiology, 67(2), 124–130. https://doi.org/10.1016/J.IJPSYCHO.2007.10.011CrossRef

Nuthmann, A., & Van Der Meer, E. (2005). Time’s arrow and pupillary response. Psychophysiology, 42(3), 306–317. https://doi.org/10.1111/j.1469-8986.2005.00291.xCrossRef

Otero, S. C., Weekes, B. S., & Hutton, S. B. (2011). Pupil size changes during recognition memory. Psychophysiology, 48(10), 1346–1353. https://doi.org/10.1111/j.1469-8986.2011.01217.xCrossRef

Partala, T., & Surakka, V. (2003). Pupil size variation as an indication of affective processing. International Journal of Human-Computer Studies, 59(1–2), 185–198. https://doi.org/10.1016/S1071-5819(03)00017-XCrossRef

Piai, V., Dahlslätt, K., & Maris, E. (2015). Statistically comparing EEG/MEG waveforms through successive significant univariate tests: How bad can it be? Psychophysiology, 52(3), 440–443. https://doi.org/10.1111/PSYP.12335CrossRef

Rouder, J. N., & Morey, R. D. (2011). A Bayes factor meta-analysis of Bem’s ESP claim. Psychonomic Bulletin and Review, 18(4), 682–689. https://doi.org/10.3758/s13423-011-0088-7CrossRef

Rouder, J. N., & Morey, R. D. (2012). Default Bayes factors for model selection in regression. Multivariate Behavioral Research, 47(6), 877–903. https://doi.org/10.1080/00273171.2012.734737CrossRef

Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16(2), 225–237. https://doi.org/10.3758/PBR.16.2.225CrossRef

Schluroff, M., Zimmermann, T. E., Freeman, R. B., Hofmeister, K., Lorscheid, T., & Weber, A. (1986). Pupillary responses to syntactic ambiguity of sentences. Brain and Language, 27(2), 322–344. https://doi.org/10.1016/0093-934X(86)90023-4CrossRef

Schmidtke, J. (2014). Second language experience modulates word retrieval effort in bilinguals: Evidence from pupillometry. Frontiers in Psychology, 5, 137. https://doi.org/10.3389/fpsyg.2014.00137CrossRef

Scholz, S., & Dutke, S. (2019). Investigating intentional forgetting using pupillometry: No evidence for the ongoing allocation of cognitive resources during forgetting. Journal of Cognitive Psychology, 31(4), 416–437. https://doi.org/10.1080/20445911.2019.1622548/SUPPL_FILE/PECP_A_1622548_SM8198.DOCXCrossRef

Siegle, G. J., D’Andrea, W., Jones, N., Hallquist, M. N., Stepp, S. D., Fortunato, A., Morse, J. Q., & Pilkonis, P. A. (2015). Prolonged physiological reactivity and loss: Association of pupillary reactivity with negative thinking and feelings. International Journal of Psychophysiology, 98(2), 310–320. https://doi.org/10.1016/J.IJPSYCHO.2015.05.009CrossRef

Sirois, S., & Brisson, J. (2014). Pupillometry. Wiley Interdisciplinary Reviews. Cognitive Science, 5(6), 679–692. https://doi.org/10.1002/wcs.1323CrossRef

Sirois, S., & Jackson, I. R. (2012). Pupil dilation and object permanence in infants. Infancy, 17(1), 61–78. https://doi.org/10.1111/j.1532-7078.2011.00096.xCrossRef

Steinhauer, S. R., & Hakerem, G. (1992). The pupillary response in cognitive psychophysiology and schizophrenia. Annals of the New York Academy of Sciences, 658(1), 182–204. https://doi.org/10.1111/j.1749-6632.1992.tb22845.xCrossRef

van der Wel, P., & van Steenbergen, H. (2018). Pupil dilation as an index of effort in cognitive control tasks: A review. Psychonomic Bulletin & Review, 25(6), 2005–2015. https://doi.org/10.3758/s13423-018-1432-yCrossRef

van Rij, J., Hendriks, P., van Rijn, H., Baayen, R. H., & Wood, S. N. (2019). Analyzing the time course of pupillometric data. Trends in Hearing, 23, 2331216519832483. https://doi.org/10.1177/2331216519832483CrossRef

Widmann, A., Schröger, E., & Wetzel, N. (2018). Emotion lies in the eye of the listener: Emotional arousal to novel sounds is reflected in the sympathetic contribution to the pupil dilation response and the P3. Biological Psychology, 133, 10–17. https://doi.org/10.1016/J.BIOPSYCHO.2018.01.010CrossRef

Wierda, S. M., Van Rijn, H., Taatgen, N. A., & Martens, S. (2012). Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. Proceedings of the National Academy of Sciences of the United States of America, 109(22), 8456–8460. https://doi.org/10.1073/pnas.1201858109CrossRef

Winn, M. B., Edwards, J. R., & Litovsky, R. Y. (2015). The impact of auditory spectral resolution on listening effort revealed by pupil dilation. Ear and Hearing, 36(4), e153–e165. https://doi.org/10.1097/AUD.0000000000000145CrossRef

Wood, S. N. (2017). Generalized additive models: An introduction with R (2^nd ed.). Chapman and Hall/CRC. https://doi.org/10.1201/9781315370279

Titel: The contribution of temporal analysis of pupillometry measurements to cognitive research
Auteurs: Ronen Hershman
Dalit Milshtein
Avishai Henik
Publicatiedatum: 18-02-2022
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 1/2023
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-022-01656-0

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 1/2023

Language does arithmetic: linguistic differences in children’s place-value processing

Similar proactive effect monitoring in free and forced choice action modes

Replacing vertical actions by mouse movements: a web-suited paradigm for investigating vertical spatial associations

The angry versus happy recognition advantage: the role of emotional and physical properties

Is motor inhibition involved in the processing of sentential negation? An assessment via the Stop-Signal Task

Dopamine supports idea originality: the role of spontaneous eye blink rate on divergent thinking