Leanne M. Hirshfield
Robert Jacob
ABSTRACT
This project represents a first step towards bridging the gap between HCI and cognition research. Using functional near-infrared spectroscopy (fNIRS), we introduce tech-niques to non-invasively measure a range of cognitive workload states that have implications to HCI research, most directly usability testing. We present a set of usability experiments that illustrates how fNIRS brain measurement provides information about the cognitive demands placed on computer users by different interface designs.
- Adcock, R.A., Constable, R.T., Gore, J.C. and Goldman-Rakic, P.S. Functional neuroanatomy of executive processes involved in dual-task performance. Proceedings of the National Academy of Sciences of the United States of America, 97 (7). 3567--3572.Google Scholar
Cross Ref
- Anderson, E.J., Mannan, S.K., Husain, M., Rees, G., Summer, P., Mort, D.J., McRobbie, D. and Kennard, C. Involvement of prefrontal cortex in visual search. Experimental Brain Research, 180 (2). 289--302.Google ScholarCross Ref
- Baddeley, A. and Della Sala, S. Working memory and execu-tive control. Philosophical Transactions of the Royal Society of London, 351.Google Scholar
- Berka, C., Levendowski, D., Cvetinovic, M., Petrovic, M., Davis, G., Lumicao, L., Zivkovic, V., Popovic, M. and Olmstead, R. Real-Time Analysis of EEG Indexes of Alert-ness, Cognition, and Memory Acquired With a Wireless EEG Headset. International Journal of Human Computer In-teraction, 17 (2). 151--170.Google ScholarCross Ref
- Blackmon, M.H., Kitajima, M. and Polson, P.G., Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs. in In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, (Portland, Oregon, USA, 2005). Google ScholarDigital Library
- Brumby, D.P., Salvucci, D.D. and Howes, A., Focus on driv-ing: how cognitive constraints shape the adaptation of strategy when dialing while driving. in In Proc. of the 27th international Conference on Human Factors in Computing Sys-tems, (Boston, MA, USA, 2009), ACM. Google ScholarDigital Library
- Buxton, R. Introduction to functional magnetic resonance imaging. Cambridge University Press, Cambridge, United Kingdom, 2002.Google ScholarCross Ref
- Chance, B., Anday, E., Nioka, S., Zhou, S., Hong, L., Worden, K., Li, C., Murray, T., Ovetsky, Y. and Thomas, R. A novel method for fast imaging of brain function, non-invasively, with light. Optics Express, 10 (2).Google Scholar
- Czerwinski, M. and Larson, K. Cognition and the Web: Moving from Theory to Web Design. in Human Factors and Web Development, Ratner, J. (Ed.), Erlbaum: NJ, 2002, 147--165.Google Scholar
- Eckstrom, R., French, J., Harman, H. and Derman, D. Kit of factor-referenced cognitive tests.Google Scholar
- Gevins, A. and Smith, M. Neurophysiological Measures of Working memory and Individual Differences in Cognitive Ability and Cogntive Style. Cerebral Cortex, 10.Google Scholar
- Grimes, D., Tan, D., Hudson, S., Shenoy, P. and Rao, R., Feasibility and Pragmatics of Classifying Working Memory Load with an Electroencephalograph. in CHI 2008 Conference on Human Factors in Computing Systems, (Florence, Italy., 2008). Google ScholarDigital Library
- Guhe, M., Liao, W., Zhu, Z., Ji, Q., Gray, W.D. and Schoelles, M.J., Non-intrusive measurement of workload in real-time. in 49th Annual Conference of the Human Factors and Ergonomics Society, (2005), 1157--1161.Google ScholarCross Ref
- Hart, S.G. and Staveland, L.E. Development of NASA-TLX (Task Load Index): Results of empirical and theorical research. in Hancock, P., Meshkati, N. ed. Human Mental Workload, Amsterdam, 1988, pp 139--183.Google ScholarCross Ref
- Hirshfield, L.M. Enhancing Usabiltiy Testing with Functional Near Infrared Spectroscopy Computer Science, Tufts University, Medford, MA, 2009.Google Scholar
- Hirshfield, L.M., Solovey, E.T., Girouard, A., Kebinger, J., Jacob, R.J.K., Sassaroli, A. and Fantini, S., Brain Measure-ment for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload in the Brain Using Functional Near Infrared Spectroscopy. in Proc. of SIGCHI, (2009). Google ScholarDigital Library
- Hoshi, Y. and Tamuraa, M. Near-Infrared Optical Detection of Sequential Brain Activation in the Prefrontal Cortex during Mental Tasks. NeuroImage, 5. 292--297.Google Scholar
- Hoshi, Y., Tsoub, B., Billockc, V., Tanosakia, M., Iguchia, Y., Shimadaa, M., Shinbaa, T., Yamadad, Y. and Odae, I. Spatiotemporal characteristics of hemodynamic changes in the human lateral prefrontal cortex during working memory tasks. NeuroImage, 20. 1493--1504.Google Scholar
- Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K. and Chance, B. Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks. International Journal of Human-Computer Interaction, 17 (2).Google Scholar
- Jaeggi, S.M., Seewer, R., Nirkko, A.C., Eckstein, D., Schroth, G., Groner, R. and Gutbrod, K. Does excessive memory load attenuate activation in the prefrontal cortex? Load-dependent processing in single and dual tasks: functional magnetic resonance imaging study. NeuroImage, 19 (2). 210--225.Google ScholarCross Ref
- Jancke, L., Brunner, B. and Esslen, M. Brain activation during fast driving in a driving simulator: the role of the lateral prefrontal cortex. Neuroreport, 19 (11).Google Scholar
- Jasdzewski, G., Strangman, G., Wagner, J., Kwong, K., Poldrack, R. and Boas, D. Differences in the hemodynamic response to event-related motor and visual paradigms as measured by near-infrared spectroscopy. NEUROIMAGE, 20 (1). 479--488.Google ScholarCross Ref
- Joanette, Y., Ansaldo, A., de Mattos Pimenta Parente, M., Fonseca, R., Kristensen, C. and Scherer, L. Neuroimaging investigation of executive functions: evidence from fNIRS. PSICO, 39 (3).Google Scholar
- Lee, J.C. and Tan, D.S., Using a Low-Cost Electroencephalograph for Task Classification in HCI Research. in ACM Symposium on User Interface Software and Technology, (2006). Google ScholarDigital Library
- Meek, J., Elwell, C., Khan, M., Romaya, J., Wyatt, J., Delpy, D. and Zeki, S. Regional Changes in Cerebral Haemodynamics as a Result of a Visual Stimulus Measured by Near Infrared Spectroscopy. Proc. Roy. Soc. London, 261. 351--356.Google Scholar
- Muller-Plath, G. Localizing subprocesses of visual search by correlating local brain activation in fMRI with response time model parameters. Journal of Neuroscience Methods, 171 (2). 316--330.Google ScholarCross Ref
- Parasuraman, R. and Caggiano, D. Neural and Genetic Assays of Human Mental Workload. in Quantifying Human Information Processing, Lexington Books, 2005.Google Scholar
- Scerbo, M., Frederick, G., Freeman, F. and Mikulka, P. A brain-based system for adaptive automation. Theoretical Issues in Ergonomics Science, 4 (1).Google Scholar
- Schroeter, M.L., Zysset, S., Kupka, T., Kruggel, F. and Yves von Cramon, D. Near-Infrared Spectroscopy Can Detect Brain Activity During a Color-Word Matching Stroop Task in an Event-Related Design. Human Brain Mapping, 17 (1). 61--71.Google ScholarCross Ref
- Smith, E. and Jonides, J. Storage and Executive Processes n the Frontal Lobes. Science, 283.Google Scholar
- Solovey, E., Girouard, A., Chauncey, K., Hirshfield, L., Sassaroli, A., Zheng, F., Fantini, S. and Jacob, R., Using fNIRS Brain Sensing in Realistic HCI Settings: Experiments and Guidelines. in ACM UIST Symposium on User Interface Software and Technology, (2009), ACM. Google ScholarDigital Library
- Tamborello, F. and Byrne, M.D., Information search: The in-tersection of visual and semantic space. in CHI 2005 Extended Abstracts, (Portland, OR, USA, 2005), ACM, 1821--1824. Google ScholarDigital Library
- Wickens, C., Lee, J., Liu, Y. and Becker, S. An Introduction to Human Factors Engineering. Pearson, 2004. Google ScholarDigital Library
- Wilson, G.F. and Fisher, F. Cognitive task classification based upon topographic EEG data. Biological Psychology, 40. 239--250.Google Scholar
- Witten, I.H. and Frank, E. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, 2005. Google ScholarDigital Library
- Ye, Z. and Zhou, X. Conflict control during sentence comprehension: fMRI evidence. Neuroimage, 48 (1). 280--290.Google ScholarCross Ref
Index Terms
- This is your brain on interfaces: enhancing usability testing with functional near-infrared spectroscopy
Index terms have been assigned to the content through auto-classification.
Recommendations
Using fNIRS brain sensing to evaluate information visualization interfaces
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe show how brain sensing can lend insight to the evaluation of visual interfaces and establish a role for fNIRS in visualization. Research suggests that the evaluation of visual design benefits by going beyond performance measures or questionnaires to ...
Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsA well designed user interface (UI) should be transparent, allowing users to focus their mental workload on the task at hand. We hypothesize that the overall mental workload required to perform a task using a computer system is composed of a portion ...
Brain Activity Changes Elicited Through Multi-session Training Assessment in the Prefrontal Cortex by fNIRS
Augmented CognitionAbstractThis study aims to utilize a non-invasive and portable neuroimaging modality – functional near infrared spectroscopy (fNIRS) to investigate training and transfer of skills in unmanned aerial system (UAS) sensor operators (SOs). To achieve this ...
Comments