David Grimes
Desney S. Tan
Scott E. Hudson
ABSTRACT
A reliable and unobtrusive measurement of working memory load could be used to evaluate the efficacy of interfaces and to provide real-time user-state information to adaptive systems. In this paper, we describe an experiment we con-ducted to explore some of the issues around using an elec-troencephalograph (EEG) for classifying working memory load. Within this experiment, we present our classification methodology, including a novel feature selection scheme that seems to alleviate the need for complex drift modeling and artifact rejection. We demonstrate classification accuracies of up to 99% for 2 memory load levels and up to 88% for 4 levels. We also present results suggesting that we can do this with shorter windows, much less training data, and a smaller number of EEG channels, than reported previously. Finally, we show results suggesting that the models we construct transfer across variants of the task, implying some level of generality. We believe these findings extend prior work and bring us a step closer to the use of such technologies in HCI research.
- Baddeley, A.D., & Hitch, G. (1974). Working Memory. In G.H Bower (ed.) Recent Advances in Learning and Motivation, 8. Academic Press: New York.Google Scholar
Cross Ref
- Berger, H. (1929). Uber das elektroenzephalogramm des menschen. Arch Psychiatr, 87, 527--570.Google ScholarCross Ref
- Card, S., Moran, T., & Newell, A. (1983). The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates: Hillsdale, NJ. Google ScholarDigital Library
- Chen, D., & Vertegaal, R. (2004). Using mental load for managing interruptions in physiologically attentive user interfaces. Extended Abstracts of SIGCHI 2004 Conference on Human Factors in Computing Systems, 1513--1516. Google ScholarDigital Library
- Fisch, B.J. (2005). Fisch & Spehlmann's EEG primer: Basic principles of digital and analog EEG. Elsevier; Amsterdam.Google Scholar
- Gevins, A., & Smith, M.E. (2003). Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomics Science, 4, 113--131.Google ScholarCross Ref
- Gevins, A., Smith, M.E., Leong, H., & McEvoy, L. (1998). Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors, 40(1), 79--91.Google ScholarCross Ref
- Howard, M.W., Rizzuto, D.S., Caplan, J.B., Madsen, J.R., Lisman, J., Aschenbrenner-Scheibe, R., Schulze-Bonhage, A., & Kahana, M.J. (2003). Gamma oscillations correlate with working memory load in humans. Cerebral Cortex, 13, 1369--1374.Google ScholarCross Ref
- Jasper, H.H. (1958). The ten-twenty electrode system of the international federation. Electroencephalography and Clinical Neurophysiology, 10, 371--375.Google Scholar
- Jensen, O., Gelfand, J., Kounios, J., & Lisman, J.E. (2002). Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. Cerebral Cortex, 12, 877--882Google ScholarCross Ref
- Kilmesch, W., Schimke, H., & Pfurtscheller, G. (1993). Alpha frequency, cognitive load and memory performance. Brain Topography, 5(3), 241--251.Google ScholarCross Ref
- Kitamura, Y., Yamaguchi, Y., Imamizu, H., Kishino, F., & Kawato, M. (2003). Things happening in the brain while humans learn to use new tools. Proceedings of SIGCHI 2003 Conference on Human Factors in Computing Systems, 417--424. Google ScholarDigital Library
- Kohlmorgen, J., Muller, K.R., & Pawelzik, K. (1998). Analysis of drafting dynamics with neural network hidden markov models. Conference on Advances in Neural Information Processing Systems, 735--741. Google ScholarDigital Library
- Kramer, A.F. (1991). Physiological metrics of mental workload: A review of recent progress. In Multiple Task Performance (ed. Damos, D.L.), 279--328.Google Scholar
- Lee, J., & Tan, D.S. (2006). Using low-cost electroencephalograph for task classification in HCI research. Proceedings of the 19th ACM Symposium on User Interface Software and Technology, 81--90. Google ScholarDigital Library
- MacKay, D.J.C. (2002). Information Theory, Inference, & Learning Algorithms. Cambridge University Press: USA. Google ScholarDigital Library
- Mecklinger, A., Kramer, A.F., & Strayer, D.L. (1992). Event related potentials and EEG components in a semantic memory search task. Psychophysiology, 29, 104--119.Google ScholarCross Ref
- Onton, J., Delorme, A., & Makeig, S. (2005). Frontal midline dynamics during working memory. Neuroimage, 27, 341--356.Google ScholarCross Ref
- Owen, A.M., McMillan, K.M., Laird, A.R., & Bullmore, E. (2005). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies. Human Brain Mapping, 25, 46--59.Google ScholarCross Ref
- Palaniappan, R. (2005). Brain computer interface design using band powers extracted during mental tasks. Proceedings of the 2nd International IEEE EMBS Conference on Neural Engineering, 321--324.Google ScholarCross Ref
- Picard, R. (2000). Affective Computing. MIT Press: Cambridge. Google ScholarDigital Library
- Picton, T.W., Bentin, P., Berg, P., Hillyard, S.A., Johnson, J.R., Miller, G.A., et al. (2000). Guidelines for using human event-related potentials to study cognition: Recording standards and publication criteria. Psychophysiology, 37, 127--152.Google ScholarCross Ref
- Piolat, A., Olive, T., Roussey, J., Thunin, O., & Ziegler, J.C. (1999). SCRIPTKELL: A tool for measuring cognitive effort and time processing in writing and other complex cognitive activities. Behavior Research Methods, Instruments, & Computers, 31(1), 113--121.Google Scholar
- Pleydell-Pearce, C.W., Whitecross, S.E., & Dickson, B.T. (2003). Multivariate analysis of EEG: Predicting cognition on the basis of frequency decomposition, inter-electrode correlation, coherence, cross phase and cross power. Hawaii International Conference on System Sciences, 11--20. Google ScholarDigital Library
- Prinzel, L.J., Pope, A.T., Freeman, F.G., Scerbo, M.W., & Mikulka, P.J. (2001). Empirical analysis of EEG and ERPs for psychophysiological adaptive task allocation. NASA Technical Report TM-2001-211016. Google ScholarDigital Library
- Rossion, B., & Pourtois, G. (2004). Revisiting Snodgrass and Vanderwart's object set: The role of surface detail in basic-level object recognition. Perception, 33, 217--236.Google ScholarCross Ref
- Smith, M.E., Gevins, A., Brown, H., Karnik, A., & Du, R. (2001). Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Human Factors, 43(3), 366--380.Google ScholarCross Ref
- Velichkovsky, B., & Hansen, J.P. (1996). New technological windows into mind: There is more in eyes and brains for human-computer interaction. Proceedings of the SIGCHI 1996 Conference on Human Factors in Computing Systems, 496--503. Google ScholarDigital Library
Index Terms
- Feasibility and pragmatics of classifying working memory load with an electroencephalograph
Recommendations
Using a low-cost electroencephalograph for task classification in HCI research
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technologyModern brain sensing technologies provide a variety of methods for detecting specific forms of brain activity. In this paper, we present an initial step in exploring how these technologies may be used to perform task classification and applied in a ...
Feature Analysis of EEG Based Brain-Computer Interfaces to Detect Motor Imagery
Brain InformaticsAbstractBrain-Computer Interfaces (BCI) is one of the alluring breakthroughs for mankind as it provides a new way of communication for the patients of neuro-muscular disorders. Electroencephalography (EEG) signals are the most studied type of signals to ...
Towards the detection of error-related potentials and its integration in the context of a P300 speller brain-computer interface
A P300 Speller is a brain-computer interface (BCI) that enables subjects to spell text on a computer screen by detecting P300 Event-Related Potentials in their electroencephalograms (EEG). This BCI application is of particular interest to disabled ...
Comments