Daniel Chen
ABSTRACT
Today's user is surrounded by mobile appliances that continuously disrupt activities through instant message, email and phone call notifications. In this paper, we present a system that regulates notifications by such devices dynamically on the basis of direct measures of the user's mental load. We discuss a prototype Physiologically Attentive User Interface (PAUI) that measures mental load using Heart Rate Variability (HRV) signals, and motor activity using electroencephalogram (EEG) analysis. The PAUI uses this information to distinguish between 4 attentional states of the user: at rest, moving, thinking and busy. We discuss an example PAUI application in the automated regulation of notifications in a mobile cell phone appliance.
- Duchowski, A.T. Eye Tracking Methodology: Theory & Practice. Springer Verlag, London, UK, 2003. Google Scholar
Digital Library
- Hart, S., Staveland, L. "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research." In Human Mental Workload, pp 139 -- 183, 1988.Google Scholar
- Horvitz, E. Kadie, C. Paek, T. Hovel, D. "Models of Attention in Computing and Communication: From principles to Applications." Special Issue on Attentive User Interfaces, Communications of ACM 46(3), March 2003. Google ScholarDigital Library
- Horvitz E. "Principles of Mixed-Initiative User Interfaces." Proc. CHI '99, 1999. Google ScholarDigital Library
- Mann, S. Chen, D. Sadeghi, S. "HI-Cam Intelligent Biofeedback Signal Processing", Proc. of the Intern. Symp. on Wearable Cmputing '01, 2001. Google ScholarDigital Library
- McCraty, R. Atkinson, M. Tiller, W. Rein, G. Watkins, A. "The Effects of Emotions on Short-Term Power Spectrum Analysis of Heart Rate Variability." The American Journal of Cardiology November 15, 1995.Google ScholarCross Ref
- NASA. "Extension Of The Human Senses Group." http://ic.arc.nasa.gov/projects/ne/ehs.htmlGoogle Scholar
- Picard, R. Healy, J. "Toward Machine Emotional Intelligence: Analysis of Affective Physiological State." IEEE Trans. On Pattern Analysis and Machine Intell., Oct. 2001 Google ScholarDigital Library
- Prinzel, L. Pope, A. Freeman, F. Scerbo, M. Mikulka, P. "Empirical Analysis of EEGs and ERP for Psychophysiological Adaptive Task Allocation" NASA Tech. Report TM-2001-211016, 2001. Google ScholarDigital Library
- Ramoser, H. Muller-Gerling, J. and P. Pfurischeller. Optimal Spatial Filtering of Single Trial EEG During Imagined Hand Movement IEEE Trans. On Rehab. Engineering, vol. 8, pp. 441--446. Dec, 2000Google ScholarCross Ref
- Rowe, D. Sibert, J. Irwin, D. "Heart Rate Variability: Indicator of User State as an Aid to Human-Computer Interaction" Proc. CHI 98, 1998 Google ScholarDigital Library
- Scerbo, M. Freeman, F. Mikulka, P. Parasuraman, R. Di Nocero, F. Prinzel, L. "The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology", NASA Technical Report TP-2001-211018, June 2001. Google ScholarDigital Library
- Schacter, D.L. "EEG theta and psychological phenomena: a review and analysis". Biological Psychology, 5, 47--82 , 1997.Google ScholarCross Ref
- Shell, J., Vertegaal, R, and Skaburskis, A. "EyePliances: Attention-Seeking Devices that Respond to Visual Attention." Ext. Abstracts CHI'03, 2003. Google ScholarDigital Library
- Thought Technologies. Procomp+ User Manual. http://www.thoughttechnology.comGoogle Scholar
- Vertegaal, R. "Attentive User Interfaces" Editorial, Special Issue on Attentive User Interfaces, Communications of ACM 46(3), March 2003. Google ScholarDigital Library
- Vertegaal, R. Dickie, C., Sohn, C, and Flickner, M. "Designing Attentive Cell Phones Using Wearable EyeContact Sensors." Ext. Abstracts CHI'02, 2002 Google ScholarDigital Library
- Using mental load for managing interruptions in physiologically attentive user interfaces
Recommendations
Forecasting user attention during everyday mobile interactions using device-integrated and wearable sensors
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and ServicesVisual attention is highly fragmented during mobile interactions, but the erratic nature of attention shifts currently limits attentive user interfaces to adapting after the fact, i.e. after shifts have already happened. We instead study attention ...
Robot Navigation Using Brain-Computer Interfaces
TRUSTCOM '12: Proceedings of the 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and CommunicationsThis paper identifies the user's adaptation on brain-controlled systems and the ability to control brain-generated events in a closed neuro-feedback loop. To accomplish that, a working system has been developed based on off-the-shelf components for ...
Use of ANNs as classifiers for selective attention brain-computer interfaces
IWANN'07: Proceedings of the 9th international work conference on Artificial neural networksSelective attention to visual-spatial stimuli causes decrements of power in alpha band and increments in beta. For steady-state visual evoked potentials (SSVEP) selective attention affects electroencephalogram (EEG) recordings, modulating the power in ...
Comments