Johannes Zagermann
Ulrike Pfeil
Harald Reiterer
ABSTRACT
In this position paper we encourage the use of eye tracking measurements to investigate users' cognitive load while interacting with a system. We start with an overview of how eye movements can be interpreted to provide insight about cognitive processes and present a descriptive model representing the relations of eye movements and cognitive load. Then, we discuss how specific characteristics of human-computer interaction (HCI) interfere with the model and impede the application of eye tracking data to measure cognitive load in visual computing. As a result, we present a refined model, embedding the characteristics of HCI into the relation of eye tracking data and cognitive load. Based on this, we argue that eye tracking should be considered as a valuable instrument to analyze cognitive processes in visual computing and suggest future research directions to tackle outstanding issues.
- Erik W. Anderson. 2012. Evaluating Visualization Using Cognitive Measures. In Proceedings of the 2012 BELIV Workshop: Beyond Time and Errors - Novel Evaluation Methods for Visualization (BELIV '12). ACM, New York, NY, USA, 1--4. Google Scholar
Digital Library
- David Beymer and Daniel M. Russell. 2005. WebGazeAnalyzer: A System for Capturing and Analyzing Web Reading Behavior Using Eye Gaze. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, New York, NY, USA, 1913--1916. Google ScholarDigital Library
- Matthew Brehmer and Tamara Munzner. 2013. A Multi-Level Typology of Abstract Visualization Tasks. IEEE Trans. Visualization and Computer Graphics (TVCG) (Proc. InfoVis) 19, 12 (2013), 2376--2385. Google ScholarDigital Library
- Matthew Brehmer, Michael Sedlmair, Stephen Ingram, and Tamara Munzner. 2014. Visualizing Dimensionally-reduced Data: Interviews with Analysts and a Characterization of Task Sequences. In Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization (BELIV '14). ACM, New York, NY, USA, 1--8. Google ScholarDigital Library
- Fang Chen, Jianlong Zhou, Yang Wang, Kun Yu, Syed Z. Arshad, Ahmad Khawaji, and Dan Conway. 2016. Robust Multimodal Cognitive Load Measurement. Springer International Publishing. Google ScholarDigital Library
- Siyuan Chen, Julien Epps, Natalie Ruiz, and Fang Chen. 2011. Eye Activity As a Measure of Human Mental Effort in HCI. In Proceedings of the 16th International Conference on Intelligent User Interfaces (IUI '11). ACM, New York, NY, USA, 315--318. Google ScholarDigital Library
- Jérémy Frey, Maxime Daniel, Julien Castet, Martin Hachet, and Fabien Lotte. 2016. Framework for Electroencephalography-based Evaluation of User Experience. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2283--2294. Google ScholarDigital Library
- Sandra G. Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications, 904--908.Google ScholarCross Ref
- Sandra G. Hart and Lowell E. Stavenland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload. Elsevier, Chapter 7, 139--183.Google ScholarCross Ref
- Kasper Hornbæk. 2006. Current Practice in Measuring Usability: Challenges to Usability Studies and Research. Int. J. Hum.-Comput. Stud. 64, 2 (Feb. 2006), 79--102. Google ScholarDigital Library
- Hans-Christian Jetter, Harald Reiterer, and Florian Geyer. 2014. Blended Interaction: Understanding Natural Human-computer Interaction in post-WIMP Interactive Spaces. Personal Ubiquitous Comput. 18, 5 (June 2014), 1139--1158. Google ScholarDigital Library
- Youn-ah Kang and John Stasko. 2012. Examining the Use of a Visual Analytics System for Sensemaking Tasks: Case Studies with Domain Experts. IEEE Transactions on Visualization and Computer Graphics 18, 12 (2012), 2869--2878. Google ScholarDigital Library
- Daniel Keim, Gennady Andrienko, Jean-Daniel Fekete, Carsten Görg, Jörn Kohlhammer, and Guy Melançon. 2008. Information Visualization. Springer-Verlag, Berlin, Heidelberg, Chapter Visual Analytics: Definition, Process, and Challenges, 154--175. Google ScholarDigital Library
- Jeff Klingner, Rakshit Kumar, and Pat Hanrahan. 2008. Measuring the Task-evoked Pupillary Response with a Remote Eye Tracker. In Proceedings of the 2008 symposium on Eye tracking research & applications. ACM, 69--72. Google ScholarDigital Library
- Victor Manuel, Victor M. Garcia-Barrios, Christian Gütl, Alexandra Preis, Keith Andrews, Maja Pivec, Felix Mödritscher, and Christian Trummer. 2004. AdELE: A Framework for Adaptive E-Learning through Eye Tracking. In Proceedings of IKNOW 2004. 609--616.Google Scholar
- Tamara Munzner. 2014. Visualization Analysis and Design. A K Peters.Google Scholar
- Bastian Pfleging, Drea K. Fekety, Albrecht Schmidt, and Andrew L. Kun. 2016. A Model Relating Pupil Diameter to Mental Workload and Lighting Conditions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5776--5788. Google ScholarDigital Library
- Marc Pomplun and Sindhura Sunkara. 2003. Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction. Proceedings of the International Conference on HCI (2003), 542--546.Google Scholar
- Marco Porta, Stefania Ricotti, and Calet Jimenez Perez. 2012. Emotional E-Learning through Eye Tracking. In Global Engineering Education Conference (EDUCON), 2012 IEEE. IEEE, 1--6.Google ScholarCross Ref
- Sohail Rafiqi, Chatchai Wangwiwattana, Jasmine Kim, Ephrem Fernandez, Suku Nair, and Eric C. Larson. 2015. PupilWare: Towards Pervasive Cognitive Load Measurement Using Commodity Devices. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (PETRA '15). ACM, New York, NY, USA, 1--8. Google ScholarDigital Library
- Darrell S. Rudmann, George W. McConkie, and Xianjun Sam Zheng. 2003. Eyetracking in Cognitive State Detection for HCI. In Proceedings of the 5th International Conference on Multimodal Interfaces (ICMI '03). ACM, New York, NY, USA, 159--163. Google ScholarDigital Library
- John Sweller. 1988. Cognitive Load During Problem Solving: Effects on Learning. Cognitive Science 12, 2 (1988), 257--285.Google ScholarCross Ref
- John Sweller. 1999. Instructional Design in Technical Areas. ACER Press.Google Scholar
- Alfred L. Yarbus. 1967. Eye Movements and Vision. Plenum. New York.Google Scholar
Index Terms
- Measuring Cognitive Load using Eye Tracking Technology in Visual Computing
Recommendations
Studying Eye Movements as a Basis for Measuring Cognitive Load
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsUsers' cognitive load while interacting with a system is a valuable metric for evaluations in HCI. We encourage the analysis of eye movements as an unobtrusive and widely available way to measure cognitive load. In this paper, we report initial findings ...
Measuring the task-evoked pupillary response with a remote eye tracker
ETRA '08: Proceedings of the 2008 symposium on Eye tracking research & applicationsThe pupil-measuring capability of video eye trackers can detect the task-evoked pupillary response: subtle changes in pupil size which indicate cognitive load. We performed several experiments to measure cognitive load using a remote video eye tracker, ...
Estimating cognitive load using remote eye tracking in a driving simulator
ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & ApplicationsWe report on the results of a study in which pairs of subjects were involved in spoken dialogues and one of the subjects also operated a simulated vehicle. We estimated the driver's cognitive load based on pupil size measurements from a remote eye ...
Comments