Prithiviraj K. Muthumanickam
ABSTRACT
Visual analytics of eye tracking data is a common tool for evaluation studies across diverse fields. In this position paper we propose a novel user-driven interactive data exploration tool for understanding the characteristics of eye gaze movements and the changes in these behaviours over time. Eye tracking experiments generate multidimensional scan path data with sequential information. Many mathematical methods in the past have analysed one or a few of the attributes of the scan path data and derived attributes such as Area of Interest (AoI), statistical measures, geometry, domain specific features etc. In our work we are interested in visual analytics of one of the derived attributes of sequential data-the: AoI and the sequences of visits to these AoIs over time. In the case of static stimuli, such as images, or dynamic stimuli, like videos, having predefined or fixed AoIs is not an efficient way of analysing scan path patterns. The AoI of a user over a stimulus may evolve over time and hence determining the AoIs dynamically through temporal clustering could be a better method for analysing the eye gaze patterns. In this work we primarily focus on the challenges in analysis and visualization of the temporal evolution of AoIs. This paper discusses the existing methods, their shortcomings and scope for improvement by adopting visual analytics methods for event-based temporal data to the analysis of eye tracking data.
- Tobii studio users manual. Technical Report Version 3.4.5, Tobii AB, January 2016.Google Scholar
- N. C. Anderson, F. Anderson, A. Kingstone, and W. F. Bischof. A comparison of scanpath comparison methods. Behavior research methods, 47(4):1377--1392, 2015.Google Scholar
- G. Andrienko, N. Andrienko, M. Burch, and D. Weiskopf. Visual analytics methodology for eye movement studies. Visualization and Computer Graphics, IEEE Transactions on, 18(12):2889--2898, 2012. Google ScholarDigital Library
- T. Blascheck, K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf, and T. Ertl. State-of-the-art of visualization for eye tracking data. In Proceedings of EuroVis, volume 2014, 2014.Google Scholar
- T. Blascheck, K. Kurzhals, M. Raschke, S. Strohmaier, D. Weiskopf, and T. Ertl. Aoi hierarchies for visual exploration of fixation sequences. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, pages 111--118. ACM, 2016. Google ScholarDigital Library
- T. Blascheck, M. Raschke, and T. Ertl. Circular heat map transition diagram. In Proceedings of the 2013 Conference on Eye Tracking South Africa, pages 58--61. ACM, 2013. Google ScholarDigital Library
- S. A. Brandt and L. W. Stark. Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of cognitive neuroscience, 9(1):27--38, 1997. Google ScholarDigital Library
- M. Burch, A. Kull, and D. Weiskopf. Aoi rivers for visualizing dynamic eye gaze frequencies. In Computer Graphics Forum, volume 32, pages 281--290. Wiley Online Library, 2013. Google ScholarDigital Library
- D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(5):603--619, 2002. Google ScholarDigital Library
- R. Dewhurst, M. Nyström, H. Jarodzka, T. Foulsham, R. Johansson, and K. Holmqvist. It depends on how you look at it: Scanpath comparison in multiple dimensions with multimatch, a vector-based approach. Behavior research methods, 44(4):1079--1100, 2012.Google Scholar
- G. Drusch, J. Bastien, and S. Paris. Analysing eye-tracking data: From scanpaths and heatmaps to the dynamic visualisation of areas of interest. Advances in Science, Technology, Higher Education and Society in the Conceptual Age: STHESCA, 20:205, 2014.Google Scholar
- A. T. Duchowski. A breadth-first survey of eye-tracking applications. Behavior Research Methods, Instruments, & Computers, 34(4):455--470, 2002.Google Scholar
- T. R. Hayes, A. A. Petrov, and P. B. Sederberg. A novel method for analyzing sequential eye movements reveals strategic influence on raven's advanced progressive matrices. Journal of Vision, 11(10):10--10, 2011.Google ScholarCross Ref
- A. K. Jain, M. N. Murty, and P. J. Flynn. Data clustering: a review. ACM computing surveys (CSUR), 31(3):264--323, 1999. Google ScholarDigital Library
- Z. Kang and S. J. Landry. An eye movement analysis algorithm for a multielement target tracking task: Maximum transition-based agglomerative hierarchical clustering. Human-Machine Systems, IEEE Transactions on, 45(1):13--24, 2015.Google Scholar
- E. Kasneci, G. Kasneci, T. C. Kübler, and W. Rosenstiel. The applicability of probabilistic methods to the online recognition of fixations and saccades in dynamic scenes. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 323--326. ACM, 2014. Google ScholarDigital Library
- S. Kotsiantis and P. Pintelas. Recent advances in clustering: A brief survey. WSEAS Transactions on Information Science and Applications, 1(1):73--81, 2004.Google Scholar
- K. Krejtz, A. Duchowski, T. Szmidt, I. Krejtz, F. González Perilli, A. Pires, A. Vilaro, and N. Villalobos. Gaze transition entropy. ACM Transactions on Applied Perception (TAP), 13(1):4, 2015. Google ScholarDigital Library
- K. Krejtz, T. Szmidt, A. T. Duchowski, and I. Krejtz. Entropy-based statistical analysis of eye movement transitions. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 159--166. ACM, 2014. Google ScholarDigital Library
- T. C. Kübler, E. Kasneci, and W. Rosenstiel. Subsmatch: Scanpath similarity in dynamic scenes based on subsequence frequencies. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 319--322. ACM, 2014. Google ScholarDigital Library
- T. C. Kübler, K. Sippel, W. Fuhl, G. Schievelbein, J. Aufreiter, R. Rosenberg, W. Rosenstiel, and E. Kasneci. Analysis of eye movements with eyetrace. In Biomedical Engineering Systems and Technologies, pages 458--471. Springer, 2015.Google ScholarCross Ref
- K. Kurzhals, C. F. Bopp, J. Bässler, F. Ebinger, and D. Weiskopf. Benchmark data for evaluating visualization and analysis techniques for eye tracking for video stimuli. In Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization, pages 54--60. ACM, 2014. Google ScholarDigital Library
- K. Kurzhals, B. Fisher, M. Burch, and D. Weiskopf. Eye tracking evaluation of visual analytics. Information Visualization, page 1473871615609787, 2015.Google Scholar
- K. Kurzhals, F. Heimerl, and D. Weiskopf. Iseecube: Visual analysis of gaze data for video. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 43--50. ACM, 2014. Google ScholarDigital Library
- K. Kurzhals and D. Weiskopf. Space-time visual analytics of eye-tracking data for dynamic stimuli. Visualization and Computer Graphics, IEEE Transactions on, 19(12):2129--2138, 2013. Google ScholarDigital Library
- K. Kurzhals and D. Weiskopf. Aoi transition trees. In Proceedings of the 41st Graphics Interface Conference, pages 41--48. Canadian Information Processing Society, 2015. Google ScholarDigital Library
- T. Lindeberg. Scale-space theory in computer vision, volume 256. Springer Science & Business Media, 2013.Google Scholar
- I. Peca, G. Fuchs, K. Vrotsou, N. Andrienko, and G. Andrienko. Scalable cluster analysis of spatial events. In Proceedings of International Workshop on Visual Analytics (EuroVA 2012), pages 19--23, 2012.Google Scholar
- D. C. Richardson and R. Dale. Looking to understand: The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cognitive science, 29(6):1045--1060, 2005.Google ScholarCross Ref
- S. M. Ross et al. Stochastic processes, volume 2. John Wiley & Sons New York, 1996.Google Scholar
- A. Santella and D. DeCarlo. Robust clustering of eye movement recordings for quantification of visual interest. In Proceedings of the 2004 symposium on Eye tracking research & applications, pages 27--34. ACM, 2004. Google ScholarDigital Library
- Å. Svensson. Air traffic controller's work-pattern during air traffic control tower simulations: A eye-tracking study of air traffic controller's eye-movements during arrivals. Master's thesis, Linköping University, Sweden, 2015.Google Scholar
- E. Tafaj, G. Kasneci, W. Rosenstiel, and M. Bogdan. Bayesian online clustering of eye movement data. In Proceedings of the Symposium on Eye Tracking Research and Applications, pages 285--288. ACM, 2012. Google ScholarDigital Library
- H. Y. Tsang, M. Tory, and C. Swindells. eseetrack -visualizing sequential fixation patterns. Visualization and Computer Graphics, IEEE Transactions on, 16(6):953--962, 2010. Google ScholarDigital Library
- K. Vrotsou, J. Johansson, and M. Cooper. Activitree: interactive visual exploration of sequences in event-based data using graph similarity. Visualization and Computer Graphics, IEEE Transactions on, 15(6):945--952, 2009. Google ScholarDigital Library
- S. Winkler and S. Ramanathan. Overview of eye tracking datasets. In QoMEX, pages 212--217, 2013.Google ScholarCross Ref
- S. Winkler, F. M. Savoy, and R. Subramanian. X-eye: A reference format for eye tracking data to facilitate analyses across databases. In IS&T/SPIE Electronic Imaging, pages 90140L--90140L. International Society for Optics and Photonics, 2014.Google Scholar
Recommendations
A new method for categorizing scanpaths from eye tracking data
ETRA '16: Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & ApplicationsFrom the seminal work of Yarbus [1967] on the relationship of eye movements to vision, scanpath analysis has been recognized as a window into the mind. Computationally, characterizing the scanpath, the sequential and spatial dependencies between eye ...
Eye&Head: Synergetic Eye and Head Movement for Gaze Pointing and Selection
UIST '19: Proceedings of the 32nd Annual ACM Symposium on User Interface Software and TechnologyEye gaze involves the coordination of eye and head movement to acquire gaze targets, but existing approaches to gaze pointing are based on eye-tracking in abstraction from head motion. We propose to leverage the synergetic movement of eye and head, and ...
An eye tracking dataset for point of gaze detection
ETRA '12: Proceedings of the Symposium on Eye Tracking Research and ApplicationsThis paper presents a new, publicly available eye tracking dataset, aimed to be used as a benchmark for Point of Gaze (PoG) detection algorithms. The dataset consists of a set of videos recording the eye motion of human test subjects as they were ...
Comments