Abstract
Passive brain-computer interfaces are designed to use brain activity as an additional input, allowing the adaptation of the interface in real time according to the user’s mental state. The goal of the present study is to distinguish between different levels of game difficulty using non-invasive brain activity measurement with functional near-infrared spectroscopy (fNIRS). The study is designed to lead to adaptive interfaces that respond to the user’s brain activity in real time. Nine subjects played two levels of the game Pacman while their brain activity was measured using fNIRS. Statistical analysis and machine learning classification results show that we can discriminate well between subjects playing or resting, and distinguish between the two levels of difficulty with some success. In contrast to most previous fNIRS studies which only distinguish brain activity from rest, we attempt to tell apart two levels of brain activity, and our results show potential for using fNIRS in an adaptive game or user interface.
Chapter PDF
Similar content being viewed by others
Keywords
References
Cutrell, E., Tan, D.S.: BCI for passive input in HCI. In: Proc. ACM CHI 2008 Conference on Human Factors in Computing Systems Workshop on Brain-Computer Interfaces for HCI and Games (2007)
Lee, J.C., Tan, D.S.: Using a Low-Cost Electroencephalograph for Task Classification in HCI Research. In: Proc. UIST 2006 (2006)
Coyle, S., Ward, T., Markham, C., McDarby, G.: On the Suitability of Near-Infrared Systems for Next Generation Brain Computer Interfaces. In: Proc. World Congress on Medical Physics and Biomedical Engineering, Sydney, Australia (2003)
Sitaram, R., Zhang, H., Guan, C., Thulasidas, M., Hoshi, Y., Ishikawa, A., Shimizu, K., Burbaumer, N.: Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. NeuroImage 34, 1416–1427 (2007)
Hirshfield, L.M., Solovey, E.T., Girouard, A., Kebinger, J., Sassaroli, A., Tong, Y., Fantini, S., Jacob, R.J.K.: Brain Measurement for Usability Testing and Adaptive Interfaces: An Example of Uncovering Syntactic Workload with Functional Near Infrared Spectroscopy. In: Proceedings of CHI 2009 Conference on Human Factors in Computing Systems (2009)
Bunce, S., Devaraj, A., Izzetoglu, M., Onaral, B., Pourrezaei, K.: Detecting deception in the brain: a functional near-infrared spectroscopy study of neural correlates of intentional deception. In: Proceedings of the SPIE International Society for Optical Engineering, vol. 5769, pp. 24–32 (2005)
Herrmann, M.J., Ehlis, A.C., Fallgatter, A.J.: Prefrontal activation through task requirements of emotional induction measured with NIRS. Biological Psychology 64(3), 255 (2003)
Villringer, A., Chance, B.: Non-Invasive Optical Spectroscopy and Imaging of Human Brain Function. Trends in Neuroscience 20, 435–442 (1997)
Bunce, S.C., Izzetoglu, M., Izzetoglu, K., Onaral, B., Pourrezaei, K.: Functional Near Infrared Spectroscopy: An Emerging Neuroimaging Modality. IEEE Engineering in Medicine and Biology Magazine, Special issue on Clinical Neuroengineering 25(4), 54–62 (2006)
Chen, D., Hart, J., Vertegaal, R.: Towards a physiological model of user interruptability. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4663, pp. 439–451. Springer, Heidelberg (2007)
Izzetoglu, K., Bunce, S., Onaral, B., Pourrezaei, K., Chance, B.: Functional Optical Brain Imaging Using Near-Infrared During Cognitive Tasks. International Journal of Human-Computer Interaction 17(2), 211–231 (2004)
Nagamitsu, S., Nagano, M., Tamashita, Y., Takashima, S., Matsuishi, T.: Prefrontal cerebral blood volume patterns while playing video games-A near-infrared spectroscopy study. Brain & Development 28, 315–321 (2006)
Matsuda, G., Hiraki, K.: Sustained decrease in oxygenated hemoglobin during video games in the dorsal prefrontal cortex: A NIRS study of children. NeuroImage 29(3), 706–711 (2006)
Saito, K., Mukawa, N., Saito, M.: Brain Activity Comparison of Different-Genre Video Game Players. In: Proceedings of ICICIC ’07 International Conference on Innovative Computing Information and Control, pp. 402–406 (2007)
Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of empirical and theorical research. In: Hancock, P., Meshkati, N. (eds.) Human Mental Workload, Amsterdam, pp. 139–183 (1988)
Butti, M., Caffini, M., Merzagora, A.C., Bianchi, A.M., Baselli, G., Onaral, B., Secchi, P., Cerutti, S.: Non-invasive neuroimaging: Generalized Linear Models for interpreting functional Near Infrared Spectroscopy signals. In: Caffini, M. (ed.) Proceedings of CNE ’07 Conference on Neural Engineering, pp. 461–464 (2007)
Nishimura, E., Stautzenberger, J.P., Robinson, W., Downs, T.H., Downs, J.H.: A new approach to functional near-infrared technology. IEEE Engineering in Medicine and Biology Magazine 26(4), 25–29 (2007)
Matsuda, G., Hiraki, K.: Prefrontal Cortex Deactivation During Video Game Play. In: Shiratori, R., Arai, K., Kato, F. (eds.) Gaming, Simulations, and Society: Research Scope and Perspective, pp. 101–109 (2005)
Field, A.P., Hole, G.: How to design and report experiments. Sage publications Ltd., Thousand Oaks (2003)
Dietterich, T.G.: Machine learning for sequential data: A review. In: Caelli, T.M., Amin, A., Duin, R.P.W., Kamel, M.S., de Ridder, D. (eds.) SPR 2002 and SSPR 2002. LNCS, vol. 2396, pp. 15–30. Springer, Heidelberg (2002)
Nijholt, A., Tan, D., Allison, B., Milan, J.d.R., Graimann, B.: Brain-computer interfaces for hci and games. In: CHI 2008 extended abstracts on Human factors in computing systems. ACM, Florence (2008)
Gevins, A., Smith, M.: Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomics Science 4, 113–131 (2003)
Allison, B.Z., Polich, J.: Workload assessment of computer gaming using a single-stimulus event-related potential paradigm. Biological Psychology 77(3), 277–283 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Girouard, A. et al. (2009). Distinguishing Difficulty Levels with Non-invasive Brain Activity Measurements. In: Gross, T., et al. Human-Computer Interaction – INTERACT 2009. INTERACT 2009. Lecture Notes in Computer Science, vol 5726. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03655-2_50
Download citation
DOI: https://doi.org/10.1007/978-3-642-03655-2_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03654-5
Online ISBN: 978-3-642-03655-2
eBook Packages: Computer ScienceComputer Science (R0)