Abstract
This study aims to utilize a non-invasive and portable neuroimaging modality – functional near infrared spectroscopy (fNIRS) to investigate training and transfer of skills in unmanned aerial system (UAS) sensor operators (SOs). To achieve this objective, we recruited 13 novice participants and exposed them to three similar training sessions followed by a testing session on a UAS simulator. The training sessions occurred at 11AM (high visibility), while the testing session occurred at 6AM or 8PM (low visibility). Regardless of the session, the participants were asked to scan pre-defined areas to best of their abilities and identify targets (red bus). Behavioral results from training sessions indicated that some participants improved their scan performance, while others did not. No significant changes in target find performance were observed within and between groups. Associated average oxyhemoglobin (HbO) changes significantly decreased in right prefrontal cortex (PFC) regions for high performers and in left PFC regions for low performers. During the transfer task, scan performance was maintained by both groups, while average HbO significantly increased in left dorsolateral PFC of high performers and left and right anterior medial PFC of low performers. In conclusion, we demonstrated intraindividual differences in expertise development during multi-session training.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Jevglevskaja, N., Galliott, J.: Airmen and unmanned aerial vehicles: the danger of generalization (2015)
Sweller, J., Van Merrienboer, J.J.G., Paas, F.G.W.C.: Cognitive architecture and instructional design. Educ. Psychol. Rev. 10(3), 251–296 (1998). https://doi.org/10.1023/A:1022193728205
Cabeza, R., Nyberg, L.: Imaging cognition II: an emperical review of 275 PET and fMRI Studies. J. Cogn. Neurosci. 12(1), 1–47 (2000)
Pinti, P., et al.: The present and future use of functional near‐infrared spectroscopy (fNIRS) for cognitive neuroscience. Ann. N. Y. Acad. Sci. 1464(1), 5–29 (2020). https://doi.org/10.1111/nyas.13948
Izzetoglu, M., Bunce, S.C., Izzetoglu, K., Onaral, B., Pourrezaei, K.: Functional brain imaging using near-infrared technology. IEEE Eng. Med. Biol. Mag. 26(4), 38–46 (2007)
Curtin, A., Ayaz, H.: The age of neuroergonomics: towards ubiquitous and continuous measurement of brain function with fNIRS. Jpn. Psychol. Res. 60(4), 374–386 (2018). https://doi.org/10.1111/jpr.12227
Menda, J., et al.: Optical brain imaging to enhance UAV operator training, evaluation, and interface development. J. Intell. Robot. Syst. Theory Appl. 61(1–4), 423–443 (2011). https://doi.org/10.1007/s10846-010-9507-7
Ayaz, H., Shewokis, P.A., Bunce, S., Izzetoglu, K., Willems, B., Onaral, B.: Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36–47 (2012). https://doi.org/10.1016/j.neuroimage.2011.06.023
Kerr, J., Reddy, P., Kosti, S., Izzetoglu, K.: UAS operator workload assessment during search and surveillance tasks through simulated fluctuations in environmental visibility. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) HCII 2019. LNCS (LNAI), vol. 11580, pp. 394–406. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22419-6_28
Reddy, P., Richards, D., Izzetoglu, K.: Evaluation of UAS operator training during search and surveillance tasks. In: 20th International Symposium on Aviation Psychology (2019)
Izzetoglu, K., Richards, D.: Human performance assessment: evaluation of wearable sensors for monitoring brain activity. In: Vidulich, M.A., Tsang, P.S. (eds.) Improving Aviation Performance through Applying Engineering Psychology. Advances in Aviation Psychology, 1st ed, pp. 163–180. CRC Press, London (2019). https://doi.org/10.4324/9780429492181-8
Reddy, P., Richards, D., Izzetoglu, K.: Cognitive performance assessment of UAS sensor operators via neurophysiological measures. In: 2nd International Neuroergonomics Conference (2018)
Palma Fraga, R., Reddy, P., Kang, Z., Izzetoglu, K.: Multimodal analysis using neuroimaging and eye movements to assess cognitive workload. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) HCII 2020. LNCS (LNAI), vol. 12196, pp. 50–63. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50353-6_4
Shewokis, P.A., Shariff, F.U., Liu, Y., Ayaz, H., Castellanos, A., Lind, D.S.: Acquisition, retention and transfer of simulated laparoscopic tasks using fNIR and a contextual interference paradigm. Am. J. Surg. 213(2), 336–345 (2017). https://doi.org/10.1016/j.amjsurg.2016.11.043
Galoyan, T., Betts, K., Abramian, H., Reddy, P., Izzetoglu, K., Shewokis, P.A.: Examining mental workload in a spatial navigation transfer game via functional near infrared spectroscopy. Brain Sci. 11(1), 45 (2021). https://doi.org/10.3390/brainsci11010045
Shewokis, P.A., et al.: Brain-in-the-Loop Learning using fNIR and simulated virtual reality surgical tasks: hemodynamic and behavioral effects. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) AC 2015. LNCS (LNAI), vol. 9183, pp. 324–335. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20816-9_31
Ayaz, H., Shewokis, P.A., Curtin, A., Izzetoglu, M., Izzetoglu, K., Onaral, B.: Using MazeSuite and functional near infrared spectroscopy to study learning in spatial navigation. J. Vis. Exp. 8(56), 3443 (2011). https://doi.org/10.3791/3443
Izzetoglu, M., Izzetoglu, K.: Real time artifact removal. US 2014/0372081 A1, 18 December 2014
Molavi, B., Dumont, G.A.: Wavelet-based motion artifact removal for functional near-infrared spectroscopy. Physiol. Meas. 33(2), 259–270 (2012). https://doi.org/10.1088/0967-3334/33/2/259
Villringer, A., Chance, B.: Non invasive optical spectroscopy and imaging of human brain function. Trends Neurosci. 20(10), 435–442 (1997). https://doi.org/10.1016/S0166-2236(97)01132-6
Westfall, J., Kenny, D.A., Judd, C.M.: Statistical Power And Optimal Design In Experiments In Which Samples Of Participants Respond To Samples Of Stimuli. J. Exp. Psychol. Gen. 143(5), 2020–2045 (2014). https://doi.org/10.1037/xge0000014
Wobbrock, J.O., Findlater, L., Gergle, D., Higgins, J.J.: The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures. In: Conference on Human Factors in Computing Systems - Proceedings, pp. 143–146 (2011). https://doi.org/10.1145/1978942.1978963
Kirilina, E., et al.: The physiological origin of task-evoked systemic artefacts in functional near infrared spectroscopy. Neuroimage 61(1), 70–81 (2012). https://doi.org/10.1016/j.neuroimage.2012.02.074
Acknowledgements
The authors would like to thank Shahar Kosti and Simlat, Inc., of Miamisburg, Ohio, USA, for providing access, licensing, and data extraction from the C-STAR simulator.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Reddy, P., Kerr, J., Shewokis, P.A., Izzetoglu, K. (2021). Brain Activity Changes Elicited Through Multi-session Training Assessment in the Prefrontal Cortex by fNIRS. In: Schmorrow, D.D., Fidopiastis, C.M. (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science(), vol 12776. Springer, Cham. https://doi.org/10.1007/978-3-030-78114-9_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-78114-9_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78113-2
Online ISBN: 978-3-030-78114-9
eBook Packages: Computer ScienceComputer Science (R0)