Brain-in-the-Loop Learning Using fNIR and Simulated Virtual Reality Surgical Tasks: Hemodynamic and Behavioral Effects
Functional near infrared spectroscopy (fNIR) is a noninvasive, portable optical imaging tool to monitor changes in hemodynamic responses (i.e., oxygenated hemoglobin (HbO)) within the prefrontal cortex (PFC) in response to sensory, motor or cognitive activation. We used fNIR for monitoring PFC activation during learning of simulated laparoscopic surgical tasks throughout 4 days of training and testing. Blocked (BLK) and random (RND) practice orders were used to test the practice schedule effect on behavioral, hemodynamic responses and relative neural efficiency (EFFrel-neural) measures during transfer. Left and right PFC for both tasks showed significant differences with RND using less HbO than BLK. Cognitive workload showed RND exhibiting high EFFrel-neural across the PFC for the coordination task while the more difficult cholecystectomy task showed EFFrel-neural differences only in the left PFC. Use of brain activation, behavioral and EFFrel-neural measures can provide a more accurate depiction of the generalization or transfer of learning.
KeywordsCognitive effort and learning fNIR Simulation Virtual reality Transfer Brain sensors and measures Contextual interference
This study was funded in part under a Drexel University College of Medicine and International Blue Cross Seed Grant #1312002473 (Panait, PI) and National Science Foundation (NSF) grant IIS: 1064871 (Shewokis, PI).
- 5.Shewokis, P.A., Ayaz, H., Izzetoglu, M., Bunce, S., Gentili, R.J., Sela, I., Izzetoglu, K., Onaral, B.: Brain in the loop: assessing learning using fnir in cognitive and motor tasks. In: Schmorrow, D.D., Fidopiastis, C.M. (eds.) FAC 2011. LNCS, vol. 6780, pp. 240–249. Springer, Heidelberg (2011)Google Scholar
- 9.Paas, F., van Merrienboer, J.J.G.: The efficiency of instructional conditions: an approach to combine mental effort and performance measures. Hum. Factors 35, 737–743 (1993)Google Scholar
- 13.Lossing, A.G., Hatswell, E.M., Gilas, T., Reznick, R.K., Smith, L.C.: A technical-skills course for 1st-year residents in general surgery: a descriptive study. Can. J. Surg. 35(5), 536–540 (1992)Google Scholar
- 15.Stefanidis, D., Sevdalis, N., Paige, J., Zevin, B., Aggarwal, R., Grantcharov, T., Jones, D.B.: Simulation in surgery: what’s needed next? Ann. Surg. 261, 1–8 (2014)Google Scholar
- 18.Ayaz, H., Shewokis, P.A., Curtin, A., Izzetoglu, M., Izzetoglu, K., Onaral, B.: Using MazeSuite and functional near infrared spectroscopy to study learning in spatial navigation. J. Vis. Exp. 56, 1–12 (2011)Google Scholar
- 20.Ayaz, H., Izzetoglu, M., Platek, S.M., Bunce, S., Izzetoglu, K., Pourezaei, K., Onaral, B.: Registering fNIR data to brain surface image using MRI templates. In: 28th IEEE EMBS Annual International Conference, pp. 2671−2674, New York City (2006)Google Scholar
- 21.Ayaz, H., Izzetoglu, M., Shewokis, P.A., Onaral, B.: Sliding-window motion artifact rejection for functional near-infrared spectroscopy. In: 32nd Annual International Conference of the IEEE EMBS, pp. 6567–6570, Buenos Aires, Argentina (2010)Google Scholar
- 22.Ayaz, H., Çakır, M.P., Izzetoglu, K., Curtin, A., Shewokis, P.A., Bunce, S., Onaral, B.: Monitoring Expertise Development during Simulated UAV Piloting Tasks using Optical Brain Imaging. In: 2012 IEEE Aerosp Conference, pp. 1–11, Big Sky, Montana (2012)Google Scholar
- 27.Ayaz, H., Onaral, B., Izzetoglu, K., Shewokis, P.A., McKendrick, R., Parasuraman, R.: Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development. Front. Hum. Neurosci. 7, 1–13 (2013)CrossRefGoogle Scholar