A Visual Spelling System Using SSVEP Based Hybrid Brain Computer Interface with Video-Oculography

  • D. SaravanakumarEmail author
  • M. Ramasubba Reddy
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 940)


A hybrid Brain Computer Interface (BCI) system is developed using steady state visual evoked potential (SSVEP) along with the video-oculogram (VOG). The keyboard layout is designed with 23 characters flickering at selected frequencies. The template matched webcam images provide the direction of eye gaze information to localize the user gazing space on the visual keyboard/display. This spatial localization helps to use/make multiple stimuli of the same frequency. The canonical correlation analysis (CCA) is used for SSVEP frequency recognition. The experiments were conducted on 8 subjects for both online and offline analysis. Based on the classification accuracy from offline analysis, the subject specific SSVEP stimulus duration and the optimal number of EEG channels were selected for online analysis. An average online classification accuracy of 93.5% was obtained with the information transfer rate (ITR) of 96.54 bits/min without inter character identifying delay. When a delay of 0.5 s is introduced between stimulus window the ITR of 80.17 bits/min is realized.


Steady state visual evoked potential Video-oculography Canonical correlation analysis (CCA) 


  1. 1.
    Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain computer interfaces for communication and control. Front. Neurosci. 4, 767–791 (2002)Google Scholar
  2. 2.
    Srihari Mukesh, T.M., Jaganathan, V., Reddy, M.R.: A novel multiple frequency stimulation method for steady state VEP based brain computer interfaces. Physiol. Meas. 27, 61–71 (2006)CrossRefGoogle Scholar
  3. 3.
    Hwang, H.J., Hwan Kim, D., Han, C.H., Im, C.H.: A new dual-frequency stimulation method to increase the number of visual stimuli for multi-class SSVEP-based brain-computer interface (BCI). Brain Res. 1515, 66–77 (2013)CrossRefGoogle Scholar
  4. 4.
    Chang, M.H., Lee, J.S., Heo, J., Park, K.S.: Eliciting dual-frequency SSVEP using a hybrid SSVEP-P300 BCI. J. Neurosci. Methods 258, 104–113 (2016)CrossRefGoogle Scholar
  5. 5.
    Lim, J.H., Lee, J.H., Hwang, H.J., Kim, D.H., Im, C.H.: Development of a hybrid mental spelling system combining SSVEP-based brain-computer interface and webcam-based eye tracking. Biomed. Signal Process. Control 21, 99–104 (2015)CrossRefGoogle Scholar
  6. 6.
    Yin, E., Zhou, Z., Jiang, J., Yu, Y., Hu, D.: A dynamically optimized SSVEP brain – computer. IEEE Trans. Biomed. Eng. 62, 1447–1456 (2015)CrossRefGoogle Scholar
  7. 7.
    ADS129x Low-Power, 8-Channel, 24-Bit Analog Front-End for Biopotential Measurements (2015)Google Scholar
  8. 8.
    Lin, Z., Zhang, C., Wu, W., Gao, X.: Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs. IEEE Trans. Biomed. Eng. 53, 2610–2614 (2006)CrossRefGoogle Scholar
  9. 9.
    Bin, G., Gao, X., Yan, Z., Hong, B., Gao, S.: An online multi-channel SSVEP based brain computer interface using a canonical correlation analysis method. J. Neural Eng. 6, 046002 (2009)CrossRefGoogle Scholar
  10. 10.
    Wolpaw, J.R., Ramoser, H., McFarland, D.J., Pfurtscheller, G.: EEG-based communication: improved accuracy by response verification. IEEE Trans. Rehabil. Eng. 6, 326–333 (1998)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Biomedical Group, Department of Applied MechanicsIndian Institute of Technology MadrasChennaiIndia

Personalised recommendations