Evaluating User Experience in a Selection Based Brain-Computer Interface Game A Comparative Study

  • Hayrettin Gürkök
  • Gido Hakvoort
  • Mannes Poel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6972)


In human-computer interaction, it is important to offer the users correct modalities for particular tasks and situations. Unless the user has the suitable modality for a task, neither task performance nor user experience can be optimised. The aim of this study is to assess the appropriateness of using a steady-state visually evoked potential based brain-computer interface (BCI) for selection tasks in a computer game. In an experiment participants evaluated a BCI control and a comparable automatic speech recogniser (ASR) control in terms of workload, usability and engagement. The results showed that although BCI was a satisfactory modality in completing selection tasks, its use in our game was not engaging for the player. In our particular setup, ASR control appeared to be a better alternative to BCI control.


Brain-computer interface steady-state visually evoked potential games user experience engagement usability workload 


  1. 1.
    Bieger, J., Molina, G.G.: Light stimulation properties to influence brain activity: A brain-computer interface application. Tech. Rep. TN-2010-00315, Philips Research, Eindhoven, The Netherlands (2010)Google Scholar
  2. 2.
    Brockmyer, J.H., Fox, C.M., Curtiss, K.A., McBroom, E., Burkhart, K.M., Pidruzny, J.N.: The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology 45(4), 624–634 (2009)Google Scholar
  3. 3.
    Brooke, J.: SUS: a ‘quick and dirty’ usability scale. In: Usability Evaluation in Industry, pp. 189–194. Taylor & Francis Ltd., London (1996)Google Scholar
  4. 4.
    Groenegress, C., Holzner, C., Guger, C., Slater, M.: Effects of P300-based BCI use on reported presence in a virtual environment. Presence: Teleoperators and Virtual Environments 19(1), 1–11 (2010)Google Scholar
  5. 5.
    Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In: Human Mental Workload, pp. 139–183. North-Holland, Amsterdam (1988) Google Scholar
  6. 6.
    Hassenzahl, M., Burmester, M., Koller, F.: AttrakDiff: Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. In: Mensch & Computer 2003, pp. 187–196. B.G. Teubner, Stuttgart (2003) Google Scholar
  7. 7.
    Hassenzahl, M., Monk, A.: The inference of perceived usability from beauty. Human-Computer Interaction 25(3), 235–260 (2010)Google Scholar
  8. 8.
    Herrmann, C.S.: Human EEG responses to 1-100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Experimental Brain Research 137(3-4), 346–353 (2001)Google Scholar
  9. 9.
    van de Laar, B., Gürkök, H., Plass-Oude Bos, D., Nijboer, F., Nijholt, A.: Perspectives on user experience evaluation of brain-computer interfaces. In: Stephanidis, C. (ed.) HCII 2011 and UAHCI 2011, Part II. LNCS, vol. 6766, pp. 600–609. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    van de Laar, B., Reuderink, B., Plass-Oude Bos, D., Heylen, D.: Evaluating user experience of actual and imagined movement in BCI gaming. International Journal of Gaming and Computer-Mediated Simulations 2(4), 33–47 (2010)Google Scholar
  11. 11.
    Nacke, L.E., Kalyn, M., Lough, C., Mandryk, R.L.: Biofeedback game design: using direct and indirect physiological control to enhance game interaction. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems, pp. 103–112. ACM, New York (2011)Google Scholar
  12. 12.
    Nijholt, A., Reuderink, B., Oude Bos, D.: Turning shortcomings into challenges: Brain-computer interfaces for games. In: Nijholt, A., Reidsma, D., Hondorp, H. (eds.) INTETAIN 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol. 9, pp. 153–168. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  13. 13.
    Pasqualotto, E., Simonetta, A., Gnisci, V., Federici, S., Belardinelli, M.O.: Toward a usability evaluation of BCIs. International Journal of Bioelectromagnetism (to appear, 2011)Google Scholar
  14. 14.
    Pfurtscheller, G., Muller-Putz, G., Scherer, R., Neuper, C.: Rehabilitation with brain-computer interface systems. Computer 41(10), 58–65 (2008)Google Scholar
  15. 15.
    Plass-Oude Bos, D., Reuderink, B., van de Laar, B., Gürkök, H., Mühl, C., Poel, M., Nijholt, A., Heylen, D.: Brain-computer interfacing and games. In: Brain-Computer Interfaces: Applying our Minds to Human-Computer Interaction, pp. 149–178. Springer, London (2010)Google Scholar
  16. 16.
    Riccio, A., Leotta, F., Bianchi, L., Aloise, F., Zickler, C., Hoogerwerf, E.J., Kübler, A., Mattia, D., Cincotti, F.: Workload measurement in a communication application operated through a P300-based brain-computer interface. Journal of Neural Engineering 8(2), 025028 (2011)Google Scholar
  17. 17.
    Tonet, O., Marinelli, M., Citi, L., Rossini, P.M., Rossini, L., Megali, G., Dario, P.: Defining brain-machine interface applications by matching interface performance with device requirements. Journal of Neuroscience Methods 167(1), 91–104 (2008)Google Scholar
  18. 18.
    Wechsung, I., Naumann, A.: Evaluation methods for multimodal systems: A comparison of standardized usability questionnaires. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol. 5078, pp. 276–284. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  19. 19.
    Zander, T.O., Gaertner, M., Kothe, C., Vilimek, R.: Combining eye gaze input with a brain-computer interface for touchless human-computer interaction. International Journal of Human-Computer Interaction 27(1), 38–51 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Hayrettin Gürkök
    • 1
  • Gido Hakvoort
    • 1
  • Mannes Poel
    • 1
  1. 1.Human-Media InteractionUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations