Abstract
We present a methodology about real-time 3D fluid simulation system using BCI (brain–computer interface). Spectators appreciate our work with their emotion. The advance of technology has exerted huge impacts on arts and as result a new genre called digital art has emerged. In digital art, interaction is an important element. Various types of interaction are bein g implemented in digital art using touch, hand gesture, sound, movement, etc., even brain wave. Usually, digital artists pursue interactions in their art work; the reason is that they want spectators’ deep appreciation and involvement. However, many of interactive digital art works fail to induce interaction as much as the artists expected. If visible interaction is weak, or interaction result is weak, spectators are not immersed much in the work. Nowadays, there are many interactive digital arts. In digital art, new type of interaction is needed to captivate spectators. So, we tried to implement BCI interaction digital art prototype (tentative title: Soul flow). Electroencephalography (EEG) is the recording of brain electrical activity along the scalp. We measured user’s EEG signal using MindSet (the MindSet senses EEG brainwave data to power the innovation of laboratory researchers and application developers like no other EEG device in the world. It delivers RAW signal, power frequency bands and NeuroSky eSense meters:attention, meditation. http://www.neurosky.com/products/mindset.aspx) to take user’s emotional state on appreciating digital art. We can get user’s emotional state in four categories (attention/inattention, meditation/uneasiness) and these emotional states interact with 3D fluid simulation system in real-time. In this art work prototype, each spectator experiences each different fluid (scale, speed and visual) because each spectator has different emotional state. Our art work prototype expressed the flow through water flow simulation. Flow means the mental state of operation in which a person performing an activity is fully immersed in a feeling of energized focus, full involvement, and enjoyment in the process of the activity. In essence, flow is characterized by complete absorption in what one does (The psychology of optimal experience 1990). In addition, it means stream in water flow. We pursued these concepts and expressed to 3D fluid simulation digital art using BCI. We used Unity3D and MindSet to implement our art work prototype. This study will expand the participation of the spectator in digital art. In addition, it will expand the possibilities of BCI in digital art interaction.
Similar content being viewed by others
Notes
The MindSet senses EEG brainwave data to power the innovation of laboratory researchers and application developers like no other EEG device in the world. It delivers RAW signal, power frequency bands and NeuroSky eSense meters:attention, meditation.
References
Yang, H.-S.: Do you know “Interactive media art”, ZDNet Korea News. http://www.zdnet.co.kr (2003)
Healthy high-hostiles evidence low-alpha power (7.5–9.5 Hz) changes during negative affective learning. Brain Cogn. 52(3), 334–342 (2003)
Riccitiello, J.: John Riccitiello sets out to identify the engine of growth for Unity Technologies (interview). VentureBeat. Interview with Dean Takahashi (2015)
How Unity3D became a game-development beast. Dice (2013). http://slashdot.org/. Accessed 13 July 2014
Helgason, D.: Game developers, start your Unity3D engines. GamesBeat. Interview with Dean Takahashi (VentureBeat) (2014)
Vidal, J.J.: Toward direct brain-computer communication. Ann. Rev. Biophys. Bioeng. 2(1), 157–180 (1973)
Vidal, J.: “Real-time detection of brain events in EEG” (PDF). IEEE Proceed. 65(5), 633–641 (1977)
Levine, S.P., Huggins, J.E., Bement, S.L., Kushwaha, R.K., Schuh, L.A., Rohde, M.M., Passaro, E.A., Ross, D.A., Elisevich, K.V., et al.: A direct brain interface based on event-related potentials. IEEE Trans. Rehabil. Eng. Pub. IEEE Eng. Med. Biol. Soc. 8(2), 180–185 (2000)
Lal, S.K.L., Craig, A.: A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 55, 173–194 (2001)
Wang, Q., Sourina, O., Nguyen, M.K.: EEG-based “serious” games design for medical applications. In: Cyberworlds (CW), international conference, pp. 270–276 (2010)
Kelly, G.S.: Body temperature variability (part 2): masking influences of body temperature variability and a review of body temperature variability in disease. Altern. Med. Rev. 12(1), 49–62 (2007)
Jeong, E., Moon, B., Lee, Y.: A platform for real time brain-waves analysis system. Grid and Distributed Computing, vol. 261, pp. 431–437. Springer, Heidelberg (2011)
Yoo, K.-S., Kim, I.-W., Youn, J.-H., Lee, D.-J., Lee, W.-H.: A design of functional game contents and analysis of power spectrum. Korean Soc. Comput. Game 6 (2005)
Rebsamen, B., Burdet, E., Guan, C., Zhang, H., Teo, C.L., Zeng, Q., et al.: A brain-controlled wheelchair based on P300 and path guidance, pp. 1101–1106 (2006)
Choi, H.S.: Using brain-computer interfaces to analyze EEG data for safety improvement. In: Proceedings of the Trust Autumn conference (2012)
Rebsamen, B., Teo, C.L., Zeng, Q., Ang Jr, M.H., Burdet, E., Guan, C., et al.: Controlling a wheelchair indoors using thought. IEEE Intell. Syst. 22, 18–24 (2007)
Lecuyer, A., Lotte, F., Reilly, R.B., Leeb, R., Hirose, M., Slater, M.: Brain-computer interfaces, virtual reality, and videogames. Computer 41, 66–72 (2008)
Hammond, D.C.: What is neurofeedback? J. Neurother. 10, 25–36 (2006)
Luber, J.F., Shouse, M.N.: EEG and behavioral changes in a hyperkinetic child concurrent with training of the sensorimotor rhythm (SMR): a preliminary report. Biofeedback Self Regul. 1(3), 293–305 (1976)
Kim, G.: A study on the ways of representing chronological information in interactive installation. Korean Soc. Basic Design Art 11(2), 31–41 (2010)
Kim, H.J.: Study on interactivity of contemporary art: focused on the analysis of the communicative ways in interactive art. Master thesis, HONGIK University (2005)
Kim, J.-H., Yoon, J.-S.: An interdisciplinary research on media art and information science technology focusing on the computer-based interactive art. Korean Soc. Basic Design Art 7(3), 349–354 (2006)
Acknowledgments
This Research was supported by Seokyeong University in 2015.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Cho, OH., Hong, Sd. Real-time 3D fluid simulation digital art using BCI. J Real-Time Image Proc 13, 419–429 (2017). https://doi.org/10.1007/s11554-015-0546-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11554-015-0546-y