Skip to main content
Log in

Real-time 3D fluid simulation digital art using BCI

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

We present a methodology about real-time 3D fluid simulation system using BCI (brain–computer interface). Spectators appreciate our work with their emotion. The advance of technology has exerted huge impacts on arts and as result a new genre called digital art has emerged. In digital art, interaction is an important element. Various types of interaction are bein g implemented in digital art using touch, hand gesture, sound, movement, etc., even brain wave. Usually, digital artists pursue interactions in their art work; the reason is that they want spectators’ deep appreciation and involvement. However, many of interactive digital art works fail to induce interaction as much as the artists expected. If visible interaction is weak, or interaction result is weak, spectators are not immersed much in the work. Nowadays, there are many interactive digital arts. In digital art, new type of interaction is needed to captivate spectators. So, we tried to implement BCI interaction digital art prototype (tentative title: Soul flow). Electroencephalography (EEG) is the recording of brain electrical activity along the scalp. We measured user’s EEG signal using MindSet (the MindSet senses EEG brainwave data to power the innovation of laboratory researchers and application developers like no other EEG device in the world. It delivers RAW signal, power frequency bands and NeuroSky eSense meters:attention, meditation. http://www.neurosky.com/products/mindset.aspx) to take user’s emotional state on appreciating digital art. We can get user’s emotional state in four categories (attention/inattention, meditation/uneasiness) and these emotional states interact with 3D fluid simulation system in real-time. In this art work prototype, each spectator experiences each different fluid (scale, speed and visual) because each spectator has different emotional state. Our art work prototype expressed the flow through water flow simulation. Flow means the mental state of operation in which a person performing an activity is fully immersed in a feeling of energized focus, full involvement, and enjoyment in the process of the activity. In essence, flow is characterized by complete absorption in what one does (The psychology of optimal experience 1990). In addition, it means stream in water flow. We pursued these concepts and expressed to 3D fluid simulation digital art using BCI. We used Unity3D and MindSet to implement our art work prototype. This study will expand the participation of the spectator in digital art. In addition, it will expand the possibilities of BCI in digital art interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

Notes

  1. The MindSet senses EEG brainwave data to power the innovation of laboratory researchers and application developers like no other EEG device in the world. It delivers RAW signal, power frequency bands and NeuroSky eSense meters:attention, meditation.

References

  1. Yang, H.-S.: Do you know “Interactive media art”, ZDNet Korea News. http://www.zdnet.co.kr (2003)

  2. Healthy high-hostiles evidence low-alpha power (7.5–9.5 Hz) changes during negative affective learning. Brain Cogn. 52(3), 334–342 (2003)

  3. Riccitiello, J.: John Riccitiello sets out to identify the engine of growth for Unity Technologies (interview). VentureBeat. Interview with Dean Takahashi (2015)

  4. How Unity3D became a game-development beast. Dice (2013). http://slashdot.org/. Accessed 13 July 2014

  5. Helgason, D.: Game developers, start your Unity3D engines. GamesBeat. Interview with Dean Takahashi (VentureBeat) (2014)

  6. Vidal, J.J.: Toward direct brain-computer communication. Ann. Rev. Biophys. Bioeng. 2(1), 157–180 (1973)

    Article  MathSciNet  Google Scholar 

  7. Vidal, J.: “Real-time detection of brain events in EEG” (PDF). IEEE Proceed. 65(5), 633–641 (1977)

    Article  Google Scholar 

  8. Levine, S.P., Huggins, J.E., Bement, S.L., Kushwaha, R.K., Schuh, L.A., Rohde, M.M., Passaro, E.A., Ross, D.A., Elisevich, K.V., et al.: A direct brain interface based on event-related potentials. IEEE Trans. Rehabil. Eng. Pub. IEEE Eng. Med. Biol. Soc. 8(2), 180–185 (2000)

    Article  Google Scholar 

  9. Lal, S.K.L., Craig, A.: A critical review of the psychophysiology of driver fatigue. Biol. Psychol. 55, 173–194 (2001)

    Article  Google Scholar 

  10. Wang, Q., Sourina, O., Nguyen, M.K.: EEG-based “serious” games design for medical applications. In: Cyberworlds (CW), international conference, pp. 270–276 (2010)

  11. Kelly, G.S.: Body temperature variability (part 2): masking influences of body temperature variability and a review of body temperature variability in disease. Altern. Med. Rev. 12(1), 49–62 (2007)

    MathSciNet  Google Scholar 

  12. Jeong, E., Moon, B., Lee, Y.: A platform for real time brain-waves analysis system. Grid and Distributed Computing, vol. 261, pp. 431–437. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  13. Yoo, K.-S., Kim, I.-W., Youn, J.-H., Lee, D.-J., Lee, W.-H.: A design of functional game contents and analysis of power spectrum. Korean Soc. Comput. Game 6 (2005)

  14. Rebsamen, B., Burdet, E., Guan, C., Zhang, H., Teo, C.L., Zeng, Q., et al.: A brain-controlled wheelchair based on P300 and path guidance, pp. 1101–1106 (2006)

  15. Choi, H.S.: Using brain-computer interfaces to analyze EEG data for safety improvement. In: Proceedings of the Trust Autumn conference (2012)

  16. Rebsamen, B., Teo, C.L., Zeng, Q., Ang Jr, M.H., Burdet, E., Guan, C., et al.: Controlling a wheelchair indoors using thought. IEEE Intell. Syst. 22, 18–24 (2007)

    Article  Google Scholar 

  17. Lecuyer, A., Lotte, F., Reilly, R.B., Leeb, R., Hirose, M., Slater, M.: Brain-computer interfaces, virtual reality, and videogames. Computer 41, 66–72 (2008)

    Article  Google Scholar 

  18. Hammond, D.C.: What is neurofeedback? J. Neurother. 10, 25–36 (2006)

    Article  Google Scholar 

  19. Luber, J.F., Shouse, M.N.: EEG and behavioral changes in a hyperkinetic child concurrent with training of the sensorimotor rhythm (SMR): a preliminary report. Biofeedback Self Regul. 1(3), 293–305 (1976)

    Article  Google Scholar 

  20. Kim, G.: A study on the ways of representing chronological information in interactive installation. Korean Soc. Basic Design Art 11(2), 31–41 (2010)

    Google Scholar 

  21. Kim, H.J.: Study on interactivity of contemporary art: focused on the analysis of the communicative ways in interactive art. Master thesis, HONGIK University (2005)

  22. Kim, J.-H., Yoon, J.-S.: An interdisciplinary research on media art and information science technology focusing on the computer-based interactive art. Korean Soc. Basic Design Art 7(3), 349–354 (2006)

    MathSciNet  Google Scholar 

Download references

Acknowledgments

This Research was supported by Seokyeong University in 2015.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sung-dae Hong.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cho, OH., Hong, Sd. Real-time 3D fluid simulation digital art using BCI. J Real-Time Image Proc 13, 419–429 (2017). https://doi.org/10.1007/s11554-015-0546-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-015-0546-y

Keywords

Navigation