Advertisement

EEG Signal Analysis in 3D Modelling to Identify Correlations Between Task Completion in Design User’s Cognitive Activities

  • Muhammad Zeeshan Baig
  • Manolya Kavakli
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11306)

Abstract

Modelling software applications vary from construction to gaming, but learning a modelling software and becoming a skilled user takes a long time and effort. Reducing the time to learn a modelling software is an important topic in human-computer interaction (HCI). To develop futuristic computer-aided design (CAD) systems that require little or no training, it is important to study the user-dependent factors that affect the system performance directly and indirectly by analysing the cognitive activity of the users. In this research, we have presented a new method to segment the EEG data: we segmented designer’s actions and then used it to align with the EEG data, while they draw a 3D object in AutoCAD. We video recorded the design activities and Electroencephalography (EEG) signals while users were performing the task. The mean EEG power of the alpha, beta, theta and gamma bands has been used to analyse the designer behaviour. We found that the users who completed the experiment in a short time-frame were performing more physical actions than perceptual and conceptual actions. Participants with low Completion Time (CT) participants perform 30% more actions per minute than high-CT participants. EEG analysis demonstrated that the task completion time (CT) was negatively correlated with physical actions. Alpha-and beta-band analysis showed that low-CT participants were more comfortable in performing physical action and high-CT participants are relaxed in performing conceptual actions.

Keywords

Cognitive activity CAD EEG HCI 3D modelling 

References

  1. 1.
    Al-Qahtani, A., Nasir, A., Shakir, M.Z., Qaraqe, K.A.: Cognitive impairments in human brain due to wireless signals and systems: an experimental study using EEG signal analysis. In: 2013 IEEE 15th International Conference on e-Health Networking, Applications & Services (Healthcom), pp. 1–3. IEEE (2013)Google Scholar
  2. 2.
    Chiu, I., Shu, L.: Potential limitations of verbal protocols in design experiments. In: ASME 2010 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 287–296. American Society of Mechanical Engineers (2010)Google Scholar
  3. 3.
    De Graaf, T.A., Gross, J., Paterson, G., Rusch, T., Sack, A.T., Thut, G.: Alpha-band rhythms in visual task performance: phase-locking by rhythmic sensory stimulation. PloS one 8(3), e60035 (2013)Google Scholar
  4. 4.
    Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial eeg dynamics including independent component analysis. J. Neurosci. Methods 134(1), 9–21 (2004)CrossRefGoogle Scholar
  5. 5.
    Fairclough, S.H., Venables, L., Tattersall, A.: The influence of task demand and learning on the psychophysiological response. Int. J. Psychophysiol. 56(2), 171–184 (2005)CrossRefGoogle Scholar
  6. 6.
    Gal, U., Lyytinen, K., Yoo, Y.: The dynamics of it boundary objects, information infrastructures, and organisational identities: the introduction of 3D modelling technologies into the architecture, engineering, and construction industry. Eur. J. Inf. Syst. 17(3), 290–304 (2008)CrossRefGoogle Scholar
  7. 7.
    Gevins, A., et al.: Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum. Fact. 40(1), 79–91 (1998)CrossRefGoogle Scholar
  8. 8.
    Gola, M., Magnuski, M., Szumska, I., Wróbel, A.: EEG beta band activity is related to attention and attentional deficits in the visual performance of elderly subjects. Int. J. Psychophysiol. 89(3), 334–341 (2013)CrossRefGoogle Scholar
  9. 9.
    Gruzelier, J.H.: EEG-neurofeedback for optimising performance. i: a review of cognitive and affective outcome in healthy participants. Neurosci. Biobehav. Rev. 44, 124–141 (2014)CrossRefGoogle Scholar
  10. 10.
    Gundel, A., Wilson, G.F.: Topographical changes in the ongoing eeg related to the difficulty of mental tasks. Brain Topogr. 5(1), 17–25 (1992)CrossRefGoogle Scholar
  11. 11.
    Hjortskov, N., Rissén, D., Blangsted, A.K., Fallentin, N., Lundberg, U., Søgaard, K.: The effect of mental stress on heart rate variability and blood pressure during computer work. Eur. J. Appl. Physiol. 92(1–2), 84–89 (2004)CrossRefGoogle Scholar
  12. 12.
    Kahneman, D., Egan, P.: Thinking, Fast and Slow, vol. 1. Farrar, Straus and Giroux, New York (2011)Google Scholar
  13. 13.
    Kavakli, M., Boyali, A.: Design: robust gesture recognition in conceptual design, sensor analysis and synthesis. In: Gulrez, T., Hassanien, A.E. (eds.) Advances in Robotics and Virtual Reality, pp. 201–225. Springer, Heidelberg (2012).  https://doi.org/10.1007/978-3-642-23363-0_9CrossRefGoogle Scholar
  14. 14.
    Kavakli, M., Suwa, M., Gero, J., Purcell, T.: Sketching interpretation in novice and expert designers. In: Visual and Spatial Reasoning in Design, vol. 99, pp. 209–219. Citeseer (1999)Google Scholar
  15. 15.
    Klimesch, W., Sauseng, P., Hanslmayr, S.: EEG alpha oscillations: the inhibition-timing hypothesis. Brain Res. Rev. 53(1), 63–88 (2007)CrossRefGoogle Scholar
  16. 16.
    Kristiansen, J., et al.: Stress reactions to cognitively demanding tasks and open-plan office noise. Int. Arch. Occup. Environ. Health 82(5), 631–641 (2009)CrossRefGoogle Scholar
  17. 17.
    Kuusela, H., Pallab, P.: A comparison of concurrent and retrospective verbal protocol analysis. Am. J. Psychol. 113(3), 387 (2000)CrossRefGoogle Scholar
  18. 18.
    Liu, Y., Ritchie, J.M., Lim, T., Kosmadoudi, Z., Sivanathan, A., Sung, R.C.: A fuzzy psycho-physiological approach to enable the understanding of an engineer affect status during cad activities. Computer-Aided Design 54, 19–38 (2014)CrossRefGoogle Scholar
  19. 19.
    Mandryk, R.L., Atkins, M.S.: A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int. J. Hum.-Comput. Stud. 65(4), 329–347 (2007)CrossRefGoogle Scholar
  20. 20.
    Nguyen, T.A., Zeng, Y.: Analysis of design activities using EEG signals. In: ASME 2010 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, pp. 277–286. American Society of Mechanical Engineers (2010)Google Scholar
  21. 21.
    Nguyen, T.A., Zeng, Y.: A physiological study of relationship between designer mental effort and mental stress during conceptual design. Comput.-Aided Des. 54, 3–18 (2014)CrossRefGoogle Scholar
  22. 22.
    Nguyen, T.A., Zeng, Y.: Effects of stress and effort on self-rated reports in experimental study of design activities. J. Intell. Manuf. 28(7), 1609–1622 (2017)CrossRefGoogle Scholar
  23. 23.
    Pellouchoud, E., Smith, M.E., McEvoy, L., Gevins, A.: Mental effort-related eeg modulation during video-game play: Comparison between juvenile subjects with epilepsy and normal control subjects. Epilepsia 40(s4), 38–43 (1999)CrossRefGoogle Scholar
  24. 24.
    Sauro, J., Kindlund, E.: A method to standardize usability metrics into a single score. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 401–409. ACM (2005)Google Scholar
  25. 25.
    Schächinger, H., Weinbacher, M., Kiss, A., Ritz, R., Langewitz, W.: Cardiovascular indices of peripheral and central sympathetic activation. Psychosom. Med. 63(5), 788–796 (2001)CrossRefGoogle Scholar
  26. 26.
    Sterman, M., Mann, C.: Concepts and applications of EEG analysis in aviation performance evaluation. Biol. Psychol. 40(1–2), 115–130 (1995)CrossRefGoogle Scholar
  27. 27.
    Suwa, M., Purcell, T., Gero, J.: Macroscopic analysis of design processes based on a scheme for coding designers’ cognitive actions. Des. Stud. 19(4), 455–483 (1998)CrossRefGoogle Scholar
  28. 28.
    Tang, Y., Zeng, Y.: Quantifying designer mental stress in the conceptual design process using kinesics study. In: DS 58–9: Proceedings of ICED 09, The 17th International Conference on Engineering Design, vol. 9, Human Behavior in Design, Palo Alto, CA, USA, 24–27 August 2009Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.VISOR (Virtual and Interactive Simulations of Reality) Research Group, Department of ComputingMacquarie UniversitySydneyAustralia

Personalised recommendations