Skip to main content
SpringerLink
Log in

An EEG signal-based music treatment system for autistic children using edge computing devices

  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

This paper proposes a system that applies electroencephalogram (EEG) technology to achieve music intervention therapy. The system can identify emotions of autistic children in real-time and play music considering their emotions as a musical treatment to assist the treatment of music therapists and the principle of playing homogenous music is to finally calm people down. The proposed method firstly collects EEG of autistic children using a 14-channel EMOTIV EPOC + and preprocesses signals through bandpass filtering, wavelet decomposition and reconstruction, then extracts frequency band-power characteristics of reconstructed EEG signals. Later, the data are classified as one of the three types of emotions (positive, middle and negative) using a support vector machine (SVM). The system also displays the recognized emotion type on a user interface and gives real-time emotional state feedback on emotional changes, which helps music therapists to evaluate the treatment and results more conveniently and effectively. Real EEG data are used to conduct the verification of system feasibility which reaches a classification accuracy of 88%. As the Internet of Things develops, the combination of edge computing with Wise Information Technology of 120 (WIT120) becomes a new trend. In this work, we propose a system to combine edge computing devices with cloud computing resources to form the music regulation system for autistic children to meet processing requirements for EEG signals in terms of timeliness and computational performance. In the designed system, preprocessing EEG signals is done in edge nodes then the preprocessed signals are sent to the cloud where frequency band-power characteristics can be extracted as features to be used in SVM. At last, the results are sent to a mobile app or computer software for therapists to evaluate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Candra, H., Yuwono, M., Chai, R., Handojoseno, A., Elamvazuthi, I., Nguyen, H. T., & Su, S. (2015). Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine. In 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

  2. Chen, J., & Xu, W. (2020). Analysis of EEG signals in children with autism spectrum disorder under positive and negative emotional stimuli. Chinese Journal, 65(21), 2245–2255.

    Google Scholar 

  3. Cyr, B., Horn, W., Miao, D., & Specter, M. (2014). Security analysis of wearable fitness devices (fitbit). Massachusetts Institute of Technology, 1.

  4. He, L. P. (2020). Health data management and analysis system based on edge computing. Electronic Design Engineering, 28(9), 54–58.

    Google Scholar 

  5. Gonzalez, H. A., Yoo, J., & Elfadel, I. M. (2019). Eeg-based emotion detection using unsupervised transfer learning. 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

  6. Jenke, P., Buss Jenke, R., Peer, A., & Buss, M. (2017). Feature extraction and selection for emotion recognition from EEG. IEEE Transactions on Affective Computing, 5(3), 327–339.

    Article  Google Scholar 

  7. Jin, W., Li, H., Xiao, Lu., Zhou Jin, Y., Wang, J. R., Li, L. Q., Huang, Z. M., Xiao, Y. T., Lu, H. Y., & Zhou, H. S. (2008). Construction and application of visual music therapy system for special children. Chinese Journal of Special Education, 15(5), 7–12.

    Google Scholar 

  8. Li, Y., Yan, K., School, University, and School Li, B., Ying, Z., Yan, L., Kai. J., School, E.S., University, Z., School, M. (2017). Research in music essence on Chinese the horizon of cultural psychology. Psychological Exploration 37(1):8–11

  9. Li, X., Sangaiah, W., Li, G., Xu, G., Sangaiah, K., Wu, J., Li, J. (2019). Edgelaas: Edge learning as a service for knowledge-centric connected healthcare. IEEE Network 33(6)

  10. Liu, K., Liu, S., Linge Liu, Q., Kamoto, K. M., Liu, X., Sun, M., & Linge, N. (2019). Low-complexity non-intrusive load monitoring using unsupervised learning and generalized appliance models. IEEE Transactions on Consumer Electronics, 65(1), 28–37.

    Article  Google Scholar 

  11. Liu, Wu., Jiang, L., Zhang, Xu., Qi Liu, Q., Wu, X., Jiang, Y., Liu, X., Zhang, Y., Xu, X., & Qi, L. (2021). A fully connected deep learning approach to upper limb gesture recognition in a secure FES rehabilitation environment. International Journal of Intelligent Systems, 36(5), 2387–2411.

    Article  Google Scholar 

  12. Liu, Z., Yin, Li., Feng Liu, Z., Zhang, L., Yin, X., Li, Z., & Feng, S. (2011). A clinical study of music therapy in the treatment of children’s autism. Journal of Pediatrics of Traditional Chinese Medicine, 7(6), 17–19.

    Google Scholar 

  13. Luo, S., Yu, Management, University, School, and University Luo, Y., Su, F., Yu, Z., Management, S.O., University, S., School, B., University, S.M. (2017). Impact of happy music on cooperative behavior-the mediating role of mood. Human Resources Development of China 29(6):34–43

  14. Luo, J., Li Luo, Z., Jin, S., & Li, Y. (2018). Denoising method of EEG signal based on tangent function of denoising source separation. Journal of Huazhong University of Science and Technology (Natural Science Edition), 46(12), 60–64.

    Google Scholar 

  15. Nie, D., Wang, X. W., Duan, R. N., & Lv, B. L. (2012). A survey on EEG based emotion recognition. Zhongguo Shengwu Yixue Gongcheng Xuebao, 31(4), 595–606.

    Google Scholar 

  16. Pham, T.D., Tran, D. (2012). Emotion recognition using the emotiv EPOC device. International Conference on Neural Information Processing

  17. Qi, P., & Su, H. (2020). Task offloading strategy considering terminal mobility in medical wisdom scenario. Journal of Zhejiang University (Engineering Science), 54(6), 1126–1137.

    Google Scholar 

  18. Qiu, T. L. (2012). Music therapy intervention principles and methods of autism children. Journal of Yichun College, 34(1), 143–146.

    MathSciNet  Google Scholar 

  19. Shen, Xu., Qi, Z., Srivastava Shen, B., Xu, X., Qi, L., Zhang, X., & Srivastava, G. (2021). Dynamic server placement in edge computing toward internet of vehicles. Computer Communications, 178, 114–123.

    Article  Google Scholar 

  20. Sun, Z., Xue, Q., Wang, X., & Huang, X. (2020). A survey of emotion recognition method based on EEG signals. Beijing Biomedical Engineering, 39(2), 186–194.

    Google Scholar 

  21. Tang, Z., Ruan Tang, Q. B., Zheng, R. R., & Ruan, J. W. (2015). Sleep stages based on fuzzy entropy of EEG rhythm. Industrial Control Computer, 282(9), 113–114.

    Google Scholar 

  22. Wang, Z., & Yang, Z. (2018). Philosophy and systematic thinking of artificial intelligence technology. Telecommunications Science, 34(4), 12–21.

    MathSciNet  Google Scholar 

  23. Xia, X., Chen, F., He, Q., Cui, G., Grundy, J. C., Abdelrazek, M., Xu, X., & Jin, H. (2021). Data, user and power allocations for caching in multi-access edge computing. IEEE Transactions on Parallel and Distributed Systems, 33(5), 1144–1155.

    Article  Google Scholar 

  24. Xin, C., Tian, S., Fan Xin, L., Cai, E., Tian, Y., Sun, X., & Fan, M. (2017). An improved electroencephalogram feature extraction algorithm and its application in emotion recognition. Journal of Biomedical Engineering, 34(4), 510–517.

    Google Scholar 

  25. Xu, X., Fang, Z., Qi, L., Zhang, X., He, Q., & Zhou, X. (2021). Tripres Traffic flow prediction driven resource reservation for multimedia IOV with edge computing. ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), 17(2), 1–21.

    Article  Google Scholar 

  26. Xu, F., Zhang, He., Yu, Qi., Dou, Xu. X., Fang, Z., Zhang, J., He, Q., Yu, D., Qi, L., & Dou, W. (2021). Edge content caching with deep spatiotemporal residual network for IoV in smart city. ACM Transactions on Sensor Networks, 17(3), 1–33.

    Article  Google Scholar 

  27. Xu, H., Zhu, S., Zhang, Qi., Bhuiyan, Xu. X., Huang, Q., Zhu, H., Sharma, S., Zhang, X., Qi, L., & Bhuiyan, M. Z. A. (2021). Secure service offloading for internet of vehicles in sdn-enabled mobile edge computing. IEEE Transactions on Intelligent Transportation Systems, 22(6), 3720–3729.

    Article  Google Scholar 

  28. Zhang, L., Zhang Zhang, H., Liu, Y. Q., & Zhang, H. (2019). Analysis of safety valve effect of music therapy in relieving anxiety and depression of college students taking a college in the west of jiangxi province as an example. Journal of Yichun University, 41(4), 114–117.

    Google Scholar 

  29. Zhao, M. (2020). Survey on technology and application of edge computing. Computer Science, 47(S1), 268–282.

    Google Scholar 

  30. Zhu, X., Luo, S., Niu, X., Shen, T., Meng, X., Sun, M., & Pei, X. (2021). A pilot study on the music regulation system of autistic children based on EEG. In The 10th International Conference on Computer Engineering and Networks (pp. 1649-1657). Springer Singapore.

Download references

Acknowledgements

This work is an extended version of our previous paper [Zhu et al. (2021) Zhu, Luo, Niu, Shen, and Pei]. We would thank Xianping Niu and Xiangchao Meng for their help and feedback for previous experiments. This work proposes a system for realtime emotion recognition on EEG signals with reduced bandwidth pressure on the cloud and minimized delay of real-time recognition based on the edge computing theory so the data processing steps are reasonably divided and data processing and analysis are carried out faster.

Author information

Authors and Affiliations

  1. School of Electrical Engineering, University of Jinan, Jinan, 250022, China

    Mingxu Sun, Xiujin Zhu, Tao Shen, Bin Sun & Yuan Xu

  2. Shandong Shenghan Finance and Trade Vocational College, Jinan, 250316, China

    Lingfeng Xiao

  3. Special Education Center of Zhoucun District, Zibo, 255300, China

    Xianping Niu

  4. Jinan Minzu Hospital, Jinan, 250002, China

    Peng Zhang

Authors
  1. Mingxu Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lingfeng Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiujin Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Peng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xianping Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tao Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Bin Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Yuan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yuan Xu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This work was supported in part by This work is supported by Key R & D projects of Shandong Province under grant 2019JZZY021005.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, M., Xiao, L., Zhu, X. et al. An EEG signal-based music treatment system for autistic children using edge computing devices. Wireless Netw (2024). https://doi.org/10.1007/s11276-024-03826-x

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11276-024-03826-x

Keywords

Search

Navigation