Advertisement

SMCS: Mobile Model Oriented to Cloud for the Automatic Classification of Environmental Sounds

  • María José Mora-Regalado
  • Omar Ruiz-VivancoEmail author
  • Alexandra Gonzalez-Eras
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1066)

Abstract

This paper presents SMCS, a cloud-oriented mobile system model that uses a Convolutional Neural Network for the automatic classification of environmental sounds in real time. The model comprises an architectural schema with its corresponding deployment scheme in Google cloud services provider. Finally, the validation protocol of SMCS is applied in two experiments using respectively the base of free sounds FSDkaggle2018 and a selection of warning sounds extracted from the same sound base. The results of the validation of the model are promising with high values of precision in the classification of sounds, demonstrating that the SMCS model is expected to be a point of reference for the development of sound analysis systems, contributing to improving the quality of life of people with Hearing Impairment.

Keywords

Hearing impairment Cloud Computing Mobile system Convolutional neural network FSDkaggle2018 

References

  1. 1.
    Vejarano, R., Alain, L.: Alternativas tecnológicas para mejorar la comunicación de personas con discapacidad auditiva en la educación superior panameña. Rev. Educ. la Univ. Granada 23, 219–235 (2016)Google Scholar
  2. 2.
    Noor, T.H., Zeadally, S., Alfazi, A., Sheng, Q.Z.: Mobile cloud computing: Challenges and future research directions. J. Netw. Comput. Appl. 115, 70–85 (2018).  https://doi.org/10.1016/j.jnca.2018.04.018CrossRefGoogle Scholar
  3. 3.
    Nanjundaswamy, M., Prabhu, P., Rajanna, R.K., et al.: Computer-based auditory training programs for children with HEARING impairment – a scoping review. Int. Arch. Otorhinolaryngol. 22, 88–93 (2018).  https://doi.org/10.1055/s-0037-1602797CrossRefGoogle Scholar
  4. 4.
    Lay, Y.-L., Tsai, C.-H., Yang, H.-J., et al.: The application of extension neuro-network on computer-assisted lip-reading recognition for hearing impaired. Expert Syst. Appl. 34, 1465–1473 (2008).  https://doi.org/10.1016/j.eswa.2007.01.042CrossRefGoogle Scholar
  5. 5.
    Chen, L., Tsai, C., Chang, W., et al.: A real-time mobile emergency assistance system for helping deaf-mute people/elderly singletons. In: 2016 IEEE International Conference on Consumer Electronics (ICCE), pp 45–46 (2016)Google Scholar
  6. 6.
    Jiang, J., Bu, L., Duan, F., et al.: Whistle detection and classification for whales based on convolutional neural networks. Appl. Acoust. 150, 169–178 (2019).  https://doi.org/10.1016/j.apacoust.2019.02.007CrossRefGoogle Scholar
  7. 7.
    Bardou, D., Zhang, K., Ahmad, S.M.: Lung sounds classification using convolutional neural networks. Artif. Intell. Med. 88, 58–69 (2018).  https://doi.org/10.1016/j.artmed.2018.04.008CrossRefGoogle Scholar
  8. 8.
    Lim, S.J., Jang, S.J., Lim, J.Y., Ko, J.H.: Classification of snoring sound based on a recurrent neural network. Expert Syst. Appl. 123, 237–245 (2019).  https://doi.org/10.1016/j.eswa.2019.01.020CrossRefGoogle Scholar
  9. 9.
    Jeong, I.-Y., Lim, H.: Audio tagging system for DCASE 2018: focusing on label noise, data augmentation, and its efficient learning (2018)Google Scholar
  10. 10.
    Dorfer, M., Widmer, G.: Grating general -purpose audio tagging networks with noisy labels and interactive self-verification (2018)Google Scholar
  11. 11.
    Kaggle, F.: General-Purpose Audio Tagging ChallengeGoogle Scholar
  12. 12.
    IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events. http://dcase.community/challenge2018/
  13. 13.
    Shen, G., Nguyen, Q., Choi, J.: An environmental sound source classification system based on mel-frequency cepstral coefficients and gaussian mixture models. IFAC Proc. Vol. 45, 1802–1807 (2012).  https://doi.org/10.3182/20120523-3-RO-2023.00251CrossRefGoogle Scholar
  14. 14.
    Fonseca, E., Plakal, M., Font, F., et al: General-purpose Tagging of Freesound Audio with AudioSet Labels: Task Description, Dataset, and Baseline (2018)Google Scholar
  15. 15.
    Ozer, I., Ozer, Z., Findik, O.: Noise robust sound event classification with the convolutional neural network. Neurocomputing 272, 505–512 (2018).  https://doi.org/10.1016/j.neucom.2017.07.021CrossRefGoogle Scholar
  16. 16.
    Piczak, K.J.: Environmental sound classification with convolutional neural networks. In: 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6 (2015)Google Scholar
  17. 17.
    Peréz Peréz, E.: Diseño de una metodología para el procesamiento de imágenes mamográficas basada en técnicas de aprendizaje profundo. Universidad Politécnica de Madrid (2017)Google Scholar
  18. 18.
    Picazo Montoya, Ó.: Redes Neuronales Convolucionales Profundas para el reconocimiento de emociones en imágenes. Universidad Politécnica de Madrid (2018)Google Scholar
  19. 19.
  20. 20.
    Developer A AVAudioRecorderGoogle Scholar
  21. 21.
    Howard, A.G., Zhu, M., Chen, B., et al.: MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR abs/1704.0 (2017)Google Scholar
  22. 22.
  23. 23.
    Marozzo, F.: Infrastructures for High-Performance Computing: Cloud Infrastructures. In: Ranganathan, S., Gribskov, M., Nakai, K., Schönbach, C. (eds.) Encyclopedia of Bioinformatics and Computational Biology, pp. 240–246. Academic Press, Oxford (2019)CrossRefGoogle Scholar
  24. 24.
    Wasserman, T. Software engineering issues for mobile application development. In: FoSER (2010)Google Scholar
  25. 25.
    Łopatka, K., Zwan, P., Czyżewski, A.: Dangerous sound event recognition using support vector machine classifiers. In: Advances in Intelligent and Soft Computing, pp. 49–57 (2010)Google Scholar
  26. 26.
    Almaadeed, N., Asim, M., Al-Maadeed, S., Bouridane, A., Beghdadi, A.: Automatic detection and classification of audio events for road surveillance applications. Sensors 18(6), 1858 (2018)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Universidad Técnica Particular de LojaLojaEcuador

Personalised recommendations