Mobile Networks and Applications

, Volume 21, Issue 5, pp 753–763

Audio-Visual Emotion Recognition Using Big Data Towards 5G

  • M. Shamim Hossain
  • Ghulam Muhammad
  • Mohammed F. Alhamid
  • Biao Song
  • Khaled Al-Mutib
Article

DOI: 10.1007/s11036-016-0685-9

Cite this article as:
Hossain, M.S., Muhammad, G., Alhamid, M.F. et al. Mobile Netw Appl (2016) 21: 753. doi:10.1007/s11036-016-0685-9

Abstract

With the advent of future generation mobile communication technologies (5G), there is the potential to allow mobile users to have access to big data processing over different clouds and networks. The increasing numbers of mobile users come with additional expectations for personalized services (e.g., social networking, smart home, health monitoring) at any time, from anywhere, and through any means of connectivity. Because of the expected massive amount of complex data generated by such services and networks from heterogeneous multiple sources, an infrastructure is required to recognize a user’s sentiments (e.g., emotion) and behavioral patterns to provide a high quality mobile user experience. To this end, this paper proposes an infrastructure that combines the potential of emotion-aware big data and cloud technology towards 5G. With this proposed infrastructure, a bimodal system of big data emotion recognition is proposed, where the modalities consist of speech and face video. Experimental results show that the proposed approach achieves 83.10 % emotion recognition accuracy using bimodal inputs. To show the suitability and validity of the proposed approach, Hadoop-based distributed processing is used to speed up the processing for heterogeneous mobile clients.

Keywords

Emotion recognition Weber local descriptor Big data 5G 

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • M. Shamim Hossain
    • 1
  • Ghulam Muhammad
    • 2
  • Mohammed F. Alhamid
    • 1
  • Biao Song
    • 3
  • Khaled Al-Mutib
    • 1
  1. 1.Software Engineering Department, College of Computer and Information Sciences (CCIS)King Saud UniversityRiyadhKingdom of Saudi Arabia
  2. 2.Computer Engineering Department, College of Computer and Information Sciences (CCIS)King Saud UniversityRiyadhKingdom of Saudi Arabia
  3. 3.Information System Department, College of Computer and Information Sciences (CCIS)King Saud UniversityRiyadhKingdom of Saudi Arabia

Personalised recommendations