A Low Cost Intelligent Smart System for Real Time Child Monitoring in the School

  • Pruthvi Raj MyakalaEmail author
  • Rajasree Nalumachu
  • V. K. Mittal
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 678)


Speech processing techniques help improving real-time communication between human to human, human and machine, machine to machine. If these techniques are used integrated with robots, then their physical flexibility and wider reach can enable a wide range of real-time applications. In this paper, we propose an ‘Intelligent Cry Detection Robotic System’ (ICDRS) for real-monitoring of child-beating in classrooms, in order to facilitate prevention of child-abuse prevalent in this form. The proposed system has two major modules: the ‘Cry-Detection System’ (CDS) and a ‘Smart Robotic System’ (SRS) equipped with audio-visual sensors. The CDS unit present in the classroom, consist of three parts. First, the cry-recording unit (CRU) records the audio signals and sends to ‘Signal Processing Unit’ (SPU). Then SPU applies signal processing techniques, and intelligently detects the cry events using the features extracted from the acoustic signal. If the system detects a cry, then it further sends the control commands to the ‘Signal Transmission Unit’ (STU), which sends an automatic SMS to the Vice-Principal or Supervisor-Teacher, i.e., the person-in-charge, thereby alerting him/her about the child cry in a particular classroom. The controlling person can give control-commands to the SRS from a web-application and can get the live-stream of the video from the classroom. A Wi-Fi module acts to facilitate the communication between this controller and the Robot (SRS). The initial performance evaluation results are very much encouraging. The proposed system can have potential applications in the schools, hospitals and child care centers etc. Hopefully, this prototype can be a useful step towards preventing child-abuse, prevalent in different forms in our society.


Cry detection robot Energy Cry signal Cry analysis WiFi controlled Remote control operation 


  1. 1.
    Asthana, S., Varma, N., Mittal, V.K.: An investigation into classification of infant cries using modified signal processing methods. In: 2nd International Conference on Signal Processing and Integrated Networks (SPIN), February 2015, pp. 679-684 (2015)Google Scholar
  2. 2.
    Rabiner, L.: On the use of auto-correlation analysis for pitch detection. IEEE Trans. Acoust. Speech Sig. Process. 25, 24–33 (1977)CrossRefGoogle Scholar
  3. 3.
    Oppenheim, A.V., Schafer, R.W., Buck, J.R.: Discrete Time Signal Processing. Prentice-Hall, Englewood Cliffs (1989)zbMATHGoogle Scholar
  4. 4.
    Mittal, V.K., Yegnanarayana, B.: Study of characteristics of aperiodicity in Noh voices. J. Acoust. Soc. Am. (JASA) 137(6), 3411–3421 (2012)CrossRefGoogle Scholar
  5. 5.
    Titze, I.R., Story, B.H.: Acoustic interactions of the voice source with the lower vocal tract. J. Acoust. Soc. Am. (JASA) 101, 2234–2243 (1997)CrossRefGoogle Scholar
  6. 6.
    Asthana, S., Varma, N., Mittal, V.K.: Preliminary analysis of causes of infant cry. In: IEEE International Symposium on Signal Processing and Information Technology, ISSPIT, 15–17 December 2014, pp. 468–473 (2014)Google Scholar
  7. 7.
    Kumar, K., Nandan, S., Mishra, A., Kumar, K., Mittal, V.K.: Voice-controlled object tracking smart robot. In: Proceedings of IEEE 3rd International Conference on Signal Processing, Computing and Control 2015 (ISPCC 2015), JUIT, Waknaghat, India (2015)Google Scholar
  8. 8.
    Sharma, S., Asthana, S., Mittal, V.K.: A database of infant cry sounds to study the likely cause of cry. In: 12th International Conference on Natural Language Processing (ICON 2015), IIITM-K, Trivandrum, India (2015)Google Scholar
  9. 9.
    Ryu, D., Kang, S., Kim, M., Song, J.-B.: Multi-modal user interface for teleoperation of ROBHAZ-DT2 field robot system. In: 2004 Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS 2004), vol. 1, pp. 168–173. IEEE (2004)Google Scholar
  10. 10.
    Raj, P., Rajasree, N., Jayasri, T., Mittal, Y., Mittal, V.K.: A Web Based Intelligent Spybot. In: Proceedings of IEEE 3rd International Mining Intelligence and Knowledge Exploration (MIKE 2015), vol. 9648, pp. 472–481. IIIT Hyderabad, December 2015Google Scholar
  11. 11.
    Mittal, V.K.: Discriminating the infant cry sounds due to pain vs. discomfort towards assisted clinical diagnosis. In: 7th Workshop on Speech and Language Processing for Assistive Technologies, SLPAT 2016, San Francisco, USA, 13 September 2016, pp. 37–42 (2016)Google Scholar
  12. 12.
    MATLAB Simulink Projects. Last Viewed 1 June 2017
  13. 13.
    Mittal, V.K.: Discriminating features of infant cry acoustic signal towards automated diagnosis of cause of crying. In: 10th International Symposium on Chinese Spoken Language Processing (ISCSLP 2016), Tianjin, 17–20 October 2016Google Scholar
  14. 14.
    Morshed, N.M., Muid-Ur-Rahman, G.M., Karim, M.R., Zaman, H.U.: Microcontroller based home automation system using Bluetooth, GSM, Wi-Fi and DTMF. In: International Conference on Advances in Electrical Engineering (ICAEE) (2009)Google Scholar
  15. 15.
    Narvaez, L., Llanes, E., Hernandez, C., Poot, R., Chi, V.: Design and implementation of a system for wireless control of a robot. Int. J. Comput. Sci. Issues 7, 191–197 (2010)Google Scholar
  16. 16.
    Dayma, D., Chavan, B., Kale, S., Tarle, B.S.: Smart Spy Robot. Int. J. Sci. Technol. Manage. 04(02), 93–95 (2015)Google Scholar
  17. 17.
    Narvaez, L., Lanes, E., Hermandez, C., Poot, R., Chi, V.: Design and implementation of a system for wireless control of a robot. Int. J. Comput. Sci. Issues 7, 191–197 (2010)Google Scholar
  18. 18.
    Makula, P., Mishra, A., Kumar, A., Karan, K., Mittal, V.K.: Voice-controlled object tracking smart robot. In: Proceedings of IEEE 3rd International Conference on Electronics, Computing and Communication Technologies (CONNECT 2015). IIIT Bangalore, India, 10–11 July 2015Google Scholar
  19. 19.
    Patoliya, J., Mehta, H., Patel, H.: Arduino controlled war feild spy robot using night vision wireless camera and android application. In: 5th Nirma University International Conference on Engineering (NUiCONE), pp. 1–5Google Scholar
  20. 20.
    Vaishnav, P., Tiwari, S.: Accelerometer based hand gesture controlled robot. Int. J. Sci. Res. (IJSR) 4(3), 223–226 (2015)Google Scholar
  21. 21.
    Balakrishnan, M.: A smart Spy robot charged and controlled by wireless systems. In: IEEE Sponsored 2nd International Conference on Innovations in Information Embedded and Communication Systems, ICIIECS 2015, Coimbatore, 19 March 2015Google Scholar
  22. 22.
    Maheshwari, T., Kumar, U., Nagpal, C., Ojha, C., Mittal, V.K.: Capturing the spied image-video data using a FlexiControlled Spy-robot. In: 2015 Third International Conference on Image Information Processing, pp. 330–335, December 2015Google Scholar
  23. 23.
    Benefits of Robots - RoboWorx . Last Viewed 15 May 2017
  24. 24.
    Mittal, Y., Toshniwal, P., Sharma, S., Singhal, D., Gupta, R., Mittal, V.K.: A voice-controlled multi-functional smart home automation system. In: Proceedings of IEEE 12th International INDICON Conference, Jamia Millia Islamia, New Delhi, India (2015)Google Scholar
  25. 25.
    Jain, P., Firke, P.N., Patil, T.S., Rode, S.S., Kapadnis, K.N., Kapadnis, K.N., et al.: RF based Spy robot. Int. J. Eng. Res. Appl. 4(4), 06–09 (2014). (Version 2)Google Scholar
  26. 26.
    Lavner, Y., Cohen, R., Ruinskiy, D., Ijzerman, H.: Baby cry detection in domestic environment using deep learning. In: 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE), pp. 1–5, November 2016Google Scholar
  27. 27.
    Skogsdal, Y., Eriksson, M., Schollin, J.: Analgesia in newborns given oral glucose. Acta Paediatrica 86(2), 217–220 (1997). CrossRefGoogle Scholar
  28. 28.
    Mittal, V.K., Yegnanarayana, B.: Analysis of production characteristics of laughter. Comput. Speech Lang. 30(1), 99–115 (2015)CrossRefGoogle Scholar
  29. 29.
    Mittal, V.K., Yegnanarayana, B.: Effect of glottal dynamics in the production of shouted speech. J. Acoust. Soc. Am. 133(5), 3050–3061 (2013)CrossRefGoogle Scholar
  30. 30.
    Petroni, M., Malowany, M., Johnston, C., Stevens, B.: A new, robust vocal fundamental frequency (F0) determination method for the analysis of infant cries. In: 1994 Proceedings of IEEE Seventh Symposium on Computer-Based Medical Systems, pp. 223–228 (1994)Google Scholar
  31. 31.
    Chandralingam, S., Anjaneyulu, T., Satyanarayana, K.: Estimation of fundamental and formant frequencies of infants cries; a study of infants with congenital heart disorder. Indian J. Comput. Sci. Eng. 3(4), 574–582 (2012)Google Scholar
  32. 32.
    Daga, R.P., Panditrao, A.M.: Acoustical analysis of pain cries in neonates: fundamental frequency. IJCA Spec. Issue Electron., Inf. Commun. Eng. ICEICE 3, 18–21 (2011)Google Scholar
  33. 33.
    Mima, Y., Arakawa, K.: Cause estimation of younger babies’ cries from the frequency analyses of the voice - classification of hunger, sleepiness, and discomfort. In: 2006 International Symposium on Intelligent Signal Processing and Communications, ISPACS 2006, pp. 29–32, December 2006Google Scholar
  34. 34.
    Neustein, A. (ed.): Advances in Speech Recognition: Mobile Environments, Call Centers and Clinics. Springer, New York (2010)Google Scholar
  35. 35.
    Cohen, R., Lavner, Y.: Infant cry analysis and detection. In: IEEE 27th Convention of Electrical & Electronics Engineers in Israel (IEEEI 2012), pp. 1–5. IEEE (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Pruthvi Raj Myakala
    • 1
    Email author
  • Rajasree Nalumachu
    • 1
  • V. K. Mittal
    • 2
  1. 1.Indian Institute of Information Technology ChittoorSri CityIndia
  2. 2.Ritwik Software Technologies Pvt. Ltd.HyderabadIndia

Personalised recommendations