Skip to main content
SpringerLink
Log in

Premature Infant Cry Classification via Deep Convolutional Recurrent Neural Network Based on Multi-class Features

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

The cry of a premature infant is an attempt to connect with its mother or others. The newborns are communicated in different ways depending on the reason for their screams. In recent days, the preprocessing, feature extraction, and classification of audio signals require expert attention and a lot of effort. In this paper, a novel deep convolutional recurrent neural network (DCR net) has been proposed to classify the premature infant cry signal into different categories. The acquisition of the cry signal generally requires a lengthy observation period and several activity processes to obtain all the signals of the premature infant. The relevant multi-class frequency features are extracted by using the MFCC (Mel-frequency cepstral coefficient), BFCC (Bark-frequency cepstral coefficient), and LPCC (linear prediction cepstral coefficient) features, which are combined to create a fused feature matrix that is helpful in the classification of pathological crying. Based on these features, the DCR net is used to classify sounds in the premature infant cry. The sound of the target cry signal is classified into five categories: “neh” means hunger, “heh” means discomfort, “eh” means burping, “eair” means cramps, and “owh” means fatigue. The efficiency of the DCR net was estimated with some metrics such as specificity, precision, accuracy, recall, and F1 score. The experimental fallouts disclose that the proposed DCR net attains a better classification accuracy of 97.27% for identifying infant cry signals. The DCR net increases the overall performance range by 8.61%, 11.58%, 0.54%, and 17.03% better than SVM-RBF, MFCC-SVM, optimized deep learning model, and hidden Markov model, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data Availability

In this study, no new data are collected or examined for analysis, so this article does not meet the definition of data sharing.

References

  1. K. Ashwini, D.R.V. PM, K. Srinivasan, C.Y. Chang, Deep convolutional neural network-based feature extraction with optimized machine learning classifier in infant cry classification, in 2020 International Conference on Decision Aid Sciences and Application (IEEE, 2020), pp. 27–32

  2. K. Ashwini, P.D.R. Vincent, A deep convolutional neural network-based approach for effective premature infant cry classification. Recent Adv. Comput. Sci. Commun. 15(2), 229–239 (2022)

    Article  Google Scholar 

  3. C.Y. Chang, S. Bhattacharya, P.M.R. Vincent, K. Lakshmanna, K. Srinivasan, An efficient classification of neonates cry using extreme gradient boosting-assisted grouped-support-vector network. J. Healthc. Eng. (2021). https://doi.org/10.1155/2021/7517313

    Article  Google Scholar 

  4. R. Cohen, D. Ruinskiy, J. Zickfeld, H. IJzerman, Y. Lavner, Baby cry detection: deep learning and classical approaches, in Development and Analysis of Deep Learning Architectures (2020), pp. 171–196

  5. S.P. Dewi, A.L. Prasasti, B. Irawan, The study of baby crying analysis using MFCC and LFCC in different classification methods, in 2019 IEEE International Conference on Signals and Systems (ICSigSys) (IEEE, 2019), pp. 18–23

  6. A.A. Dixit, N.V. Dharwadkar, A Survey on detection of reasons behind infant cry using speech processing, in 2018 International Conference on Communication and Signal Processing (IEEE, pp. 90–194) (2018)

  7. D. Ferretti, M. Severini, E. Principi, A. Cenci, S. Squartini, Infant cry detection in adverse acoustic environments by using deep neural networks, in 2018 26th European Signal Processing Conference (IEEE, 2018), pp. 992–996

  8. C. Ji, T.B. Mudiyanselage, Y. Gao, Y. Pan, A review of infant cry analysis and classification. EURASIP J Audio Speech Music Process. 2021(1), 1–17 (2021)

    Article  Google Scholar 

  9. C. Ji, X. Xiao, S. Basodi, Y. Pan, Deep learning for asphyxiated infant cry classification based on acoustic features and weighted prosodic features, in 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) IEEE (2019), pp. 1233–1240

  10. S. Jindal, K. Nathwani, V. Abrol, Classification of infant behavioural traits using acoustic cry: an empirical study, in 2021 12th International Symposium on Image and Signal Processing and Analysis (ISPA) IEEE (2021), pp. 97–102

  11. Y. Kheddache, C. Tadj, Identification of diseases in newborns using advanced acoustic features of cry signals. Biomed. Signal Process. Control 50, 35–44 (2019)

    Article  Google Scholar 

  12. S. Lahmiri, C. Tadj, C. Gargour, S. Bekiros, Deep learning systems for automatic diagnosis of infant cry signals. Chaos Solitons Fractals. 154, 111700 (2022)

    Article  Google Scholar 

  13. L. Le, A.N.M. Kabir, C. Ji, S. Basodi, Y. Pan, Using transfer learning, SVM, and ensemble classification to classify baby cries based on their spectrogram images, in 2019 IEEE 16th International Conference on Mobile Ad Hoc and Sensor Systems Workshops IEEE (2019), pp. 106–110

  14. L. Liu, Y. Li, K. Kuo, Infant cry signal detection, pattern extraction and recognition, in 2018 International Conference on Information and Computer Technologies IEEE (2018), pp. 159–163

  15. T.N. Maghfira, T. Basaruddin, A. Krisnadhi, Infant cry classification using CNN–RNN, in Journal of Physics: Conference Series, vol 1528 (2020), p. 012019

  16. C. Manfredi, A. Bandini, D. Melino, R. Viellevoye, M. Kalenga, S. Orlandi, Automated detection and classification of basic shapes of newborn cry melody. Biomed. Signal Process. Control 45, 174–181 (2018)

    Article  Google Scholar 

  17. F.S. Matikolaie, C. Tadj, Machine learning-based cry diagnostic system for identifying septic newborns. J. Voices (2022). https://doi.org/10.1016/j.jvoice.2021.12.021

    Article  Google Scholar 

  18. F.S. Matikolaie, C. Tadj, On the use of long-term features in a newborn cry diagnostic system. Biomed. Signal Process. Control 59, 101889 (2020)

    Article  Google Scholar 

  19. G. Naithani, J. Kivinummi, T. Virtanen, O. Tammela, M.J. Peltola, J.M. Leppänen, Automatic segmentation of infant cry signals using Gaussian Mixture Models. EURASIP J. Audio Speech Music Process. 1, 1–14 (2018)

    Article  Google Scholar 

  20. C. Pan, W. Zhao, S. Deng, W. Wei, Y. Zhang, Y. Xu, The methods of realizing baby crying recognition and intelligent monitoring based on DNN-GMM-HMM, in 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference IEEE (2018), pp. 352–356

  21. D. Panigrahy, P.K. Sahu, F. Albu, Detection of ventricular fibrillation rhythm by using boosted support vector machine with an optimal variable combination. Comput. Electr. Eng. 91, 107035 (2021)

    Article  Google Scholar 

  22. M. Severini, D. Ferretti, E. Principi, S. Squartini, Automatic detection of cry sounds in premature infant intensive care units by using deep learning and acoustic scene simulation. IEEE Access 7, 51982–51993 (2019)

    Article  Google Scholar 

  23. K. Sharma, C. Gupta, S. Gupta, Infant weeping calls decoder using statistical feature extraction and gaussian mixture models, in 2019 10th International Conference on Computing, J. Commun. Netw. pp. 1–6 (2019)

  24. V. Vaishnavi, P.S. Dhanaselvam, Premature infant cry signal prediction and classification via dense convolution neural network. J. Intell. Fuzzy Syst. 1–14. (2022)

  25. P.D.R. Vincent, K. Srinivasan, C.Y. Chang, Deep learning assisted premature infant cry classification via support vector machine models. Public Health Front. 9, 670352 (2021)

    Article  Google Scholar 

Download references

Acknowledgements

The authors greatly thank the reviewers for all of their careful, constructive and insightful comments in accordance with this research.

Funding

There is no financial support for this research.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, SNS College of Technology, Coimbatore, Tamil Nadu, India

    R. Sabitha, P. Poonkodi, M. S. Kavitha & S. Karthik

Authors
  1. R. Sabitha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. Poonkodi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. S. Kavitha
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Karthik
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The authors confirm contribution to the paper as follows: Study conception and design were done by Dr. RS and Dr. MSK; PP, Dr. SK collected the data; P. Poonkodi, Dr. M. S. Kavitha done analysis and interpretation of results; Dr. RS, Dr. SK drafted the manuscript preparation. All authors reviewed the results and approved the final version of the manuscript.

Corresponding author

Correspondence to P. Poonkodi.

Ethics declarations

Competing interests

The publication of this paper does not involve any conflict of interest.

Ethical Approval

In accordance with ethical guidelines, my research advisor has approved this paper for publication in this journal.

Human and Animal Rghts

All of the authors in this article did not use human or animal subjects for their studies.

Informed Consent

I confirm that I have clarified with the aforementioned person the scope and aim of the research and the potential advantages of participating. All inquiries regarding this study have been answered, and we are always available to answer additional inquiries.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sabitha, R., Poonkodi, P., Kavitha, M.S. et al. Premature Infant Cry Classification via Deep Convolutional Recurrent Neural Network Based on Multi-class Features. Circuits Syst Signal Process 42, 7529–7548 (2023). https://doi.org/10.1007/s00034-023-02457-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-023-02457-5

Keywords

Search

Navigation