Skip to main content

Advertisement

SpringerLink
Log in

Developing computerized speech therapy system using metaheuristic optimized artificial cuckoo immune system

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Robotics are effectively utilized in the field of speech therapy because, most of the people affected by the apraxia speech problem which is one of the neurological disorder. This disorder occurred due to the Alzheimer disease, stroke that affects the movement of mouth severely. These neurological disease affected people requires more attention while training the speech therapy. Traditional approaches are fail to manage the accuracy while making training also consumes more time to get result. So, in this paper introduces the metaheuristic optimized algorithm called artificial cuckoo immune system method to examine the mouth posterior which helps to provide the speech therapy with the help of robotics. This process helps to perform therapy session in both partial as well as automatic manner. The efficiency of robotic speech therapy process is analyzed using MATLAB based experimental process. During this process introduced system ensures 96.8% of accuracy, 97.1% of precision value, 96.9% of recall value and 98.2% of F1-score value.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://www.robotixlab.in/.

References

  1. Josephs, K.A., Duffy, J.R.: Apraxia of speech and nonfluent aphasia: a new clinical marker for corticobasal degeneration and progressive supranuclear palsy. Curr. Opin. Neurol. 21(6), 688–692 (2008). https://doi.org/10.1097/WCO.0b013e3283168ddd

    Article  Google Scholar 

  2. Wambaugh, J.L., Nessler, C., Cameron, R., Mauszycki, S.C.: Acquired apraxia of speech: the effects of repeated practice and rate/rhythm control treatments on sound production accuracy. Am. J. Speech Lang. Pathol. 21(2), S5–27 (2012). https://doi.org/10.1044/1058-0360(2011/11-0102)

    Article  Google Scholar 

  3. Terband, H., Maassen, B., Guenther, F.H., Brumberg, J.: Computational neural modeling of speech motor control in childhood apraxia of speech (CAS). J. Speech Lang. Hear. Res. 52, 1595–1609 (2009)

    Article  Google Scholar 

  4. Terband, H., Maassen, B., Guenther, F.H., Brumberg, J.: Auditory-motor interactions in pediatric motor speech disorders: neurocomputational modeling of disordered development. J. Commun. Disord. (2014). https://doi.org/10.1016/j.jcomdis.2014.01.001

    Article  Google Scholar 

  5. Alonso-Martín, F., Castro-González, A., Gorostiza, J.F., Salichs, M.A.: Augmented robotics dialog system for enhancing human–robot interaction. Sensors 15(12), 15799–15829 (2015)

    Article  Google Scholar 

  6. Rodríguez Dueñas, W.R., Vaquero, C., Saz, O., Lleida, E.: Speech technology applied to children with speech disorders. In: AbuOsman, N.A., Ibrahim, F., WanAbas, W.A.B., AbdulRahman, H.S., Ting, H.N. (eds.) 4th Kuala Lumpur International Conference on Biomedical Engineering 2008. IFMBE Proceedings, 21st edn. Springer, Berlin (2008)

    Google Scholar 

  7. American Speech-Language-Hearing Association: Apraxia of speech in adults. https://www.asha.org/public/speech/disorders/ApraxiaAdults/ (2017)

  8. Ricci, M., Magarelli, M., Todino, V., Bianchini, A., Calandriello, E., Tramutoli, R.: Progressive apraxia of speech presenting as isolated disorder of speech articulation and prosody: a case report. Neurocase 14(2), 162–168 (2008)

    Article  Google Scholar 

  9. van der Merwe, A.: Self-correction in apraxia of speech: the effect of treatment. Aphasiology 21(6–8), 658–669 (2007). https://doi.org/10.1080/02687030701192174

    Article  Google Scholar 

  10. Kalal, Z., Mikolajczyk, K., Matas, J.: Face-tld: trackinglearning-detection applied to faces. In: 2010 IEEE International Conference on Image Processing, pp. 3789–3792, Hong Kong, China (2010)

  11. Morgan, A.T., Vogel, A.P.: A Cochrane review of treatment for childhood apraxia of speech. Eur. J. Phys. Rehabil. Med. 45(1), 103–110 (2009)

    Google Scholar 

  12. Castillo, J.C., Encinar, I.P., Conti-Morera, A., González, Á.C., Salichs, M.Á.: Vowel recognition from RGB-D facial information. In: Ambient Intelligence-Software and Applications: 7th International Symposium on Ambient Intelligence (ISAmI 2016), Advances in Intelligent Systems and Computing, pp. 225–232, Springer, Cham (2016)

  13. Bartlett, M.S., Littlewort, G., Frank, M., Lainscsek, C., Fasel, I., Movellan, J.: Recognizing facial expression: machine learning and application to spontaneous behavior. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), pp. 568–573, SanDiego (2005)

  14. Castillo, J.C., Álvarez-Fernández, D., Alonso-Martín, F., Marques-Villarroya, S., Salichs, M.A.: Social robotics in therapy of apraxia of speech. J. Healthc. Eng. (2018). https://doi.org/10.1155/2018/7075290

    Article  Google Scholar 

  15. Joshi, N., Kumar, A., Chakraborty, P., Kala, R.: Speech controlled robotics using Artificial Neural Network. In: Third International Conference on Image Information Processing (ICIIP) in IEEE (2015)

  16. Yamada, T., Murata, S., Arie, H., Ogatal, T.: Dynamical integration of language and behavior in a recurrent neural network for human–robot interaction. Front. Neurorobot. (2016). https://doi.org/10.3389/fnbot.2016.00005

    Article  Google Scholar 

  17. Galbraith, B.V., Guenther, F.H., Versace, M.: A neural network-based exploratory learning and motor planning system for co-robots. Front Neurorobot. 9, 7 (2015). https://doi.org/10.3389/fnbot.2015.00007

    Article  Google Scholar 

  18. Świetlicka, I., Kuniszyk-Jóźkowiak, W., Smołka, E.: Artificial neural networks in the disabled speech analysis. In: Kurzynski, M., Wozniak, M. (eds.) Computer Recognition Systems Advances in Intelligent and Soft Computing, 57th edn. Springer, Berlin (2009)

    Google Scholar 

  19. Wada, K., Ikeda, Y., Inoue, K., Uehara, R.: Development and preliminary evaluation of a caregiver’s manual for robot therapy using the therapeutic seal robot PARO. In: 19th International Symposiumin Robot and Human Interactive Communication, pp. 533–538, Viareggio, Italy (2010)

  20. Clark, E., Hone, A., Timmis, J.: A Markov chain model of the B-cell algorithm. In: Artificial Immune Systems, vol. 3627 of Lecture Notes in Computer Science, pp. 318–330, Springer, Berlin (2005)

  21. Li, Z.H., He, C.H.: The AIS-HSL optimization: an artificial immune system with heuristic social learning. In: Proceedings of the 2012 IET International Conference on Information Science and Control Engineering, pp. 306–310, Institution of Engineering and Technology, Shenzhen, China (2012)

  22. Li, Z., Zhang, Y., Tan, H.-Z.: IA-AIS: an improved adaptive artificial immune system applied to complex optimization problems. Appl. Soft Comput. 11(8), 4692–4700 (2011)

    Article  Google Scholar 

  23. Coelho, G.P., von Zuben, F.J.: A concentration-based artificial immune network for continuous optimization. In: Proceedings of IEEE Congress on Evolutionary Computation, pp. 1–8, Barcelona, Spain (2010).

  24. Madhav, K.: OpenNI Standard Launched (2010). kinecthacks.net. Accessed 5 Jan 2011.

  25. Feng, G., Ma, L., Tan, X.: Visual map construction using RGB-D sensors for image-based localization in indoor environments. J. Sens. (2017). https://doi.org/10.1155/2017/8037607

    Article  Google Scholar 

  26. Milborrow, S., Nicolls, F.: Active shape models with SIFT descriptorsand MARS. In: Proceedings of the 9th International Conference on Computer Vision Theory and Applications, pp. 380–387, Lisbon, Portugal (2014).

  27. Jin, J., Li, M., Jin, L.: Data normalization to accelerate training for linear neural net to predict tropical cyclone tracks. Math. Probl. Eng. (2015). https://doi.org/10.1155/2015/931629

    Article  Google Scholar 

  28. Lima, F.P.A., Lopes, M.L.M., Lotufo, A.D.P., Minussi, C.R.: An artificial immune system with continuous-learning for voltage disturbance diagnosis in electrical distribution systems. Expert Syst. Appl. 56, 131–142 (2016)

    Article  Google Scholar 

  29. Pan, H.P., Wang, W.H., Gao, J.F.: Study on a variable arguments PID controller based on improved artificial immune algorithm. In: Proceedings of the 30th Chinese Control Conference, pp. 3752–3755, Yantai, China (2011).

  30. Wang, M., Feng, S., Ouyang, C., Li, Z.: RFID tag oriented data allocation method using artificial immune network. In Proceedings of the 27th Chinese Control and Decision Conference (CCDC'15), pp. 5218–5223, IEEE, Qingdao, China (2015)

  31. Freitas, A.A., Timmis, J.: Revisiting the foundations of artificial immune systems for data mining. IEEE Trans. Evol. Comput. 11(4), 521–540 (2007)

    Article  Google Scholar 

  32. Dasgupta, D., Yu, S., Nino, F.: Recent advances in artificial immune systems: models and applications. Appl. Soft Comput. J. 11(2), 1574–1587 (2011)

    Article  Google Scholar 

  33. Yang, X.S., Deb, S., Mishra, S.K.: Multi-species cuckoo search algorithm for global optimization. Cogn. Comput. 10, 1085 (2018). https://doi.org/10.1007/s12559-018-9579-4

    Article  Google Scholar 

  34. Madni, S.H.H., Latiff, M.S.A., Ali, J., et al.: Multi-objective-oriented cuckoo search optimization-based resource scheduling algorithm for clouds. Arab. J. Sci. Eng. 44, 3585 (2019). https://doi.org/10.1007/s13369-018-3602-7

    Article  Google Scholar 

  35. Fernández-Caballero, A., Martínez-Rodrigo, A., Pastor, J.M., et al.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inf. 64(2), 55–73 (2016)

    Article  Google Scholar 

  36. Salichs, E., Castro-Gonzáalez, A., Malfaz, M., Salichs, M.: Mini: a social assistive robot for people with mild cognitive impairment. In: New Friends 2016. The 2nd International Conference on Social Robots in Therapy and Education, pp. 29–30, Barcelona/Spain (2016)

  37. Manogaran, G., Shakeel, P.M., Hassanein, A.S., Priyan, M.K., Gokulnath, C.: Machine-learning approach based gamma distribution for brain abnormalities detection and data sample imbalance analysis. IEEE Access. (2018). https://doi.org/10.1109/ACCESS.2018.2878276

    Article  Google Scholar 

  38. Kanan, H.R., Faez, K., Taheri, S.M.: Feature selection using ant colony optimization (ACO): a new method and comparative study in the application of face recognition system. In: Perner, P. (ed.) Advances in Data Mining Theoretical Aspects and Applications. ICDM 2007. Lecture Notes in Computer Science, 4597th edn. Springer, Berlin (2007)

    Google Scholar 

Download references

Acknowledgements

The authors extend their appreciation to the Deanship of Scientific Research at King Saud University for funding this work through Research Group No. RG-1441-354”.

Author information

Authors and Affiliations

  1. Computer Science Department, Community College, King Saud University, Riyadh, Saudi Arabia

    Ayed Alwadain, Mohammed Al-Ma’aitah & Aldosary Saad

Authors
  1. Ayed Alwadain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammed Al-Ma’aitah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Aldosary Saad
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mohammed Al-Ma’aitah.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alwadain, A., Al-Ma’aitah, M. & Saad, A. Developing computerized speech therapy system using metaheuristic optimized artificial cuckoo immune system. Cluster Comput 23, 1755–1767 (2020). https://doi.org/10.1007/s10586-020-03123-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-020-03123-0

Keywords

Search

Navigation