Vowel Recognition from RGB-D Facial Information
One of the main concerns in developed countries is population ageing. Elder people are susceptible of suffering conditions which reduce quality of life such as apraxia of speech, a burden that requires prolongued therapy. Our proposal is intended to be a first step towards automated solutions that assist speech therapy through detecting mouth poses. This work proposes a system for vowel poses recognition from an RGB-D camera that provides 2D and 3D information. 2D data is fed into a face recognition approach able to accurately locate and characterize the mouth in the image space. The approach also uses 3D real world measures obtained after pairing the 2D detection with the 3D information. Both information sources are processed by a set of classifiers to ascertain the best option for vowel recognition.
KeywordsApraxia of speech Visual recognition Classification RGB-D
Unable to display preview. Download preview PDF.
- 5.Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning, 2nd edn., pp. 587–588. Springer (2008)Google Scholar
- 7.Lowe, D.G.: Object recognition from local scale-invariant features. In: ICCV, vol. 2, pp. 1150–1157 (1999)Google Scholar
- 8.Marti, P., Bacigalupo, M., Giusti, L., Mennecozzi, C., Shibata, T.: Socially assistive robotics in the treatment of behavioural and psychological symptoms of dementia. In: Biomedical Robotics and Biomechatronics, BioRob, pp. 483–488 (2006)Google Scholar
- 9.Milborrow, S., Nicolls, F.: Active Shape models with sift descriptors and mars. In: VISAPP, vol. 2, pp. 380–387 (2014)Google Scholar
- 11.Olson, D.L., Delen, D.: Advanced data mining techniques. Springer Science & Business Media (2008)Google Scholar
- 13.Prabhu, U., Seshadri, K.: Facial Recognition Using Active Shape Models, Local Patches and Support Vector Machines (2009). http://www.contrib.andrew.cmu.edu/~kseshadr/ML_Paper.pdf (Accessed February 6, 2016)
- 14.Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Ng, A.Y.: ROS: an open-source robot operating system. In: ICRA Workshop on Open Source Software, vol. 3(3.2), p. 5 (2009)Google Scholar
- 15.Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers (1993)Google Scholar
- 17.Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach. Prentice Hall (1995)Google Scholar
- 18.Schölkopf, B., Burges, C.J.C., Smola, A.J.: Advances in Kernel Methods: Support Vector Learning. MIT Press (1999)Google Scholar
- 19.Li, S.Z., Jain, A.K.: Handbook of Face Recognition. Springer-Verlag (2005)Google Scholar