Analysis of Emotional Expression of Finger Braille
Finger Braille is one of tactual communication media of deafblind people. In two-handed Finger Braille, index finger, middle finger and ring finger of both hands are likened to keys of a Braille typewriter. A sender dots Braille code on the fingers of a receiver like whether he/she does the type of the Braille typewriter. Then the receiver recognizes the Braille code. In one-handed Finger Braille, the sender dots the left column of Braille code on the DIP joints of three fingers of the receiver, and then the sender dots the right column of Braille code on the PIP joints of them. Deafblind people who are skilled in Finger Braille can catch up with speech conversation and express various emotions. Because there are small nondisabled people who are skilled in Finger Braille, deafblind people communicate only with interpreters. Objective of this study is development of a Finger Braille supporting device which assists not only verbal communication but also nonverbal (emotional) communication between deafblind people and non-disabled people who are not skilled in Finger Braille. In this paper, an experiment of emotional expression of Finger Braille was carried out. And we analyzed features of emotional expression of Finger Braille and discussed algorithm of emotion recognition. The features of emotional expression were: (1) the durations of code of Joy were particularly shorter than other emotions; (2) the durations of code of Sadness were particularly longer than other emotions; (3) the finger loads of Anger were particularly bigger than other emotions. To develop emotion recognition system, we discussed algorithm of emotion recognition using the accelerometers worn by tester. According to the results of discriminant analysis, it was considered that emotion recognition using the discriminant functions and the average of posterior probabilities in a sentence was possible.
Keywordsdeafblind Finger Braille emotional expression prosody emotion recognition
Unable to display preview. Download preview PDF.
- 1.Matsuda Y et al. (2005) Finger Braille Teaching System for Nondisabled People who Communicate with Deafblind People, IFMBE Proc. vol. 8, 6th Asian-Pacific Conference on Med. & Biolog. Eng., Tsukuba, Japan, 2005, PA-2-36Google Scholar
- 2.Matsuda Y et al. (2007) Finger Braille Teaching System for People who Communicate with Deafblind People, Proc. of the 2007 IEEE International Conference on Mechatronics and Automation, Harbin, China, 2007, pp.3202–3207Google Scholar
- 3.Matsuda Y et al. (2006) Finger Braille Recognition System for Nondisabled People who Communicate with Deafblind People, IFMBE Proc. vol. 14, World Congress on Med. Phys. & Biomed. Eng. 2006, Seoul, Korea, 2006, pp.2812–2815Google Scholar
- 4.Matsuda Y et al. (2007) Analysis of Shock Accelerations by Dotting of One-handed Finger Braille, Proc. of the Third Asian Pacific Conference on Biomechanics, Tokyo, Japan, 2007, p S88Google Scholar