Construction of a Japanese Sign Language Database with Various Data Types
We have constructed a sign language database which shows 3D animations. We are aiming at constructing an interdisciplinary database which can be used by researchers in various academic fields. This database helps the researchers analyze Japanese sign language. We have recorded nearly 2,000 Japanese signs to now, and we are planning to record on the database approximately 5,000 signs. Firstly, we decided to pick up frequently used Japanese words on the database. Each sign language expression corresponds to the Japanese words is examined. Secondly, we recorded 3D motion data of the determined sign language expressions. We used optical motion capture to record 3D motion data. The data format obtained through motion capture is C3D data, BVH data and FBX data, and frame rate is 120 fps. In addition, we also recorded a full HD video data at 60 fps, super-slow HD data at 30 fps, and depth data at 30 fps, for use in analysis of sign language.
These are recorded synchronously. In addition, we have developed a new annotation system which can reproduce different types of data synchronously to make the database the most effective. Because it is necessary for data analysis to reproduce synchronously all data, which have been recorded at different frame rates.
KeywordsSign language Motion capture 3D animations
This work was partly supported by grant-in-aid from the Ministry of Education, Culture, Sports, Science and Technology (MEXT) of Japan (No. (S)17H06114).
- 1.Amano, S., Kasahara, K., Kondo, T. (eds.): NTT Database Series [Lexical Properties of Japanese], vol. 9, Word Familiarity Database (Addition), Sanseido, Tokyo (2008)Google Scholar
- 2.Corpus of Spontaneous Japanese. http://pj.ninjal.ac.jp/corpus_center/csj/. Accessed 29 Nov 2018
- 3.Katou, N.: Japanese Sign Language Corpus on NHK News. In: 2010 NLP (the Association for Natural Language Processing) Annual Meeting, pp. 494–497 (2010)Google Scholar
- 4.Japan Institute for Sign Language Studies (ed.): Japanese/Japanese Sign Language Dictionary. Japanese Federation of the Deaf, Tokyo (1997)Google Scholar