Character Input by Gesture Performed with Grasping Both Ends of Tablet PC
We developed a method to enter Hiragana (cursive in Japanese) characters and alphanumeric characters by thumb gestures for Japanese people. This method is optimized to be used while holding the left and right ends of a tablet PC with hands. Each gesture is designed by concatenating a few horizontal and/or vertical strokes, but path of the gesture remains inside the one-stroke square centering its starting position. A Hiragana character is input by selecting a row of the table of Japanese syllabary and then a column of the table. The alphabet characters are segmented into 6 groups in order of letters. Just like Hiragana, an alphabet character is entered by selecting a group and then selecting a member. However, in the alphanumeric mode, to reduce the cost of modifying the mistakenly selected group, an operation to move to the previous or next group have been added.
Characters are entered by gestures executed by the dominant hand. Gestures carried out in the opposite hand are assigned to some control codes that are needed to kana-to-kanji conversion and document modification. Since the input guide on the display is rewritten each time when one stroke is recognized, a user can enter any character by moving the thumb to the direction of the character shown on the guide, even if he or she does not memorize its gesture.
In the experiment entering Hiragana, input speed of beginners was about 20 [CPM]. A person skillful at this method could input about 58 [CPM] without watching fingertips.
KeywordsCharacter input Tablet PC Holding with both hands Stroke gesture by thumb The Japanese language
This work was supported by JSPS KAKENHI Grant Number JP16K00286.
- 1.Maniwa, H., Kotani, K., Suzuki, S., Asao, T.: Influence in posture of the upper extremity through the use of various size of tablets and characters. J. Mob. Interact. 3(1), 33–38 (2013). (in Japanese)Google Scholar
- 2.How to use the Windows 10 touch keyboard. http://www.techradar.com/how-to/software/operating-systems/how-to-make-the-most-out-of-the-windows-10-touch-keyboard-1307508/2. Accessed 18 Dec 2017
- 3.Basic operation of iPhone (keyboard chapter). http://iphoneac.com/beginner4.html, 18 Dec 2017
- 4.A.I. type Tablet Keyboard, https://play.google.com/store/apps/details?id=com.aitype.android.tablet. Accessed 18 Dec 2017
- 5.How to Undock & Split Your iPad Keyboard. http://www.macobserver.com/tmo/article/how-to-undock-and-split-your-ipad-keyboard. Accessed 18 Dec 2017
- 6.Word Flow Keyboard. https://www.microsoft.com/en-us/garage/profiles/word-flow-keyboard/. Accessed 18 Dec 2017
- 7.Tanaka, M., Tagawa, K., Yamanaka, S.: A study on developing of new thumb keyboard tagtype. In: Proceeding of Dynamics and Design Conference: D & D, pp. 626–631 (2001). (in Japanese)Google Scholar
- 8.Tagtype for VAIO. http://www.vaio.sony.co.jp/Enjoy/Download/Tagtype/. Accessed 18 Dec 2017
- 9.Isokoski, P., Raisamo, R.: Device independent text input: A rationale and an example. In: Proceedings of the Working Conference on Advanced Visual Interfaces - AVI 2000, pp. 76–83. ACM, New York (2000)Google Scholar
- 10.Felzer, T., Nordmann, R.: Alternative text entry using different input methods. In: Proceedings of the ACM SIGACCESS Conference on Computers and Accessibility - ASSETS 2006, pp. 10–17 (2006)Google Scholar
- 11.MacKenzie, S., Soukoreff, W., Helga, J.: 1 thumb, 4 buttons, 20 words per minute: Design and evaluation of H4-Writer. In: Proceedings of the ACM Symposium on User Interface Software and Technology - UIST 2011, pp. 471–480 (2011)Google Scholar
- 12.Wobbrock, J., Aung, H., Rothrock, B., Myers, B.: Maximizing the guessability of symbolic input. In: Extended Abstracts of ACM Human Factors in Computing Systems (CHI2005), pp. 1869–1872 (2005)Google Scholar
- 13.Wobbrock, J., Myers, B., Rothrock, B.: Few-key text entry revisited: Mnemonic gestures on four keys. In: Extended Abstracts of ACM Conference on Human Factors in Computing Systems - CHI 2006, pp. 489–492 (2006)Google Scholar
- 14.Fukatsu, Y., Shizuki, B., Tanaka, J.: No-look flick: single-handed and eyes-free japanese text input system on touch screens of mobile devices. In: Proceeding of MOBILE HCI 2013 – Touch and Text Input, pp. 161–170 (2013)Google Scholar
- 15.Aoki, R., et. al.: Drag&Flick: A text entry method on a touch screen for visually impaired people. In: Proceeding of IPSJ Interaction 2013, pp. 72–79 (2013). (in Japanese)Google Scholar
- 16.Oulasvirta, A., et al.: Improving two-thumb text entry on touchscreen devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 2765–2774 (2013)Google Scholar
- 17.Everyone’s Japanese words in the website Japanese teacher’s teaching. http://kyoan.u-biq.org/tangosearch.html. Accessed 18 Dec 2017 (in Japanese)
- 20.Soukoreff, W., MacKenzie, I.: Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of ACM CHI 2003, pp. 113–120 (2003)Google Scholar