To Write not Select, a New Text Entry Method Using Joystick

  • Zhenyu GuEmail author
  • Xinya Xu
  • Chen Chu
  • Yuchen Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9170)


Existing joystick text entry methods for game and TV boxes are curser-based selections on virtual keyboards. In this paper we present a new text entry method using joysticks as tangible devices to capture users’ freehand writing gestures. The method has considerable accuracy to accomplish English text entry. On the prediction model, we introduced HMM algorithm so users can enter text assisted with automatic correcting. We conducted a pairwise usability test on the keyboard selection method and writing-with-joystick method. The result shows that both of them are very easier to learn and writing-with-joystick is faster than the keyboard selection method both on the prediction model or none-prediction model. Subjects also report that using the keyboard selection method to enter text can be boring when using handwriting is somehow natural. This result indicates that writing with joystick may be another text entry option for game console or Smart TV users.


Text entry Joystick writing Online recognition 


  1. 1.
    Wilson, A.D., Agrawala., M.: Text entry using a dual joystick game controller. In: Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM (2006)Google Scholar
  2. 2.
    Wobbrock, J.O., Myers, B.A., Aung, H.H.: Writing with a joystick: a comparison of date stamp, selection keyboard, and EdgeWrite. In: Proceedings of Graphics Interface 2004. Canadian Human-Computer Communications Society (2004)Google Scholar
  3. 3.
    Wobbrock, J.O., et al.: Integrated text entry from power wheelchairs. Behav. Inf. Technol. 24(3), 187–203 (2005)CrossRefGoogle Scholar
  4. 4.
    Rash, C.E.: Analysis and Design of Keyboards for the AH-64D Helicopter, DTIC Document (2005)Google Scholar
  5. 5.
    MacKenzie, I.S., Zhang, S.X.: The design and evaluation of a high-performance soft keyboard. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, pp. 25–31. ACM, Pittsburgh (1999)Google Scholar
  6. 6.
    Goldberg, D., Richardson, C.: Touch-typing with a stylus. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, pp. 80–87. ACM Amsterdam, The Netherlands (1993)Google Scholar
  7. 7.
    Castellucci, S.J., MacKenzie, I.S.: Graffiti vs. unistrokes: an empirical comparison. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 305–308. ACM, Florence (2008)Google Scholar
  8. 8.
    Plamondon, R., Srihari, S.N.: Online and off-line handwriting recognition: a comprehensive survey. IEEE Trans. Pattern Anal. Mach. Intell. 22(1), 63–84 (2000)CrossRefGoogle Scholar
  9. 9.
    Bahlmann, C., Haasdonk, B., Burkhardt, H.: Online handwriting recognition with support vector machines-a kernel approach. In: Proceedings. Eighth International Workshop on Frontiers in Handwriting Recognition. IEEE (2002)Google Scholar
  10. 10.
    MacKenzie, I.S., Soukoreff, R.W., Helga, J.: 1 thumb, 4 buttons, 20 words per minute: Design and evaluation of H4-Writer. In: Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM (2011)Google Scholar
  11. 11.
    Parizeau, M., Lemieux, A., Gagne, C.: Character recognition experiments using Unipen data. In: Proceedings. Sixth International Conference on Document Analysis and Recognition (2001)Google Scholar
  12. 12.
    Polacek, O., Sporka, A.J., Butler, B.: Improving the methodology of text entry experiments. In: IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom), pp. 155–160 (2013)Google Scholar
  13. 13.
    MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: CHI 2003 Extended Abstracts on Human Factors in Computing Systems, pp. 754–755. ACM, Fort Lauderdale, Florida (2003)Google Scholar
  14. 14.
    Soukoreff, R.W., MacKenzie, I.S.: Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Shanghai Jiao Tong UniversityShanghaiChina

Personalised recommendations