Advertisement

A calligraphy training system based on skill acquisition through haptization

  • Hiroaki NishinoEmail author
  • Kouta Murayama
  • Kazuya Shuto
  • Tsuneo Kagawa
  • Kouichi Utsumiya
Original Research

Abstract

We present a virtual reality system targeted at building a calligraphy training environment. Our main goal is to construct a virtual space enabling learners to intuitively acquire hard-to-inherit skills through the development of a Japanese calligraphy training system. The proposed system provides a haptic interaction channel allowing the learners to intuitively master instructor’s fine motor skills through the sense of touch. We utilize a commercially available haptic device called PHANTOM for simulating a writing brush in a virtual training space. The system implements a function for recording and replaying instructor’s hand motions via the PHANTOM device. The instructor’s writing techniques such as brush-strokes and pen pressures are recorded when he/she is writing characters and they are effectively reproduced and presented to the learners via the PHANTOM device. The learners can master how to write the recorded characters by feeling the instructor’s style of handwritings. We implemented a simple yet powerful 3D brush model for real-time visualization of handwritten characters without compromising the quality and reality of the visualized characters. The learners can start training at any time and iterate training sessions without worrying about resource consumptions such as papers and ink as much as they like. We conducted two experiments to validate the effectiveness of the proposed system for learning calligraphy in a virtual environment.

Keywords

Haptic interface Virtual reality Computer graphics Calligraphy training E-learning 

Supplementary material

Supplementary material 1 (WMV 6364 kb)

Supplementary material 2 (WMV 4599 kb)

References

  1. Chu NS, Tai CL (2004) Real-time painting with an expressive virtual Chinese brush. IEEE Comput Graph Appl 24(5):76–85CrossRefGoogle Scholar
  2. Eid M, Mansour M, El Saddik A, Iglesias R (2007) A haptic multimedia handwriting learning system. In: Proceedings of ACM EMME’07, pp 103–108, Sept 2007Google Scholar
  3. Inami N, Tominaga H, Matsubara Y, Yamasaki T (2004) Pencil touch learning system for Japanese handwriting based on the haptic device. Trans IEICE, J87-D-I (12): 1128–1135 (in Japanese)Google Scholar
  4. Keefe DF, Laidlaw DH (2005) A haptic interface for creating smooth 3D curves with varying line weight. In: Proceedings of ACM SIGGRAPH 2005 Posters, No. 99, 31 Jul–4 Aug 2005Google Scholar
  5. Massie TH, Salisbury JK (1994) The PHANTOM haptic interface: a device for probing virtual objects. In: Proceedings on the ASME winter annual meeting, symposium on haptic interface for virtual environment and teleoperator systems, pp 295–299, Nov 1994Google Scholar
  6. Nishino H, Takekata K, Sakamoto M, Salzman BA, Kagawa T, Utsumiya K (2005) An IEC-based haptic rendering optimizer. In: Proceedings of IEEE, soft computing as transdisciplinary science and technology (WSTST’05), Springer, pp 653–662, May 2005Google Scholar
  7. Nishino H, Yamaguchi A, Kagawa T, Utsumiya K (2008) A networked virtual environment for teaching handwritten characters through haptization of human motor skills. In: Proceedings of IEEE 22th international conference on advanced information networking and applications (AINA2008), pp 840–847, Mar 2008Google Scholar
  8. Nishino H, Yamaguchi A, Kagawa T, Utsumiya K (2009) A networked virtual environment for teaching handwritten characters through shared haptization. Int J Bus Intell Data Min 4(1):38–61CrossRefGoogle Scholar
  9. Nishino H, Murayama K, Kagawa T, Utsumiya K (2010) A Japanese calligraphy trainer based on skill acquisition through haptization. In: Proceedings of IEEE 24th international conference on advanced information networking and applications (AINA2010), pp 1225–1232, Apr 2010Google Scholar
  10. Saga S, Kawakami N, Tachi S (2005) A study on teaching methods utilizing a proactivity in haptics. Trans Virtual Real Soc Jpn 10(3):363–370 (in Japanese)Google Scholar
  11. Salisbury K, Conti F, Barbagli F (2004) Haptic rendering: introductory concepts. IEEE Comput Graph Appl 24(2):24–32CrossRefGoogle Scholar
  12. Takekata K, Salzman BA, Nishino H, Kagawa T, Utsumiya K (2005) An intuitive optimization method of haptic rendering using interactive evolutionary computation. In: Proceedings of IEEE international conference on systems, man, and cybernetics (SMC2005), pp 1896–1901, Oct 2005Google Scholar
  13. Teo CL, Burdet E, Lim HP (2002) A robotic teacher of Chinese handwriting. In: Proceedings of the 10th IEEE international symposium on haptic interfaces for virtual environment and teleoperator systems (Haptics’02), pp 335–341, Mar 2002Google Scholar
  14. Wada A, Shin J-P (2009) Three dimensional virtual calligraphy simulation with pen tablet. In: Proceedings of the 1st IEEE international workshop on aware computing (IWAC2009), pp 628–631, Sept 2009Google Scholar
  15. Wang D, Zhang Y, Yao C (2006) Stroke-based modeling and haptic skill display for Chinese calligraphy simulation system. Virtual reality. Springer 9(2–3):118–132Google Scholar
  16. Xu S, Francis Lau CM, Xu C, Pan Y (2005) Virtual hairy brush for digital painting and calligraphy. Sci China Ser. F inf sci (Springer) 48(3):285–303CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  • Hiroaki Nishino
    • 1
    Email author
  • Kouta Murayama
    • 1
  • Kazuya Shuto
    • 2
  • Tsuneo Kagawa
    • 1
  • Kouichi Utsumiya
    • 1
  1. 1.Department of Computer Science and Intelligent SystemsOita UniversityOitaJapan
  2. 2.NEC Software Kyushu, LtdFukuokaJapan

Personalised recommendations