Skip to main content
SpringerLink
Log in

Adaptive Lip Feature Point Detection Algorithm for Real-Time Computer Vision-Based Smile Training System

  • Conference paper
Learning by Playing. Game-based Education System Design and Development (Edutainment 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5670))

Abstract

This paper presents an adaptive lip feature point detection algorithm for the proposed real-time smile training system using visual instructions. The proposed algorithm can detect a lip feature point irrespective of lip color with minimal user participation, such as drawing a line on a lip on the screen. Therefore, the proposed algorithm supports adaptive feature detection by real-time analysis for a color histogram. Moreover, we develop a supportive guide model as visual instructions for the target expression. By using the guide model, users can train their smile expression intuitively because they can easily identify the differences between their smile and target expression. We also allow users to experience the smile training system using the proposed methods and we evaluated the effectiveness of these methods through usability tests. As experimental results, the proposed algorithm for feature detection had 3.4 error pixels and we found that the proposed methods could be an effective approach for training smile expressions in real-time processing.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kurokawa, T.: Nonverbal interface. Ohmsha, Ltd., Tokyo (1994) (in Japanese)

    Google Scholar 

  2. Yoshikawa, S.: Facial expression as a media in body and computer, pp. 376–388. Kyoritsu Shuppan Co., Ltd. (2001) (in Japanese)

    Google Scholar 

  3. Uchida, T.: Function of facial expression. Bungeisha, Co., Ltd. (2006) (in Japanese)

    Google Scholar 

  4. Mehrabian, A.: Silent messages, 2nd edn. Implicit Communication of Emotions and Attitudes. Wadsworth Pub. Co. (1981)

    Google Scholar 

  5. Ito, K., Kurose, H., Takami, A., Nishida, S.: Development of Facial Expression Training System. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4557, pp. 850–857. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  6. Ito, K., Kurose, H., Takami, A., Nishida, S.: Development and Application of Facial Expression Training System. In: Holzinger, A. (ed.) USAB 2007. LNCS, vol. 4799, pp. 365–372. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  7. Ito, K., Kurose, H., Takami, A., Nishida, S.: iFace: Facial Expression Training System. Affective computing, 319–328 (2008)

    Google Scholar 

  8. Wilson, P.I., Fernandez, J.: Facial Feature Detection Using Haar Classifiers. Journal of Computing Sciences in Colleges 21(4), 127–133 (2006)

    Google Scholar 

  9. Castrillón-Santana, M., Déniz-Suárez, O., Antón-Canalís, L., Lorenzo-Navarro, J.: Face and Facial Feature Detection Evaluation. In: International Conference on Computer Vision Theory and Applications (VISAPP 2008) (2008)

    Google Scholar 

  10. Harris, C., Stephens, M.: A Combined Corner and Edge Detector. In: Proceedings of the 4th Alvey Vision Conference, pp. 147–151 (1988)

    Google Scholar 

  11. Intel Open Source Computer Vision Library, http://sourceforge.net/projects/opencvlibrary/

  12. Kruppa, H., Castrillón Santana, M., Schiele, B.: Fast and Robust Face Finding via Local Context. In: Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), pp. 157–164 (2003)

    Google Scholar 

  13. Viola, P., Jones, M.J.: Robust Real-time Face Detection. International Journal of Computer Vision 57(2), 137–154 (2004)

    Article  Google Scholar 

  14. Tian, Y., Kanade, T., Cohn, J.F.: Recognizing Action Units for Facial Expression Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)

    Article  Google Scholar 

  15. Tian, Y., Kanade, T., Cohn, J.F.: Robust Lip Tracking by Combining Shape, Color and Motion. In: ACCV 2000, pp. 1040–1045 (2000)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. GIST U-VR Lab., Gwangju, 500-712, South Korea

    Youngkyoon Jang & Woontack Woo

Authors
  1. Youngkyoon Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Woontack Woo
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computing and Information Systems 1200, Athabasca University, 10011-109 Street, T5J-3S8, Edmont, Canada

    Maiga Chang

  2. Department of Digital Design 369, Ming Dao University, Wen-Hua Dr., Peetow, 52345, ChangHua, Taiwan

    Rita Kuo

  3. School of Computing and Inforamtion Systems, Athabasca University, 1 University Drive, T9S 3A3, Athabasca, AB, Canada

    Kinshuk

  4. Department of Computer Science and Information Engineering, National Central University, 300, Jhongda Rd., 32001, Jhongli City, Taiwan

    Gwo-Dong Chen

  5. Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, 113-8656, Tokyo, Japan

    Michitaka Hirose

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jang, Y., Woo, W. (2009). Adaptive Lip Feature Point Detection Algorithm for Real-Time Computer Vision-Based Smile Training System. In: Chang, M., Kuo, R., Kinshuk, Chen, GD., Hirose, M. (eds) Learning by Playing. Game-based Education System Design and Development. Edutainment 2009. Lecture Notes in Computer Science, vol 5670. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03364-3_46

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03364-3_46

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03363-6

  • Online ISBN: 978-3-642-03364-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation