Skip to main content

Traditional Chinese Medical Face Diagnosis System Visualized by Augmented Reality Interface Design

  • 2111 Accesses

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 275)


This research analyzes the esoteric traditional Asian medical face diagnosis theories to bridge medicine with technology and the arts. It then shows the screen’s health results by augmented reality technology (AR) with art and consultation knowledge. Computer vision performs recognition operations to distinguish the face’s faults, such as marks, acne, and color that appeared in specific positions. The data that meet the feature definition accurately determine which objective complexion image to be translated and correspond to the Asian medical theory. The resulting image is displayed on the screen interface to users through AR. Users can reflect on self-health from the artistic expression of the self-color spectrum. 6 TCM doctors surveyed the face diagnosis template for qualitative credibility. Follow up by the prototype design and then posted on the webpage to recruit 100 volunteers to answer the quantitative survey. More gamification than the medical diagnosis to prevent ignoring the severe symptoms based on the findings of the face recognition of Asian Medical varies from different theories and has mutual interaction simultaneously.


  • Asian medical
  • Face diagnosis
  • Augmented reality
  • Computer vision
  • Gamification

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-80091-8_29
  • Chapter length: 9 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   219.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-80091-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   279.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.


  1. Almohaimmeed, B.: Restaurant Quality and Customer Satisfaction. Int. Rev. Manage. Mark. 7(3) 42–49 (2017)

    Google Scholar 

  2. Barnes, P.M., Bloom, B., Nahin, R.L.: Complementary and Alternative Medicine Use Among Adults and Children: United States, 2007. National health statistics reports. (C. f. Prevention, Ed.) DHHS publication. (2008, 12 10)

    Google Scholar 

  3. Brozek, C.: Face Mapping for Acne: The Ultimate Guide. Retrieved from Moss: Mar 2017)

  4. Department of Chinese Medicine and Pharmacy. Basic Theory of Chinese Medicine. Retrieved 12 2019, from Taiwan Ministry of Health and welfare: (2018, 7)

  5. Hou, S., Li, P., Han, J., Yao, H., Sun, R., Li, L., et al.: Research on TCM constitution classification based on facial color and texture features. Biomed. Res. (0970–938X) 28(10), 4645–4650 (2017)

    Google Scholar 

  6. Sharkey, L., Hannan, C.: Can You Use Face Mapping to Improve Your Skin’s Health? Accessed from Healthline: (2019, 8)

  7. Spiller, D., (n.d.). Jiang, B.J.: The Generals. Retrieved 1 5, 2021, from The gods of Taiwan: (2021)

  8. Sun, C., Zhang, H., Qiu, X., Peng, Q., Sun, Z., Fu, W.: Automatic facial spirit classification for traditional Chinese medicine based on mutiple facial features. In: 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) Bioinformatics and Biomedicine (BIBM), pp. 16–21. Belfast: 2014 IEEE International Conference (2014)

    Google Scholar 

  9. White, J.: Lifelines: Complementary and Alternative Medicine. Accessed 20 Dec 2019. (10 Aug 2010)

  10. Zhao, C., Li, G.-Z., Li, F., Wang, Z., Liu, C.: Qualitative and quantitative analysis for facial complexion in traditional Chinese medicine. Biomed. Res. Int. 2014, 1–17 (2014)

    Google Scholar 

  11. Zhao, J., Liu, M., Guo, S.-Z., Tian, F., Jiang, Z.-H., Lu, X.-Z.: Analysis on the facial diagnosis objectification of traditional Chinese medicine. Tianjin J. Tradit. Chinese Med. 34(10), 317–320 (2017)

    Google Scholar 

Download references


Thanks to Doctor Chuan‐Yu Chen for providing idea, fruitful discussions and sponsor on this research project. This work was partially funded by the National Science Council, Taiwan (NSC- 109–2410-H-119 -005-).

Author information

Authors and Affiliations


Corresponding author

Correspondence to Jia-Ming Day .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Day, JM., Way, DL., Day, W., Lo, HL., Chang, CY. (2021). Traditional Chinese Medical Face Diagnosis System Visualized by Augmented Reality Interface Design. In: Ahram, T.Z., Falcão, C.S. (eds) Advances in Usability, User Experience, Wearable and Assistive Technology. AHFE 2021. Lecture Notes in Networks and Systems, vol 275. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-80090-1

  • Online ISBN: 978-3-030-80091-8

  • eBook Packages: EngineeringEngineering (R0)