Identity Verification Using Face Recognition for Artificial-Intelligence Electronic Forms with Speech Interaction

  • Akitoshi OkumuraEmail author
  • Shuji Komeiji
  • Motohiko Sakaguchi
  • Masahiro Tabuchi
  • Hiroaki Hattori
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11594)


Concern over the decline in Japan’s manufacturing competitiveness has increased in recent years. In particular, falsification of inspection data is a social problem that could undermine Japan’s manufacturing industry, which is founded on a dedication to high quality. Falsification could be prevented by ensuring transparency of the inspection process by visualizing the process. End-to-end visualization facilitates early detection and prevention of various law infractions. In the workplace, visualization requires an efficient low-cost identity-verification method that ensures ease of visual confirmability for product traceability. We previously developed AI-forms, i.e., artificial-intelligence electronic forms, that provides a speech interface as a means of improving the standard work process in workplaces by making operations more efficient and visualizing processes. AI-forms improves production efficiency and visualizes the collected operation records by enhancing the readability and writability of records and handover operations that are not sufficiently supported by traditional electronic forms. To prevent falsification of inspections, it is necessary to use a widely deployed device and verification method in the workplace. We propose an identity-verification method for applying face recognition to AI-forms and developed a smartphone app for AI-forms. Preliminary feasibility testing involving 11 workers in an actual workplace confirmed that identity verification is possible when face recognition is carried out with frontal images of workers who are not wearing face masks. The face-recognition process completed within 0.4 s, enabling workers to seamlessly begin work with AI-forms. Recording both collation photos and worker names during identity verification also made it possible for a human to visually confirm a worker’s identity. Discussion with workers and supervisors after the feasibility tests provided findings for improving our face-recognition app for closer integration of AI-forms and our identity-verification method at arbitrary times.


AI forms Data inspection Face recognition Biometrics Identity verification Falsifying inspection data 


  1. 1.
    The Mainichi Editorial: Quality control scandals endangering the ‘Japan brand’, October 2017.
  2. 2.
    How Workplaces Falsify Data, 12 December 2017. (in Japanese)
  3. 3.
    Tabuchi, M., Sakaguchi, M., Hattori, H., Okumura, A.: Artificial-intelligence powered, voice-activated electronic forms for a standard process improvement solution. J. Inf. Process. 8(2), 13–23 (2018). (in Japanese)Google Scholar
  4. 4.
    Tokyo Polytechnic University: Survey on natural user interface, December 2017. (in Japanese)
  5. 5.
    Komeiji, S., Sakaguchi, M., Tabuchi, M., Hattori, H., Okumura, A.: An approach to realize an artificial-intelligence voice-activated electronic forms having cheat deterrent effect - a proposal of multi-layer speaker adaptation. J. Inf. Process. 8(3) (2018). (in Japanese)Google Scholar
  6. 6.
    Japan Information Economic and Social Promotion Association: 2012 information security promotion business survey report, Survey research on social infrastructure construction using attribute information for identification, p. 16, March 2013. (in Japanese)Google Scholar
  7. 7.
    Imaoka, H., Mizoguchi, M., Hara, M.: Biometrics technology to preserve safety and security. Inf. Process. 51(12), 1547–1554 (2010). (in Japanese)Google Scholar
  8. 8.
    Seto, Y.: Trends and prospects in biometric security authentication technology. Inf. Process. 47(6), 571–576 (2006). (in Japanese)Google Scholar
  9. 9.
    Soto, M.: Using biometric authentication technology in Japanese financial institutions. Inf. Process. 47(6), 577–582 (2006)Google Scholar
  10. 10.
    Sakamoto, S.: Present status and prospects of biometric products and solutions, NEC Tech. Rep. 5(3) (2010).
  11. 11.
    IPA (Information-technology Promotion Agency, Japan): Guide for introduction and operation of biometric authentication, pp. 19–21, January 2013. (in Japanese)Google Scholar
  12. 12.
    Face Recognition Technology Evaluation Committee for Immigration: Demonstration experiment results on face recognition technology for Japanese going and returning from abroad, 18 November 2014. (in Japanese)
  13. 13.
    Face Recognition Homepage Vendors.
  14. 14.
  15. 15.
  16. 16.
    Imaoka, H.: NEC’s face recognition technology and applications, IPSG SIG Technical report, vol. 2013-CVIM-187, no. 38, pp. 1–4 (2013). (in Japanese)Google Scholar
  17. 17.
    Okumura, A., Hoshino, T., Handa, S., Nishiyama, Y., Tabuchi, M.: Identity verification of ticket holders at large-scale events using face recognition. J. Inf. Process. 25, 448–458 (2017)Google Scholar
  18. 18.
    Okumura, A., Hoshino, T., Handa, S., Nishiyama, Y., Tabuchi, M.: Improving identity verification for ticket holders of large-scale events using non-stop face recognition system. J. Inf. Process. 8(1), 1–8 (2018). (in Japanese)Google Scholar
  19. 19.
    Okumura, A., Hoshino, T., Handa, S., Yamada, E. Tabuchi, M.: Identity verification for attendees of large-scale events using face recognition of selfies taken with smartphone cameras. J. Inf. Process. 8(3) (2018)Google Scholar
  20. 20.
    Bentivoglio, A.R., Bressman, S.B., Cassetta, E., Carretta, D., Tonali, P., Albanese, A.: Analysis of blink rate patterns in normal subjects. Mov Disord. 12(6), 1028–1034 (1997)CrossRefGoogle Scholar
  21. 21.
    Nosch, D.S., Pult, H., Albon, J., Purslow, C., Murphy, P.J.: Relationship between corneal sensation, blinking, and tear film quality. Optom. Vis. Sci. 93(5), 471–481 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Akitoshi Okumura
    • 1
    Email author
  • Shuji Komeiji
    • 1
  • Motohiko Sakaguchi
    • 1
  • Masahiro Tabuchi
    • 1
  • Hiroaki Hattori
    • 1
  1. 1.NEC Solution Innovators, Ltd.KawasakiJapan

Personalised recommendations