Abstract
In this paper, we aim to carry out a brief study of a new sets of Quaternion Discrete Moment Invariants (QDMI) in uniform lattice named: Quaternion Tchebichef Moment Invariants (QTMI), Quaternion Krawtchouk Moment Invariants (QKMI), and Quaternion Hahn Moment Invariants (QHMI), for hand gesture-based sign language recognition. For this purpose, we present briefly the principles of those moment invariants. Then, we test them on several datasets that contain challenging attributions, with regard to invariability and recognition under noise-free and noisy conditions. We conclude our paper by discussing the obtained results and the future works in this field.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Elouariachi, I., Benouini, R., Zenkouar, K., Zarghili, A.: Robust hand gesture recognition system based on a new set of quaternion Tchebichef moment invariants. Pattern Anal. Appl. 1–17 (2020)
Elouariachi, I., Benouini, R., Zenkouar, K., Zarghili, A., El Fadili, H.: Explicit quaternion krawtchouk moment invariants for finger-spelling sign language recognition. In: 2020 28th European Signal Processing Conference (EUSIPCO), pp. 620–624. IEEE (2021, January)
Ren, Z., Yuan, J., Meng, J., Zhang, Z.: Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimed. 15, 1110–1120 (2013)
Huang, D.Y., Hu, W.C., Chang, S.H.: Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination. Expert Syst. Appl. 38(5), 6031–6042 (2011)
Li, Y.T., Wachs, J.P.: HEGM: a hierarchical elastic graph matching for hand gesture recognition. Pattern Recognit. 47(1), 80–88 (2014)
Lin, J., Ding, Y.: A temporal hand gesture recognition system based on hog and motion trajectory. Optik 124(24), 6795–6798 (2013)
Patil, S.B., Sinha, G.R.: Distinctive feature extraction for Indian Sign Language (ISL) gesture using scale invariant feature Transform (SIFT). J. Inst. Eng. (India): Ser. B 98(1), 19–26 (2017)
Zhang, F., Liu, Y., Zou, C., & Wang, Y.: Hand gesture recognition based on HOG-LBP feature. In: 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1–6. IEEE (2018, May)
Benouini, R., Batioua, I., Elouariachi, I., Zenkouar, K., Zarghili, A.: Explicit separable two dimensional moment invariants for object recognition. Procedia Comput. Sci. 148, 409–417 (2019)
Flusser, J., Suk, T., Zitov, B.: 2D and 3D image analysis by moments. Wiley, Hoboken (2016)
Jadooki, S., Mohamad, D., Saba, T., Almazyad, A.S., Rehman, A.: Fused features mining for depth-based hand gesture recognition to classify blind human communication. Neural Comput. Appl. 28(11), 3285–3294 (2017)
Hu, Y.: Finger spelling recognition using depth information and support vector machine. Multimedia Tools Appl. 77(21), 29043–29057 (2018)
Gallo, L., Placitelli, A.P.: View-independent hand posture recognition from single depth images using PCA and Flusser moments. In: 2012 eighth international conference on signal image technology and internet based systems, pp. 898–904. IEEE (2012, November)
Hamilton, W.R.: Elements of quaternions. Longmans, Green, & Company (1866)
Krawtchouk, M.: On interpolation by means of orthogonal polynomials. Memoirs Agric. Inst. Kyiv 4, 21–28 (1929)
Zhou, J., Shu, H., Zhu, H., Toumoulin, C., & Luo, L.: Image analysis by discrete orthogonal Hahn moments. In International Conference Image Analysis and Recognition, pp. 524–531. Springer, Berlin, Heidelberg (2005, September)
Wang, C., Liu, Z., Chan, S.C.: Superpixel-based hand gesture recognition with kinect depth camera. IEEE Trans. Multimedia 17(1), 29–39 (2014)
Pugeault, N., Bowden, R.: Spelling it out: Real-time ASL fingerspelling recognition. In: 2011 IEEE International conference on computer vision workshops (ICCV workshops), pp. 1114–1119. IEEE (2011, November)
Mukundan, R., Ong, S.H., Lee, P.A.: Image analysis by Tchebichef moments. IEEE Trans. Image Process. 10(9), 1357–1364 (2001)
Karakasis, E.G., Papakostas, G.A., Koulouriotis, D.E., Tourassis, V.D.: Generalized dual Hahn moment invariants. Pattern Recogn. 46(7), 1998–2014 (2013)
VisionTexture (VisTex). http://vismod.media.mit.edu/vismod/imagery/VisionTexture/Images/Reference/
Colored Brodatz (CBT). http://multibandtexture.recherche.usherbrooke.ca/colored%20_brodatz.html
Outex texture (Outex). http://lagis-vi.univ-lille1.fr/datasets/outex.html
Amsterdam Library of Textures (Amsterdam). http://aloi.science.uva.nl/public_alot/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
El Ouariachi, I., Benouini, R., Zenkouar, K., Zarghili, A., El Fadili, H. (2022). Sign Language Recognition with Quaternion Moment Invariants: A Comparative Study. In: Ben Ahmed, M., Teodorescu, HN.L., Mazri, T., Subashini, P., Boudhir, A.A. (eds) Networking, Intelligent Systems and Security. Smart Innovation, Systems and Technologies, vol 237. Springer, Singapore. https://doi.org/10.1007/978-981-16-3637-0_52
Download citation
DOI: https://doi.org/10.1007/978-981-16-3637-0_52
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-3636-3
Online ISBN: 978-981-16-3637-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)