Abstract
The rise of machine learning and neural networks has opened many doors for making various arduous real-life tasks far more accessible, in addition to their ability to analyze vast amounts of data that are considered to be impossible for humans to process. Neural networks are an essential topic as they can be applied in many real-life applications, such as image, video and sound matching, making them a very attractive research area. Numerous methods and approaches are available for training neural networks, but this paper is concerned with only the semi-supervised training approach, for which a new “enhanced semi-supervised” learning method is proposed. Semi-supervised learning means that machines, such as computers, can learn in the presence of datasets that are both labeled and unlabeled. In contrast, the supervised learning approach can be applicable with labeled data only. A novel semi-supervised learning approach for descriptor generation using artificial neural networks is proposed to control the values that are output by the neural network. However, no interaction with the assignment of these values to each input group occurs, nor is the space where the output values belong utilized. Thus, this method seeks to provide a more efficient learning approach with a more even distribution of the output throughout the output field of space, resulting in a more effective learning approach. The handwritten digit experiment showed an accuracy of 85.27%, while Alzheimer’s detection experiment recorded an accuracy of 99.27%. The results after applying the proposed method to two sets of experimental data revealed a significant improvement in accuracy compared with the use of Siamese neural networks in different applications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alsaadi HI, Almuttairi RM, Bayat O, Uçan ON (2020) Computational intelligence algorithms to handle dimensionality reduction for enhancing intrusion detection system. J Inf Sci Eng 36(2):293–308. https://doi.org/10.6688/JISE.202003_36(2).0009
Bashar A (2019) Survey on evolving deep learning neural network architectures. J Artif Intell 1(02):73–82. https://doi.org/10.36548/jaicn.2019.2.003
Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features. In: Leonardis A, Bischof H, Pinz A (eds) Computer vision—ECCV 2006. Springer, Berlin, pp 404–417. https://doi.org/10.1007/11744023_32
Burrello A, Schindler K, Benini L, Rahimi A (2018) One-shot learning for iEEG seizure detection using end-to-end binary operations: local binary patterns with hyperdimensional computing. In: IEEE biomedical circuits and systems conference (BioCAS). IEEE, pp 1–4. https://doi.org/10.1109/BIOCAS.2018.8584751
Chopra S, Hadsell R, LeCun Y (2005) Learning a similarity metric discriminatively, with application to face verification. In: IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 539–546. https://doi.org/10.1109/CVPR.2005.202
Farooq A, Anwar , Awais M, Rehman S (2017) A deep CNN based multi-class classification of Alzheimer's disease using MRI. In: 2017 IEEE international conference on imaging systems and techniques (IST). IEEE, pp 1–6. https://doi.org/10.1109/IST.2017.8261460
Fechter T, Baltas D (2020) One-shot learning for deformable medical image registration and periodic motion tracking transactions on medical imaging. IEEE 39(7):2506–2517. https://doi.org/10.1109/TMI.2020.2972616
Fischer P, Dosovitskiy A, Brox T (2014) Descriptor matching with convolutional neural networks: a comparison to SIFT. arXiv preprint arXiv:1405.5769
Islam J, Zhang Y (2018) Brain MRI analysis for Alzheimer’s disease diagnosis using an ensemble system of deep convolutional neural networks. Brain Inform 5(2):1–14. https://doi.org/10.1186/s40708-018-0080-3
Jadon S, Srinivasan AA (2021) Improving Siamese networks for one-shot learning using kernel-based activation functions. In: Sharma N, Chakrabarti A, Balas VE, Martinovic J (eds) Data management, analytics and innovation. Advances in Intelligent Systems and Computing, vol 1175. Springer, Singapore, pp 353–367. https://doi.org/10.1007/978-981-15-5619-7_25
Kvistad AH (2018) Active one-shot learning with memory-augmented neural networks. Norwegian University, Trondheim
Lee A (2015) Comparing deep neural networks and traditional vision algorithms in mobile robotics. Swarthmore University, Swarthmore
Lee DH (2019) One-shot scale and angle estimation for fast visual object tracking. IEEE Access 7:55477–55484. https://doi.org/10.1109/ACCESS.2019.2913390
Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the seventh IEEE international conference on computer vision, vol 2, pp 1150–1157. https://doi.org/10.1109/ICCV.1999.790410
Lu Z, Qin S, Li X, Li L, Zhang D (2019) One-shot learning hand gesture recognition based on modified 3d convolutional neural networks. Mach vis Appl 30(7):1157–1180. https://doi.org/10.1007/s00138-019-01043-7
Ma C, Zhang S, Wang A, Qi Y, Chen G (2020) Skeleton-based dynamic hand gesture recognition using an enhanced network with one-shot learning. Appl Sci 10(11):3680. https://doi.org/10.3390/app10113680
Mehmood A, Maqsood M, Bashir M, Shuyuan Y (2020) A deep Siamese convolution neural network for multi-class classification of Alzheimer disease. Brain Sci 10(2):84. https://doi.org/10.3390/brainsci10020084
Mehrotra A, Dukkipati A (2017) Generative adversarial residual pairwise networks for one shot learning. arXiv preprint arXiv:1703.08033
Mostavi M, Chiu YC, Chen Y, Huang Y (2021) One-shot learning for predicting primary and metastatic tumor types unseen during model training. BMC Bioinform 22(1):1–17. https://doi.org/10.1186/s12859-021-04157-w
Nandy A, Mondal SS (2019) Kinship verification using deep Siamese convolutional neural network. In: 2019 14th IEEE international conference on automatic face & gesture recognition (FG 2019). IEEE, pp 1–5. https://doi.org/10.1109/FG.2019.8756528
Reed S, Chen Y, Paine T, Oord AVD, Eslami S, Rezende D, Vinyals O, de Freitas N (2017) Few-shot autoregressive density estimation: towards learning to learn distributions. arXiv preprint arXiv:1710.10304
Ren F, Xue S (2020) Intention detection based on Siamese neural network with triplet loss. IEEE Access 8:82242–82254. https://doi.org/10.1109/ACCESS.2020.2991484
Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 815–823. https://doi.org/10.1109/CVPR.2015.7298682
Schuster S, Gupta S, Shah R, Lewis M (2018) Cross-lingual transfer learning for multilingual task-oriented dialog. arXiv preprint arXiv:1810.13327
Shorfuzzaman M, Hossain MS (2021) A Siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients. Pattern Recognit 113:107700. https://doi.org/10.1016/j.patcog.2020.107700
Thakurdesai N, Raut N, Tripathi A (2018) Face recognition using one-shot learning. Int J Comput Appl 975:8887. https://doi.org/10.5120/ijca2018918032
Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition. CVPR 2001, vol 1. IEEE, p I. https://doi.org/10.1109/CVPR.2001.990517
Wright C, Stewart D (2019) One-shot-learning for visual lip-based biometric authentication. In: International symposium on visual computing. Springer, pp 405–417. https://doi.org/10.1007/978-3-030-33720-9_31
Funding
Authors declare there are no funding for this study.
Author information
Authors and Affiliations
Contributions
AFA conducted the literature review, planned the experimental design, and analyzed and interpreted the information, in addition to writing the manuscript. ONU and AAI supervised and helped in the literature review and AFA, AY are contributed the manuscript preparation.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is not any conflict of interest regarding the publication of this manuscript. In addition, the ethical issues, including plagiarism, informed consent, misconduct, data fabrication and/ or falsification, double publication and/or submission, and redundancy has been completely observed by the authors.
Consent for publication
All authors agree to the publication.
Ethics approval and consent to participate
All authors agree to participate.
Additional information
Communicated by Irfan Uddin.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alwindawi, A.F., Uçan, O.N., Ibrahim, A.A. et al. Novel semi-supervised learning approach for descriptor generation using artificial neural networks. Soft Comput 26, 7709–7720 (2022). https://doi.org/10.1007/s00500-022-06742-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-022-06742-4