Skip to main content
Log in

Enhancing IoT-Based Smart Home Security Through a Combination of Deep Learning and Self-Attention Mechanism

  • Research Article-Computer Engineering and Computer Science
  • Published:
Arabian Journal for Science and Engineering Aims and scope Submit manuscript

Abstract

Deep learning and the Internet of Things (IoT) are rapidly advancing technologies with wide-ranging applications, notably in areas such as face detection. There is a growing need for sophisticated touchless authentication systems within this domain. While numerous security methods are available, many of them suffer from various shortcomings, including issues like forgotten passwords and the potential transmission of diseases through touch-based authentication techniques. This paper proposes IoT-based intelligent control face detection systems that leverage deep learning (DL) models. These systems are designed to significantly enhance security without relying on manually crafted rules. Face detection plays a pivotal role in safeguarding society, identifying wrongdoers, and bolstering community safety. However, challenges persist, particularly in achieving high accuracy with face recognition control systems in uncontrolled environments and real-time scenarios, such as intersections. In response to these challenges, our paper introduces a novel model that harnesses a combination of deep convolutional neural networks (CNNs) with self-attention mechanisms. Our experimental results demonstrate that this model can rapidly detect whole-scale images in a single forward pass. Notably, our proposed method achieved an outstanding accuracy rate of 99.7%. In comparison to existing state-of-the-art methods, our approach exhibits superior efficiency. This work showcases how the integration of IoT and DL, particularly with the use of a CNN with self-attention, outperforms other CNN-based approaches in terms of both speed and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Moreira, D.C.; Pereira, E.T.; Alvarez, M.: PEDA 376K: a novel dataset for deep-learning based porn-detectors. In: 2020 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2020, July).

  2. Potluri, S.; Mohanty, S.N.: An efficient scheduling mechanism for IoT-based home automation system. Int. J. Electron. Bus. 16(2), 147–156 (2021)

    Article  Google Scholar 

  3. Karamizadeh, S.; Abdullah, S.M.; Shayan, J.; Zamani, M.; Nooralishahi, P.: Taxonomy of filtering based illumination normalization for face recognition. J. Telecommun. Electron. Comput. Eng. JTEC 9(1–5), 135–139 (2017)

    Google Scholar 

  4. Xu, W.; Parvin, H.; Izadparast, H.: Deep learning neural network for unconventional imageimagesification. Neural. Process. Lett. 52(1), 169–185 (2020)

    Article  Google Scholar 

  5. Singh, R.P.; Javaid, M.; Haleem, A.; Suman, R.: Internet things (IoT) applications to fight against of COVID-19 pandemic. Diabetes Metab. Syndr. Clin. Res. Rev. 14, 521–524 (2020)

    Article  Google Scholar 

  6. Hossain, M.S.; Muhammad, G.: Emotion recognition using deep learning approach from audio-visual emotional big data. Inf. Fusion 49, 69–78 (2019)

    Article  Google Scholar 

  7. Tarasiewicz, T.; Nalepa, J.; Kawulok, M.: Skinny: a lightweight U-net for skin detection and segmentation. In: 2020 IEEE International Conference on Image Processing (ICIP), pp. 2386–2390. IEEE. (2020, October)

  8. Patel, S.; Kumar, P.; Garg, S.; Kumar, R.: Face Recognition based smart attendance system using IOT. Int. J. Comput. Sci. Eng. 6(5), 871–877 (2018)

    Google Scholar 

  9. Bengio, Y.; Lecun, Y.; Hinton, G.: Deep learning for AI. Commun. ACM 64(7), 58–65 (2021)

    Article  Google Scholar 

  10. Karamizadeh, S.: New Method to Improve Illumination Variations in Adult Images Based on Fuzzy Deep Neural Network. J. Inf. Commun. Technol. 41(41), 1 (2020)

    Google Scholar 

  11. Chen, S.: Zhang, L.; Feng, R.; Zhang, C.: High-resolution remote sensing image classification with RmRMR-enhanced bag of visual words. In: Computational Intelligence and Neuroscience (2021)

  12. Schroff, F.; Kalenichenko, D.; Philbin, J.: FaceNET: a unified embedding for face recognition and clustering. In: CVPR, pp. 815–823 (2015)

  13. Sun, Y.; Wang, X.; Tang, X.: Hybrid deep learning for computing face similarities. Int’l Conf. Comput. Vis. 38(10), 1997–2009 (2013)

    Google Scholar 

  14. Singh, R.; Om, H.: Newborn face recognition using deep convolutional neuralnetwork. Multimedia Tools Appl. 76(18), 19005–19015 (2017)

    Article  Google Scholar 

  15. Lu, Z.; Jiang, X.; Kot, A.: Deep coupled resnet for low-resolution face recognition. IEEE Signal Process. Lett. 25(4), 526–530 (2018)

    Article  Google Scholar 

  16. Wehrmann, J.; Barros, R.C.: Movie genre classification: A multi-label approach based on convolutions through time. Appl. Soft Comput. 61, 973–982 (2017)

    Article  Google Scholar 

  17. Wati, D.A.R.; Abadianto, D.: Design of face detection and recognition system for smart home security application. In: 2017 2nd International Conferences on Information Technology, Information Systems and Electrical Engineering, Yogyakarta, Indonesia, Feb. 2018

  18. Chuimurkar, R.; Bagdi, V.: Smart surveillance security & monitoring system using Raspberry PI and PIR sensor. Int. J. Sci. Eng. Appl. 2(1) (2016)

  19. Hou, L.; et al.: Internet of things cloud: architecture and implementation. IEEECommun. Mag. 54(12), 32–39 (2016)

    Article  Google Scholar 

  20. Parkhi, O.M.; Vedaldi, A.; Zisserman, A.; et al.: Deep face recognition. In: BMVC 1, p. 6 (2015)

  21. Karamizadeh, S.; Shojae Chaeikar, S.; Jolfaei, A.: Adult content image recognition by Boltzmann machine limited and deep learning. Evol. Intell. 16, 1185–1194 (2022)

    Article  Google Scholar 

  22. Hu, H.; Shah, S.A.A.; Bennamoun, M.; Molton, M.: 2D and 3D face recognitionusing convolutional neural network. In: TENCON 2017-2017 IEEE Region 10 conference, Penang, pp. 133–132 (2017)

  23. Simón, M.; et al.: Improved RGB-d-t based face recognition. IET Biometr. 5, 297–304 (2016)

    Article  Google Scholar 

  24. Sun, Y.; Wang, X.; Tang, X.: Deep learning face representation from predicting 10,000 classes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2014)

  25. Gong, S.; Liu, X.; Jain, A.: DebFace: de-biasing face recognition. Accessed on Feb. 25, 2020

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sasan Karamizadeh.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Karamizadeh, S., Moazen, M., Zamani, M. et al. Enhancing IoT-Based Smart Home Security Through a Combination of Deep Learning and Self-Attention Mechanism. Arab J Sci Eng (2024). https://doi.org/10.1007/s13369-023-08685-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s13369-023-08685-w

Keywords

Navigation