Skip to main content
SpringerLink
Log in

Self-attention-based multimodality convolutional volcano eruption network based indoor localization and wayfinding for blind people

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The ability to navigate and precisely locate a visually challenged people within a building is significantly important for a wide variety of location services and public safety. Also, Indoor Localization (IL) for blind people is an open research challenge and the individual localization algorithm failed to achieve accurate location results. To overcome this problem, in this research work, a novel hybrid indoor localization strategy using a WiFi fingerprint database is proposed. It includes two stages such as Offline Phase (OP) and Online Phase (OnP). In the OF, this system employs a Min-Max Normalization approach to normalize the fingerprint database. Then, the Fractional Sparse Fuzzy C-Means Clustering method (FSFCC) is proposed to retrieve the Validation Set (VS) from all the Training Sets (TS) in the ratio of 4:1. In the online stage, the received signal strength indicator (RSSI) data value in dBm is reconstructed and key features such as longitude, latitude, floor ID and building ID are extracted by using Self-Attention-Based Multimodality Convolutional Volcano Eruption Network (Se-AMCVE). Hence, the weight parameters of the proposed network are optimized by applying Volcano Eruption Optimization (VEO). Finally, the accurate estimated location data is the outcome of the proposed network which helps the blind to find the path. The achieved accuracy is 94%, mean positioning error is 3.01 m and floor hit rate is 97.08% which is implemented in the python flask framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig 15
Fig 16
Fig 17
Fig 18
Fig 19

Similar content being viewed by others

References

  1. Zhou M, Long Y, Zhang W, Pu Q, Wang Y, Nie W, He W (2021) Adaptive genetic algorithm-aided neural network with channel state information tensor decomposition for indoor localization. IEEE Trans Evolut Comput 25(5):913–927

    Article  Google Scholar 

  2. Chen M, Liu K, Ma J, Zeng X, Dong Z, Tong G, Liu C (2020) MoLoc: Unsupervised fingerprint roaming for device-free indoor localization in a mobile ship environment. IEEE Internet Things J 7(12):11851–11862

    Article  Google Scholar 

  3. del-Blanco CR, Carballeira P, Jaureguizar F, García N (2021) Robust people indoor localization with omnidirectional cameras using a grid of spatial-aware classifiers. Signal Process Image Commun 93:116135

    Article  Google Scholar 

  4. Gharghan SK, Al-Kafaji RD, Mahdi SQ, Zubaidi SL, Ridha HM (2022) Indoor Localization for the Blind Based on the Fusion of a Metaheuristic Algorithm with a Neural Network Using Energy-Efficient WSN. Arab J Sci Eng:1-28.

  5. Hoang MT, Yuen B, Ren K, Dong X, Lu T, Westendorp R, Reddy K (2020) A CNN-LSTM quantifier for single access point CSI indoor localization. arXiv preprint arXiv:2005.06394

  6. Zhu X, Qu W, Qiu T, Zhao L, Atiquzzaman M, Wu DO (2020) Indoor intelligent fingerprint-based localization: Principles, approaches and challenges. IEEE Commun Surv Tutor 22(4):2634–2657

    Article  Google Scholar 

  7. Zhang Y, Wu C, Chen Y (2021) A low-overhead indoor positioning system using CSI fingerprint based on transfer learning. IEEE Sensors J 21(16):18156–18165

    Article  Google Scholar 

  8. Sulaiman B, Natsheh E, Tarapiah S (2022) Towards a better indoor positioning system: A location estimation process using artificial neural networks based on a semi-interpolated database. Pervasive Mob Comput 81:101548

    Article  Google Scholar 

  9. Shu M, Chen G, Zhang Z (2022) Efficient image-based indoor localization with MEMS aid on the mobile device. ISPRS J Photogramm Remote Sens 185:85–110

    Article  Google Scholar 

  10. Kim HG, Kim GY (2020) Deep neural network-based indoor emergency awareness using contextual information from sound, human activity, and indoor position on mobile device. IEEE Trans on Consum Electr 66(4):271–278

    Article  Google Scholar 

  11. Sun M, Wang Y, Xu S, Yang H, Zhang K (2021) Indoor geomagnetic positioning using the enhanced genetic algorithm-based extreme learning machine. IEEE Trans Instrum Meas 70:1–11

    Google Scholar 

  12. Zhang L, Wang Z, Meng X, Fang C, Liu C (2021) Noise reduction for radio map crowdsourcing building in WLAN indoor localization system. EURASIP J Adv Signal Process 2021:1–22

    Article  Google Scholar 

  13. Dou F, Lu J, Xu T, Huang CH, Bi J (2020) A bisection reinforcement learning approach to 3-D indoor localization. IEEE Int Things J 8(8):6519–6535

    Article  Google Scholar 

  14. Zhang Z, Yu Y, Chen L, Chen R (2023) Hybrid Indoor Positioning System Based on Acoustic Ranging and Wi-Fi Fingerprinting under NLOS Environments. Remote Sens 15(14):3520

    Article  Google Scholar 

  15. Wang Y, Lei Y, Zhang Y, Yao L (2021) A robust indoor localization method with calibration strategy based on joint distribution adaptation. Wirel Netw 27:1739–1753

    Article  Google Scholar 

  16. Fan S, Wu Y, Han C, Wang X (2021) SIABR: A structured intra-attention bidirectional recurrent deep learning method for ultra-accurate terahertz indoor localization. IEEE J Selected Areas Commun 39(7):2226–2240

    Article  Google Scholar 

  17. Labinghisa BA, Lee DM (2021) Neural network-based indoor localization system with enhanced virtual access points. J Supercomput 77:638–651

    Article  Google Scholar 

  18. Zhang L, Cheng M, Xiao Z, Zhou L, Zhou J (2020) Adaptable map matching using PF-net for pedestrian indoor localization. IEEE Commun Lett 24(7):1437–1440

    Article  Google Scholar 

  19. Koike-Akino T, Wang P, Pajovic M, Sun H, Orlik PV (2020) Fingerprinting-based indoor localization with commercial MMWave WiFi: A deep learning approach. IEEE Access 8:84879–84892

    Article  Google Scholar 

  20. Chen X, Li H, Zhou C, Liu X, Wu D, Dudek G (2022) Fidora: Robust WiFi-based indoor localization via unsupervised domain adaptation. IEEE Internet Things J 9(12):9872–9888

    Article  Google Scholar 

  21. Zhu Q, Xiong Q, Wang K, Lu W, Liu T (2020) Accurate WiFi-based indoor localization by using fuzzy classifier and mlps ensemble in complex environment. J Franklin Inst 357(3):1420–1436

    Article  Google Scholar 

  22. Jia B, Qiao W, Zong Z, Liu S, Hijji M, Del Ser J, Muhammad K (2022) A fingerprint-based localization algorithm based on LSTM and data expansion method for sparse samples. Future Gener Comput Syst 137:380–393

    Article  Google Scholar 

  23. Kulkarni O, Jena S, Ravi Sankar V (2020) MapReduce framework based big data clustering using fractional integrated sparse fuzzy C means algorithm. IET Image Process 14(12):2719–2727

    Article  Google Scholar 

  24. Jia M, Gao Y, Li S, Yue J, Ye M (2021) An explicit self-attention-based multimodality CNN in-loop filter for versatile video coding. Multimed Tools Appl:1-5

  25. Hosseini E, Sadiq AS, Ghafoor KZ, Rawat DB, Saif M, Yang X (2021) Volcano eruption algorithm for solving optimization problems. Neural Comput Appl 33:2321–2337

    Article  Google Scholar 

  26. Qin F, Zuo T, Wang X (2021) Ccpos: Wifi fingerprint indoor positioning system based on cdae-cnn. Sensors 21(4):1114

    Article  Google Scholar 

  27. Ma L, Cao N, Feng X, Zhang J, Yan J (2022) Indoor positioning algorithm based on reconstructed observation model and particle filter. ISPRS Int J Geo-Inf 11(1):71

    Article  Google Scholar 

  28. Duong-Bao N, He J, Thi LN, Nguyen-Huu K, Lee SW (2022) A Novel Valued Tolerance Rough Set and Decision Rules Method for Indoor Positioning Using WiFi Fingerprinting. Sensors 22(15):5709

    Article  Google Scholar 

  29. Song X, Fan X, He X, Xiang C, Ye Q, Huang X, Fang G, Chen LL, Qin J, Wang Z (2019) Cnnloc: Deep-learning based indoor localization with wifi fingerprinting. In 2019 IEEE SmartWorld, Ubiquitous Intell Comput, Adva & Trusted Comput, Scalable Comput Commun, Cloud & Big Data Comput, Internet of People and Smart City Innov (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) (pp. 589-595). IEEE

  30. Al-Madani B, Orujov F, Maskeliūnas R, Damaševičius R, Venčkauskas A (2019) Fuzzy logic type-2 based wireless indoor localization system for navigation of visually impaired people in buildings. Sensors 19(9):2114

    Article  Google Scholar 

  31. Torres-Sospedra J, Montoliu R, Martínez-Usó A, Avariento JP, Arnau TJ, Benedito-Bordonau M, Huerta J (2014) UJIIndoorLoc: A new multi-building and multi-floor database for WLAN fingerprint-based indoor localization problems. In 2014 Int Conf on Indoor Positioning and Indoor Navigation (IPIN) (pp. 261-270). IEEE

  32. Njima W, Bazzi A, Chafii M (2022) DNN-based indoor localization under limited dataset using GANs and semi-supervised learning. IEEE Access 10:69896–69909

    Article  Google Scholar 

  33. Wang C, Luo J, Liu X, He X (2021) Secure and reliable indoor localization based on multitask collaborative learning for large-scale buildings. IEEE Int Things J 9(22):22291–22303

    Article  Google Scholar 

  34. Alitaleshi A, Jazayeriy H, Kazemitabar J (2023) EA-CNN: A smart indoor 3D positioning scheme based on Wi-Fi fingerprinting and deep learning. Eng Appl Artificial Intell 117:105509

    Article  Google Scholar 

  35. Agah N, Evans B, Meng X, Xu H (2023) A Local Machine Learning Approach for Fingerprint-based Indoor Localization. In Southeast Con 2023 (pp. 240-245). IEEE

  36. Hou C, Xie Y, Zhang Z (2022) FCLoc: A Novel Indoor Wi-Fi Fingerprints Localization Approach to Enhance Robustness and Positioning Accuracy. IEEE Sensors J 23(7):7153–7167

    Article  Google Scholar 

  37. Njima W, Bazzi A, Chafii M (2022) DNN-based indoor localization under limited dataset using GANs and semi-supervised learning. IEEE Access 10:69896–69909

    Article  Google Scholar 

  38. Laska M, Blankenbach J (2021) Deeplocbox: Reliable fingerprinting-based indoor area localization. Sensors 21(6):2000

    Article  Google Scholar 

  39. Ebaid E, Navaie K (2022) Optimum NN Algorithms Parameters on the UJIIndoorLoc for Wi-Fi Fingerprinting Indoor Positioning Systems. In 2022 32nd International Telecommun Netw Appl Conference (ITNAC) (pp. 280-286). IEEE

Download references

Data availability statements

Data sharing not applicable to this article as no datasets were generated or analysed during the current study.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Kalasalingam Academy of Research and Education, Krishnankoil, Tamilnadu, 626126, India

    Thandu Nagaraju & R. Murugeswari

Authors
  1. Thandu Nagaraju
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. R. Murugeswari
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All the authors have contributed equally to the work.

Corresponding author

Correspondence to Thandu Nagaraju.

Ethics declarations

Conflict of interest

The authors declare that they have no potential conflict of interest.

Ethical approval

All applicable institutional and/or national guidelines for the care and use of animals were followed.

Informed consent

For this type of analysis formal consent is not needed.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nagaraju, T., Murugeswari, R. Self-attention-based multimodality convolutional volcano eruption network based indoor localization and wayfinding for blind people. Multimed Tools Appl 83, 59355–59378 (2024). https://doi.org/10.1007/s11042-023-17274-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-17274-w

Keywords

Search

Navigation