Skip to main content
Log in

Distributed computing and big data techniques for efficient fault detection and data management in wireless networks

  • Published:
Optical and Quantum Electronics Aims and scope Submit manuscript

Abstract

Due to social media, internet websites, and cellular networks, the world is undergoing a digital avalanche. Extensive information will mask this pattern, emerging quickly and in many ways. Big data analytics will filter large amounts of unprocessed data to provide more manageable data to help parties make intelligent decisions. This research demonstrates how large geographical datasets are essential to numerous cutting-edge wireless communication technologies. We also argue that geospatial and spatio-temporal concerns matter differently in massive datasets than interpersonal issues. We present three significant geospatial information use cases with distinct architectural and analytical challenges. Next, using map-based Reduce computing, we offer our research on developing highly available multi-processing systems for geographical information on Hadoop. Our results show that Hadoop allows for highly extendable spatial data analysis methodologies. However, designing such applications requires specialized skills, stressing the need for simpler alternatives.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

Not Applicable.

References

  • Borkar, V.R., Carey, M.J., Li, C.: Big data platforms, XRDS: crossroads. ACM Magaz. Stud. 19, 44–49 (2012)

    Google Scholar 

  • Gani, A., Siddiqa, S., Shamshirband, F.: Hanum, A survey on indexing techniques for big data: taxonomy and performance evaluation. Know. Inf. Syst. 46, 241–284 (2016)

    Article  Google Scholar 

  • Hapsari, W., et al.: Minimization of drive tests solution in 3GPP. IEEE Commun. Mag.commun. Mag. 50(6), 28–36 (2012)

    Article  Google Scholar 

  • Kachhoria, R., Jaiswal, S., Lokhande, M., Rodge, J.: Lane detection and path prediction in autonomous vehicle using deep learning. In: Intelligent edge computing for cyber physical applications, 111–127 (2023)

  • Kandavalli, S.R., Edberk, A.S., Rajendran, D.K., Rajagopal, V.: A progressive review on wire arc additive manufacturing: mechanical properties, metallurgical and defect analysis. Adv. Addit. Manuf. Processes 1, 178 (2021). https://doi.org/10.2174/9789815036336121010014

    Article  Google Scholar 

  • Landset, S., Khoshgoftaar, T.M., Richter, A.N., Hasanin, T.: A survey of open source tools for machine learning with big data in the Hadoop ecosystem. J. Big Data 2, 1–36 (2015)

    Article  Google Scholar 

  • Lee, K., Jung, K., Park, J., Kwon, D.: ARLS: a MapReduce-based output analysis tool for large-scale simulations. Adv. Eng. Softw.softw. 95, 28–37 (2016)

    Article  Google Scholar 

  • Lemoudden, M., Ouahidi, B.E.: Managing cloud-generated logs using big data technologies. In: 2015 International conference on wireless networks and mobile communications (WINCOM), IEEE, pp. 1–7 (2015)

  • Leonid, T.T., Kanna, H., Claudia Christy, V.J., Hamritha, A.S., Lokesh, C.: Human wildlife conflict mitigation using YOLO algorithm. In: 2023 Eighth international conference on science technology engineering and mathematics (ICONSTEM), Chennai, India, 2023, pp. 1–7, https://doi.org/10.1109/ICONSTEM56934.2023.10142629.

  • Mainetti, L., Patrono, L., Vilei, A.: Evolution of wireless sensor networks towards the internet of things: a survey. In: Proceedings of 19th international conference on software, telecommunications and computer networks, pp. 1–6 (2011)

  • Markkandan, S., Logeshwaran, R., Venkateswaran, N.: Analysis of precoder decomposition algorithms for MIMO system design. IETE J. Res. 69, 1–8 (2021). https://doi.org/10.1080/03772063.2021.1920848

    Article  Google Scholar 

  • Pyne, S., Rao, B.P., Rao, S.B.: Big data analytics: methods and applications. Springer, Berlin (2016)

    Google Scholar 

  • Qadir, J., Ahad, N., Mushtaq, E., Bilal, M.: SDNs, clouds, and big data: new opportunities. In: 2014 12th international conference on frontiers of information technology, IEEE, pp. 28–33 (2014)

  • Sayrac, B., et al.: Cognitive radio systems specific for IMT systems: operator’s view and perspectives. Telecommun. Policy 37(2–3), 154–166 (2013)

    Article  Google Scholar 

  • Shemer, J., Neches, P.: The genesis of a database computer. Computer 17, 42–56 (1984)

    Article  Google Scholar 

  • Singh, D., Reddy, C.K.: A survey on platforms for big data analytics. J. Big Data 2, 8 (2014). https://doi.org/10.1186/s40537-014-0008-6

    Article  Google Scholar 

  • Vijayan, V.P., Juvanna, I., Maheshwara Rao, V.V.R., Raseena, K.M., Sundareswari, K., Jayachitra, S.: Intelligent exploration strategy for a mobile robot to reduce the repeated searches in an unknown environment. Int. J. Syst. Assur. Eng. Manag.Manag., 1-62022). https://doi.org/10.1007/s13198-022-01776-1

  • White, T.: Hadoop: the definitive guide. O'Reilly Media, Inc., (2012)

Download references

Funding

Not Applicable.

Author information

Authors and Affiliations

Authors

Contributions

Dr AK: Contributed to conceptualization, literature review, data analysis, and manuscript writing. RPN: Provided guidance, conceptualization, methodology development, and manuscript revisions. SG: Assisted with research design, data collection, analysis, and manuscript revisions. Dr. SA: Involved in data preprocessing, algorithm implementation, visualization, and manuscript writing. Dr. PSR: Supported in data collection, AI algorithm implementation, evaluation, and manuscript revisions. DS: Assisted with data analysis, visualization, and manuscript writing.

Corresponding author

Correspondence to Ajmeera Kiran.

Ethics declarations

Conflict of interest

The authors have no competing interests to declare relevant to this article's content.

Human and animal rights

This study does not include human participants or animals; hence, any informed consent or animal welfare statement does not apply to this study.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kiran, A., Renjith, P.N., Gupta, S. et al. Distributed computing and big data techniques for efficient fault detection and data management in wireless networks. Opt Quant Electron 55, 1200 (2023). https://doi.org/10.1007/s11082-023-05502-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11082-023-05502-4

Keywords

Navigation