Skip to main content
SpringerLink
Log in

Toward Big Data Various Challenges and Trending Applications

  • Conference paper
  • First Online:
Cyber Security, Privacy and Networking

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 370))

  • 391 Accesses

Abstract

With  the continuous growth in the data and its use as a resource for analytic knowledge continues to help companies develop, the need for innovative approaches, tools, and strategies to extract actionable insights is becoming increasingly important. The data collected from myriad sources like social media, search engines, and the Internet of Things has developed substantial opportunities concerning the business to business industrial organizations. Big data (BD) computing is classified as batch and stream computing based on the processing types. Batch computing is performed when data is at rest, whereas real-time computing is performed when data is in motion. In the present era, real-time stream processing is in demand as the massive data generated has to be handled speedily to meet the business or organization requirements. BD analytics is used to get the big insight from this data. However, cleansing, interpreting, and analyzing such massive databases present hurdles in marketing, particularly in terms of making real-time decisions. This paper throws light on the various issues and challenges associated to BD. Most of the challenges are associated to the preprocessing phase of BD. It also presents the diverse applications of BD.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Tsai CW, Lai CF, Chao HC, Vasilakos AV (2015) Big data analytics: a survey. J Big Data 2:1–32. https://doi.org/10.1186/s40537-015-0030-3

    Article  Google Scholar 

  2. Al-Taie MZ, Kadry S, Lucas JP (2019) Online data preprocessing: a case study approach. Int J Electr Comput Eng 9:2620–2626. https://doi.org/10.11591/ijece.v9i4.pp2620-2626

  3. Najafabadi MM, Villanustre F, Khoshgoftaar TM, Seliya N, Wald R, Muharemagic E (2015) Deep learning applications and challenges in big data analytics. J Big Data 2:1–21. https://doi.org/10.1186/s40537-014-0007-7

    Article  Google Scholar 

  4. Galetsi P, Katsaliaki K, Kumar S (2020) Big data analytics in health sector: theoretical framework, techniques and prospects. Int J Inf Manage 50:206–216. https://doi.org/10.1016/j.ijinfomgt.2019.05.003

    Article  Google Scholar 

  5. Kotiyal B, Kumar A, Pant B, Goudar RH (2013) Big data: mining of log file through Hadoop. In: Proceedings of the international conference on human-computer interaction, ICHCI 2013, pp 1–7. https://doi.org/10.1109/ICHCI-IEEE.2013.6887797

  6. Mohamed A, Najafabadi MK, Wah YB, Zaman EAK, Maskat R (2020) The state of the art and taxonomy of big data analytics: view from new big data framework. Springer, Netherlands. https://doi.org/10.1007/s10462-019-09685-9

  7. Guan Z, Ji T, Qian X, Ma Y, Hong X (2017) A survey on big data pre-processing. In: 5th international conference on applied computing and information technology, pp 241–247. https://doi.org/10.1109/ACIT-CSII-BCD.2017.49

  8. ur Rehman MH, Liew CS, Abbas A, Jayaraman PP, Wah TY, Khan SU (2016) Big data reduction methods: a survey. Data Sci Eng 1:265–284. https://doi.org/10.1007/s41019-016-0022-0

  9. Ezzine I, Benhlima L (2018) A study of handling missing data methods for big data. In: Colloquium in information science and technology CIST, Oct 2018, pp 498–501. https://doi.org/10.1109/CIST.2018.8596389

  10. Fernández A, del Río S, Chawla NV, Herrera F (2017) An insight into imbalanced big data classification: outcomes and challenges. Complex Intell Syst 3:105–120. https://doi.org/10.1007/s40747-017-0037-9

    Article  Google Scholar 

  11. Adnan K, Akbar R (2019) An analytical study of information extraction from unstructured and multidimensional big data. J Big Data 6:1–38. https://doi.org/10.1186/s40537-019-0254-8

    Article  Google Scholar 

  12. L’Heureux A, Grolinger K, Elyamany HF, Capretz MAM (2017) Machine learning with big data: challenges and approaches. IEEE Access 5:7776–7797. https://doi.org/10.1109/ACCESS.2017.2696365

    Article  Google Scholar 

  13. Hariri RH, Fredericks EM, Bowers KM (2019) Uncertainty in big data analytics: survey, opportunities, and challenges. J Big Data 6:1–16. https://doi.org/10.1186/s40537-019-0206-3

    Article  Google Scholar 

  14. Acharjya DP, Ahmed K (2016) A survey on big data analytics: challenges, open research issues and tools. Int J Adv Comput Sci Appl 7:511–518. https://doi.org/10.14569/ijacsa.2016.070267

  15. Marjani M, Nasaruddin F, Gani A, Karim A, Hashem IAT, Siddiqa A, Yaqoob I (2017) Big IoT data analytics: architecture, opportunities, and open research challenges. IEEE Access 5:5247–5261. https://doi.org/10.1109/ACCESS.2017.2689040

    Article  Google Scholar 

  16. Valenzuela-Escárcega MA, Hahn-Powell G, Hicks T, Surdeanu M (2015) A domain-independent rule-based framework for event extraction. In: ACL-IJCNLP 2015—53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing system demonstrations proceeding, pp 127–132. https://doi.org/10.3115/v1/p15-4022

  17. Wani MA, Jabin S (2018) Big data: issues, challenges, and techniques in business intelligence. In: Advances in intelligent systems and computing. Springer Verlag, pp 613–628. https://doi.org/10.1007/978-981-10-6620-7_59

  18. Maqbool Q, Habib A (2019) Big data challenges. Control Eng 66:33. https://doi.org/10.4172/2324-9307.1000133

    Article  Google Scholar 

  19. Taleb I, Serhani MA, Dssouli R (2018) Big data quality: a survey. In: IEEE international congress on big data. BigData congress 2018—part of the 2018 IEEE world congress on services. IEEE, pp 166–173. https://doi.org/10.1109/BigDataCongress.2018.00029

  20. Chahal H, Jyoti J, Wirtz J (2018) Understanding the role of business analytics: some applications. Springer, Singapore. https://doi.org/10.1007/978-981-13-1334-9

  21. García-Gil D, Luengo J, García S, Herrera F (2019) Enabling smart data: noise filtering in big data classification. Inf Sci (Ny) 479:135–152. https://doi.org/10.1016/j.ins.2018.12.002

    Article  Google Scholar 

  22. Alam S, Yao N (2019) The impact of preprocessing steps on the accuracy of machine learning algorithms in sentiment analysis. Comput Math Organ Theory 25:319–335. https://doi.org/10.1007/s10588-018-9266-8

    Article  Google Scholar 

  23. Keswani B (2018) Enhanced approach to attain competent big data pre-processing. In: 4th international conference on cyber security, pp 524–527

    Google Scholar 

  24. Gandomi A, Haider M (2015) Beyond the hype: big data concepts, methods, and analytics. Int J Inf Manage 35:137–144. https://doi.org/10.1016/j.ijinfomgt.2014.10.007

    Article  Google Scholar 

  25. Yaqoob I, Hashem IAT, Gani A, Mokhtar S, Ahmed E, Anuar NB, Vasilakos AV (2016) Big data: from beginning to future. Int J Inf Manage 36:1231–1247. https://doi.org/10.1016/j.ijinfomgt.2016.07.009

    Article  Google Scholar 

  26. Sivarajah U, Kamal MM, Irani Z, Weerakkody V (2017) Critical analysis of big data challenges and analytical methods. J Bus Res 70:263–286. https://doi.org/10.1016/j.jbusres.2016.08.001

    Article  Google Scholar 

  27. Jabbar A, Akhtar P, Dani S (2019) Real-time big data processing for instantaneous marketing decisions: a problematization approach. Ind Mark Manag 1. https://doi.org/10.1016/j.indmarman.2019.09.001

  28. Kolajo T, Daramola O, Adebiyi A (2019) Big data stream analysis: a systematic literature review. J Big Data 6:1–30. https://doi.org/10.1186/s40537-019-0210-7

    Article  Google Scholar 

  29. Krawczyk B (2016) Learning from imbalanced data: open challenges and future directions. Prog Artif Intell 5:221–232. https://doi.org/10.1007/s13748-016-0094-0

    Article  Google Scholar 

  30. Madaan A, Sharma V, Pahwa P, Das P, Sharma C (2018) Hadoop: solution to unstructured data handling. Adv Intell Syst Comput 654:47–54. https://doi.org/10.1007/978-981-10-6620-7_6

    Article  Google Scholar 

  31. Amudhavel J, Padmapriya V, Gowri V, Lakshmipriya K, PremKumar K, Thiyagarajan B (2015) Perspectives, motivations and implications of big data analytics. In: ACM international conference proceeding series, pp 1–5. https://doi.org/10.1145/2743065.2743099

  32. Sharma S, Rathee G, Saini H (2018) Big data analytics for crop prediction mode using optimization technique. In: 5th international conference on parallel, distributed and grid computing. IEEE, pp 760–764. https://doi.org/10.1109/PDGC.2018.8746001

  33. Balachandran BM, Prasad S (2017) Challenges and benefits of deploying big data analytics in the cloud for business intelligence. Procedia Comput Sci 1112–1122. https://doi.org/10.1016/j.procs.2017.08.138

  34. Shatnawi MQ, Yassein MB, Abuein Q, Nsuir L (2019) Big data analytics tools and applications: survey. In: ACM international conference proceeding series, pp 1–4. https://doi.org/10.1145/3368691.3368741

  35. Lv Z, Song H, Basanta-Val P, Steed A, Jo M (2017) Next-generation big data analytics: state of the art, challenges, and future research topics. IEEE Trans Ind Inform 13:1891–1899. https://doi.org/10.1109/TII.2017.2650204

    Article  Google Scholar 

  36. Desai PV (2018) A survey on big data applications and challenges. In: Proceedings of the international conference on inventive communication and computational technologies ICICCT 2018. IEEE, pp 737–740. https://doi.org/10.1109/ICICCT.2018.8472999

  37. Saggi MK, Jain S (2018) A survey towards an integration of big data analytics to big insights for value-creation. Inf Process Manag 54:758–790. https://doi.org/10.1016/j.ipm.2018.01.010

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Gurukul Kangri Vishwavidyalaya, 60, Rajpur Road, Dehradun, Uttarakhand, India

    Bina Kotiyal & Heman Pathak

Authors
  1. Bina Kotiyal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heman Pathak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bina Kotiyal .

Editor information

Editors and Affiliations

  1. University of Cincinnati, Cincinnati, OH, USA

    Dharma P. Agrawal

  2. State University of Rio de Janeiro, Rio de Janeiro, Brazil

    Nadia Nedjah

  3. Department of Computer Science and Information Engineering, Asia University, Taichung, Taiwan

    B. B. Gupta

  4. University of Murcia, Murcia, Spain

    Gregorio Martinez Perez

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kotiyal, B., Pathak, H. (2022). Toward Big Data Various Challenges and Trending Applications. In: Agrawal, D.P., Nedjah, N., Gupta, B.B., Martinez Perez, G. (eds) Cyber Security, Privacy and Networking. Lecture Notes in Networks and Systems, vol 370. Springer, Singapore. https://doi.org/10.1007/978-981-16-8664-1_20

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-8664-1_20

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-8663-4

  • Online ISBN: 978-981-16-8664-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation