Skip to main content

The Nexus Between Big Data and Decision-Making: A Study of Big Data Techniques and Technologies

  • Conference paper
  • First Online:
Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2021) (AICV 2021)

Abstract

Big Data (BD) has shifted the paradigm of conventional data analysis with the exploitation of emerging technologies. Analysis using BD contributes to foreseeing and pulling out value from large data, exposing covert information, and expediting the decision-making process. This study highlights the impression and effect on decision-making through BD. The investigation’s rationale is to dig deep insight into the buzzword to enable stakeholders to understand the challenges and opportunities that BD has bought in the current business scenarios. It also discusses applications of BD-influenced decision-making, along with state-of-the-art BD techniques and technologies. The study is a review article based on the research articles, conference proceedings, books, and web articles available on Google Scholar and Google from the period between 2010 and 2020. Due to BD’s extreme importance, the available techniques and technologies should facilitate effective data collection, storage, analysis, and visualization. Every opportunity comes with greater challenges; this paper summarizes the strengths and weaknesses of different tools associated with three broad categories of BD technologies. This enables researchers to quickly glance at the available tools’ pros and cons in one only place. This emerging field is still very young and premature. Various techniques and technologies have been designed to deal with such humungous data, but they still offer minimal efficacy to deal with BD problems completely. This is high time now that technologists, researchers, and governments pay significant attention to this vast and evolving field by investing their time and money in developing efficient tools that maximize value from it. BD also means big opportunities, big challenges, and big systems; therefore, it also requires big attention from researchers to overcome the research gaps that exist in this big field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Miller, H.G., Mork, P.: From data to decisions: a value chain for big data. IT Prof. 15(1), 57–59 (2013)

    Article  Google Scholar 

  2. Elgendy, N., Elragal, A.: Big data analytics in support of the decision making process. Procedia Comput. Sci. 100, 1071–1084 (2016)

    Article  Google Scholar 

  3. Li, G.J., Cheng, X.Q.: Research status and scientific thinking of big data. Bull. Chin. Acad. Sci. 27(6), 647–657 (2012)

    Google Scholar 

  4. Renu, R.S.M.G.K.A.: Use of big data and knowledge discovery to create data backbones for decision support systems. Procedia Comput. Sci. 20, 446–453 (2013)

    Article  Google Scholar 

  5. Poleto, T., de Carvalho, V.D.H., Costa A.P.C.S.: The roles of big data in the decision-support process: an empirical investigation. In: International Conference on Decision Support System Technology, Cham (2015)

    Google Scholar 

  6. Berman, J.J.: Principles of big data preparing, sharing, and analyzing complex information. Elsevier (2013)

    Google Scholar 

  7. Chen, M., Mao, S., Liu, Y.: Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)

    Article  Google Scholar 

  8. McKinsey Global Institute: Big Data: the next frontier for innovation, competition, and productivity. McKinsey & Company (2011)

    Google Scholar 

  9. Ward, J.S., Barker, A.: Undefined by data: a survey of big data definitions. arXiv preprint, arXiv:1309.5821 (2013)

  10. De Mauro, A., Greco, M., Grimaldi, M.: A formal definition of big data based on its essential features. Libr. Rev. 65(3), 122–135 (2016)

    Article  Google Scholar 

  11. Gantz, J., Reinsel, D.: Extracting value from chaos. IDC iView 1142(2011), 1–12 (2011)

    Google Scholar 

  12. Dumbill, E.: Making sense of big data. Big Data 1(1), (2013)

    Google Scholar 

  13. Prakashbhai, P.A., Pandey H.M.: Inference patterns from big data using aggregation, filtering and tagging - a survey. In: 5th International Conference - The Next Generation Information Technology Summit (Confluence) (2014)

    Google Scholar 

  14. Kościelniaka, H., Puto, A.: BIG DATA in decision making processes of enterprises. Procedia Comput. Sci. 65, 1052–1058 (2015)

    Article  Google Scholar 

  15. Pauleen, D.J., Wang, W.Y.: Does big data mean big knowledge? KM perspectives on big data and analytics. J. Knowl. Manag. 21(1), 1–6 (2017)

    Article  Google Scholar 

  16. Gandomi, A., Haider, M.: Beyond the hype: big data concepts, methods, and analytics. Int. J. Inf. Manag. 35(2), 137–144 (2015)

    Article  Google Scholar 

  17. Janssen, M., van der Voort, H., Wahyudi, A.: Factors influencing big data decision-making quality. J. Bus. Res. 70, 338–345 (2017)

    Article  Google Scholar 

  18. Huang, L., Wu, C., Wang, B., Ouyang, Q.: Big-data-driven safety decision-making: a conceptual framework and its influencing factors. Saf. Sci. 109, 46–56 (2018)

    Article  Google Scholar 

  19. Huang, L., Wu, C., Wang, B., Ouyang, Q.: A new paradigm for accident investigation and analysis in the era of big data. Process Saf. Prog. 37(1), 42–48 (2018)

    Article  Google Scholar 

  20. Mari, L., Petri, D.: The metrological culture in the context of big data: managing data-driven decision confidence. IEEE Instrum. Meas. Mag. 20(5), 4–20 (2017)

    Article  Google Scholar 

  21. Wang, G., Gunasekaran, A., Ngai, E.W., Papadopoulos, T.: Big data analytics in logistics and supply chain management: certain investigations for research and applications. Int. J. Prod. Econ. 176, 98–110 (2016)

    Article  Google Scholar 

  22. Acharya, A., Singh, S.K., Pereira, V., Singh, P.: Big data, knowledge co-creation and decision making in fashion industry. Int. J. Inf. Manag. 42, 90–101 (2018)

    Article  Google Scholar 

  23. Al Nuaimi, E., Al Neyadi, H., Mohamed, N., Al-Jaroodi, J.: Applications of Big Data to Smart Cities. J. Internet Serv. Appl. 6(1), 25 (2015)

    Article  Google Scholar 

  24. Joh, E.E.: The new surveillance discretion: automated suspicion, big data, and policing. Harvard Law Policy Rev. 10, 15–42 (2016)

    Google Scholar 

  25. Fan, W., Bifet, A.: Mining big data: current status, and forecast to the future. ACM SIGKDD Explor. Newsl. 14(2), 1–5 (2013)

    Article  Google Scholar 

  26. Ford, J.D., Tilleard, S.E., Berrang-Ford, L.A.M., Biesbroek, R., Lesnikowski, A.C., MacDonald, G.K., Hsu, A., Chen, C., Bizikova, L.: Opinion: Big Data has big potential for applications to climate change adaptation. Proc. Natl. Acad. Sci. 113(39), 10729–10732 (2016)

    Article  Google Scholar 

  27. Wolfert, S., Ge, L., Verdouw, C., Bogaardt, M.J.: Big data in smart farming–a review. Agric. Syst. 153, 69–80 (2017)

    Article  Google Scholar 

  28. Fuchs, M., Höpken, W., Lexhagen, M.: Big Data analytics for knowledge generation in tourism destinations–a case from Sweden. J. Destin. Mark. Manag. 3(4), 198–209 (2014)

    Google Scholar 

  29. Fyall, A., Garrod, B., Wang, Y.: Destination collaboration: a critical review of theoretical approaches to a multi-dimensional phenomenon. J. Destin. Mark. Manag. 1(1–2), 10–26 (2012)

    Google Scholar 

  30. Ye, F., Wang, Z.J., Zhou, F.C., Wang, Y.P., Zhou, Y.C.: Cloud-based big data mining & analyzing services platform integrating R. In: International Conference on Advanced Cloud and Big Data (2013)

    Google Scholar 

  31. Pébay, P., Thompson, D., Bennett, J., Mascarenhas, A.: Design and performance of a scalable, parallel statistics toolkit. In: IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum (2011)

    Google Scholar 

  32. Naqvi, R.: Data mining in educational settings. Pak. J. Eng. Technol. Sci. 4(2), 104–114 (2015)

    Google Scholar 

  33. upGrad: Top 10 most common data mining algorithms you should know, 02 December 2019. https://www.upgrad.com/blog/common-data-mining-algorithms/. Accessed 13 May 2020

  34. Sharma, K., Shrivastava, G., Kumar, V.: Web mining: today and tomorrow. In: 3rd International Conference on Electronics Computer Technology (2011)

    Google Scholar 

  35. Domingos, P.: A few useful things to know about machine learning. Commun. ACM 55(10), 78–87 (2012)

    Article  Google Scholar 

  36. Yaqoob, I., Hashem, I.A.T., Gani, A., Mokhtar, S., Ahmed, E., Anuar, N.B., Vasilakos, A.V.: Big data: from beginning to future. Int. J. Inf. Manag. 36(6), 1231–1247 (2016)

    Article  Google Scholar 

  37. Simeone, O.: A very brief introduction to machine learning with applications to communication systems. IEEE Trans. Cogn. Commun. Netw. 4(4), 648–664 (2018)

    Article  Google Scholar 

  38. Sahimi, M., Hamzehpour, H.: Efficient computational strategies for solving global optimization problems. Comput. Sci. Eng. 12(4), 74–83 (2010)

    Article  Google Scholar 

  39. Geng, B., Li, Y., Tao, D., Wang, M., Zha, Z.J., Xu, C.: Parallel lasso for large-scale video concept detection. IEEE Trans. Multimed. 14(1), 55–65 (2011)

    Article  Google Scholar 

  40. Gorodov, E.Y.E., Gubarev, V.V.E.: Analytical review of data visualization methods in application to big data. J. Electr. Comput. Eng. 2013, 1–8 (2013)

    Google Scholar 

  41. Tabassum, S., Pereira, F.S., Fernandes, S., Gama, J.: Social network analysis: an overview. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 8(5), 1–30 (2018)

    Article  Google Scholar 

  42. Chen, C.P., Zhang, C.Y.: Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf. Sci. 275, 314–347 (2014)

    Article  Google Scholar 

  43. Vaseekaran, G.: Big data battle : batch processing vs stream processing, 21 October 2017. https://medium.com/@gowthamy/big-data-battle-batch-processing-vs-stream-processing-5d94600d8103. Accessed 14 May 2020

  44. Karim, S., Soomro, T.R., Burney, S.A.: Spatiotemporal aspects of big data. Appl. Comput. Syst. 23(2), 90–100 (2018)

    Article  Google Scholar 

  45. Anuradha, J.: A brief introduction on big data 5Vs characteristics and Hadoop technology. Procedia Comput. Sci. 48, 319–324 (2015)

    Article  Google Scholar 

  46. Awadallah, A.: Introducing Apache Hadoop: The Modern Data Operating System. Lecture given at Stanford University (2011)

    Google Scholar 

  47. Li, H., Fox, G., Qiu, J.: Performance model for parallel matrix multiplication with dryad: dataflow graph runtime. In: Proceedings of Second International Conference on Cloud and Green Computing (2012)

    Google Scholar 

  48. Eluri, V.R., Ramesh, M., Al-Jabri, A.S.M., Jane, M.: A comparative study of various clustering techniques on big data sets using Apache Mahout. In: Proceedings of 3rd MEC International Conference on Big Data and Smart City (ICBDSC) (2016)

    Google Scholar 

  49. Schelter, S., Owen, S.: Collaborative filtering with Apache Mahout. In: Proceedings of ACM RecSys Challenge (2012)

    Google Scholar 

  50. Vargas, V., Syed, A., Mohammad, A., Halgamuge, M.N.: Pentaho and Jaspersoft: a comparative study of business intelligence open source tools processing big data to evaluate performances. Int. J. Adv. Comput. Sci. Appl. (IJACSA) 7(10), 20–29 (2016)

    Google Scholar 

  51. Alzoubi, H., Ahmed, G.: Do TQM practices improve organisational success? A case study of electronics industry in the UAE. Int. J. Econ. Bus. Res. 17(4), 459 (2019). https://doi.org/10.1504/IJEBR.2019.10020194

    Article  Google Scholar 

  52. Wayner, P.: 7 Top Tools for Taming Big Data, 18 April 2012. https://www.networkworld.com/article/2187788/7-top-tools-for-taming-big-data.html. Accessed 17 May 2020

  53. Membrey, P., Plugge, E., Hawkins, D.: The Definitive Guide to MongoDB: The noSQL Database for Cloud and Desktop Computing. Apress, New York (2011)

    Google Scholar 

  54. Mehmood, T., Alzoubi, H.M., Alshurideh, M., Al-Gasaymeh, A., Ahmed, G.: Schumpeterian entrepreneurship theory: evolution and relevance. Acad. Entrep. J. 25(4), 1–10 (2019)

    Google Scholar 

  55. Alzoubi, H., Ahmed, G., Al-Gasaymeh, A., Kurdi, B.: Empirical study on sustainable supply chain strategies and its impact on competitive priorities: the mediating role of supply chain collaboration. Manag. Sci. Lett. 10(3), 703–708 (2019)

    Google Scholar 

  56. Samuels, D.: Skytree: machine learning meets big data. Silicon Valley Bus. J., 23 February 2012. https://www.bizjournals.com/sanjose/blog/2012/02/skytree-machine-learning-meets-big-data.html?page=all. Accessed 17 May 2020

  57. Mujawar, S., Kulkarni, S.: Big data: tools and applications. Int. J. Comput. Appl. 115(23), 7–11 (2015)

    Google Scholar 

  58. Gounder, M.S., Iyer, V.V., Mazyad, A.A.: A survey on business intelligence tools for university dashboard development. In: Proceedings of the 3rd MEC International Conference on Big Data and Smart City (ICBDSC) (2016)

    Google Scholar 

  59. Murray, D.G.: Tableau Your Data!: Fast and Easy Visual Analysis with Tableau Software. Wiley, Indianapolis (2013)

    Google Scholar 

  60. Shang, W., Jiang, Z.M., Hemmati, H., Adams, B., Hassan, A.E., Martin, P.: Assisting developers of big data analytics applications when deploying on Hadoop clouds. In: Proceedings of 35th International Conference on Software Engineering (ICSE) (2013)

    Google Scholar 

  61. Sapna, U.G., Sharma, P.: A comparative study on big data analytics approaches and tools. Int. Res. J. Eng. Technol. (IRJET) 6(5), 6242–6247 (2019)

    Google Scholar 

  62. Alzoubi, H.M., Yanamandra, R.: Investigating the mediating role of Information sharing strategy on agile supply chain. Uncertain Supply Chain Manag. 8(2), 273–284 (2020)

    Article  Google Scholar 

  63. Joghee, S., Alzoubi, H., Dubey, A.: Decisions effectiveness of FDI investment biases at real estate industry: empirical evidence from Dubai smart city projects. Int. J. Sci. Technol. Res. 9(3), 1245–1258 (2020)

    Google Scholar 

  64. Neumeyer, L., Robbins, B., Nair, A., Kesari, A.: S4: distributed stream computing platform. In: IEEE International Conference on Data Mining Workshops (2010)

    Google Scholar 

  65. Alzoubi, H., Alshurideh, M., Kurdi, B., Inairat, M.: Do perceived service value, quality, price fairness and service recovery shape customer satisfaction and delight? A practical study in the service telecommunication context. Uncertain Supply Chain Manag. 8(3), 439–462 (2020)

    Google Scholar 

  66. Chauhan, J., Chowdhury, S.A., Makaroff, D.: Performance evaluation of Yahoo! S4: a first look. In: Seventh International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, Victoria, BC, Canada (2012)

    Google Scholar 

  67. Dave, M., Gianey, H.K.: Analysis of big data for data-intensive applications. In: International Conference on Recent Advances and Innovations in Engineering (ICRAIE), Jaipur, India (2016)

    Google Scholar 

  68. Jan, B., Farman, H., Khan, M., Imran, M., Islam, I.U., Ahmad, A., Ali, S., Jeon, G.: Deep learning in big data analytics: a comparative study. Comput. Electr. Eng. 75, 275–287 (2019)

    Article  Google Scholar 

  69. Alspaugh, S., Chen, B., Lin, J., Ganapathi, A., Hearst, M., Katz, R.: Analyzing log analysis: an empirical study of user log mining. In: 28th Large Installation System Administration Conference (LISA14), Seattle, USA (2014)

    Google Scholar 

  70. Alshurideh, M., Gasaymeh, A., Ahmed, G., Alzoubi, H., Kurd, B.: Loyalty program effectiveness: theoretical reviews and practical proofs. Uncertain Supply Chain Manag. 8(3), 599–612 (2020)

    Article  Google Scholar 

  71. Kreps, J., Narkhede, N., Rao, J.: Kafka: a distributed messaging system for log processing. In: Proceedings of the NetDB (2011)

    Google Scholar 

  72. Rudolf, M., Paradies, M., Bornhövd, C., Lehner, W.: The graph story of the SAP HANA database. Datenbanksysteme für Business, Technologie und Web (BTW) 2037, 403–420 (2013)

    Google Scholar 

  73. Alzoubi, A.A., Alnuaimi, M., Ajelat, D., Alzoubi, H.M.: Towards intelligent organisations: an empirical investigation of learning orientation’s role in technical innovation. Int. J. Innov. Learn. 29(2), 207–221 (2021)

    Article  Google Scholar 

  74. Färber, F., Cha, S.K., Primsch, J., Bornhövd, C., Sigg, S., Lehner, W.: SAP HANA database: data management for modern business applications. ACM SIGMOD Rec. 40(4), 45–51 (2012)

    Article  Google Scholar 

  75. Heer, J., Kandel, S.: Interactive analysis of big data. ACM Mag. Stud. 19(1), 50–54 (2012)

    Google Scholar 

  76. Melnik, S., Gubarev, A., Long, J.J., Romer, G., Shivakumar, S., Tolton, M., Vassilakis, T.: Dremel: interactive analysis of web-scale datasets. In: Proceedings of the VLDB Endowment (2010)

    Google Scholar 

  77. Chandio, A.A., Tziritas, N., Xu, C.Z.: Big-data processing techniques and their challenges in transport domain. ZTE Commun. 13(1), 50–59 (2015)

    Google Scholar 

  78. Hausenblas, M., Nadeau, J.: Apache drill: interactive ad-hoc analysis at scale. Big Data 1(2), 100–104 (2013)

    Article  Google Scholar 

  79. Alnuaimi, M.A., Alzoubi, H.M., Alnazer, N.N.: Analysing the appropriate cognitive styles and its effect on strategic innovation in Jordanian universities. Int. J. Bus. Excell. 13(1), 127–140 (2017)

    Article  Google Scholar 

  80. Shoro, A.G., Soomro, T.R.: Big data analysis: Apache spark perspective. Global J. Comput. Sci. Technol. 15(1), 7–14 (2015)

    Google Scholar 

  81. Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Springer Science & Business Media, Heidelberg (2013)

    MATH  Google Scholar 

  82. Sysoev, O., Burdakov, O., Grimvall, A.: A segmentation-based algorithm for large-scale partially ordered monotonic regression. Comput. Stat. Data Anal. 55(8), 2463–2476 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  83. Akour, I., Alshurideh, M., Kurdi, B., Ali, A., Salloum, S.: Using machine learning algorithms to predict people’s intention to use mobile learning platforms during the COVID-19 pandemic: machine learning approach. JMIR Med. Educ. 7(1), 1–17 (2021)

    Article  Google Scholar 

  84. Yousuf, H., Zainal, A.Y., Alshurideh, M., Salloum, S.A.: Artificial intelligence models in power system analysis. In: Artificial Intelligence for Sustainable Development: Theory, Practice and Future Applications, pp. 231–242. Springer (2021)

    Google Scholar 

  85. AlShamsi, M., Salloum, S.A., Alshurideh, M., Abdallah, S.: Artificial intelligence and blockchain for transparency in governance. In: Artificial Intelligence for Sustainable Development: Theory, Practice and Future Applications, pp. 219–230. Springer (2021)

    Google Scholar 

  86. Kurdi, B.A., Alshurideh, M., Salloum, S.A.: Investigating a theoretical framework for e-learning technology acceptance. Int. J. Electr. Comput. Eng. 10(6), 6484–6496 (2020)

    Google Scholar 

  87. Almaazmi, J., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: The effect of digital transformation on product innovation: a critical review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 731–741 (2020)

    Google Scholar 

  88. Alshurideh, M., Al Kurdi, B., Salloum, S.A.: Digital transformation and organizational operational decision making: a systematic review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 708–719 (2020)

    Google Scholar 

  89. Al Mehrez, A.A., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: Internal factors affect knowledge management and firm performance: a systematic review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 632–643 (2020)

    Google Scholar 

  90. Alshurideh, M., Al Kurdi, B., Salloum, S.A., Arpaci, I., Al-Emran, M.: Predicting the actual use of m-learning systems: a comparative approach using PLS-SEM and machine learning algorithms. Interact. Learn. Environ. 1–15 (2020)

    Google Scholar 

  91. Alhashmi, S.F.S., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: A systematic review of the factors affecting the artificial intelligence implementation in the health care sector. In: AISC, vol. 1153 (2020)

    Google Scholar 

  92. Salloum, S.A., Alshurideh, M., Elnagar, A., Shaalan, K.: Machine learning and deep learning techniques for cybersecurity: a review. In: AISC, vol. 1153 (2020)

    Google Scholar 

  93. AlShurideh, M., Alsharari, N.M., Al Kurdi, B.: Supply chain integration and customer relationship management in the airline logistics. Theor. Econ. Lett. 9(02), 392–414 (2019)

    Article  Google Scholar 

  94. Alshurideh, M., Salloum, S.A., Al Kurdi, B., Al-Emran, M.: Factors affecting the social networks acceptance: an empirical study using PLS-SEM approach. In: 8th International Conference on Software and Computer Applications, pp. 1–5 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Muhammad Turki Alshurideh .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Naqvi, R., Soomro, T.R., Alzoubi, H.M., Ghazal, T.M., Alshurideh, M.T. (2021). The Nexus Between Big Data and Decision-Making: A Study of Big Data Techniques and Technologies. In: Hassanien, A.E., et al. Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2021). AICV 2021. Advances in Intelligent Systems and Computing, vol 1377. Springer, Cham. https://doi.org/10.1007/978-3-030-76346-6_73

Download citation

Publish with us

Policies and ethics