Abstract
Big Data (BD) has shifted the paradigm of conventional data analysis with the exploitation of emerging technologies. Analysis using BD contributes to foreseeing and pulling out value from large data, exposing covert information, and expediting the decision-making process. This study highlights the impression and effect on decision-making through BD. The investigation’s rationale is to dig deep insight into the buzzword to enable stakeholders to understand the challenges and opportunities that BD has bought in the current business scenarios. It also discusses applications of BD-influenced decision-making, along with state-of-the-art BD techniques and technologies. The study is a review article based on the research articles, conference proceedings, books, and web articles available on Google Scholar and Google from the period between 2010 and 2020. Due to BD’s extreme importance, the available techniques and technologies should facilitate effective data collection, storage, analysis, and visualization. Every opportunity comes with greater challenges; this paper summarizes the strengths and weaknesses of different tools associated with three broad categories of BD technologies. This enables researchers to quickly glance at the available tools’ pros and cons in one only place. This emerging field is still very young and premature. Various techniques and technologies have been designed to deal with such humungous data, but they still offer minimal efficacy to deal with BD problems completely. This is high time now that technologists, researchers, and governments pay significant attention to this vast and evolving field by investing their time and money in developing efficient tools that maximize value from it. BD also means big opportunities, big challenges, and big systems; therefore, it also requires big attention from researchers to overcome the research gaps that exist in this big field.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Miller, H.G., Mork, P.: From data to decisions: a value chain for big data. IT Prof. 15(1), 57–59 (2013)
Elgendy, N., Elragal, A.: Big data analytics in support of the decision making process. Procedia Comput. Sci. 100, 1071–1084 (2016)
Li, G.J., Cheng, X.Q.: Research status and scientific thinking of big data. Bull. Chin. Acad. Sci. 27(6), 647–657 (2012)
Renu, R.S.M.G.K.A.: Use of big data and knowledge discovery to create data backbones for decision support systems. Procedia Comput. Sci. 20, 446–453 (2013)
Poleto, T., de Carvalho, V.D.H., Costa A.P.C.S.: The roles of big data in the decision-support process: an empirical investigation. In: International Conference on Decision Support System Technology, Cham (2015)
Berman, J.J.: Principles of big data preparing, sharing, and analyzing complex information. Elsevier (2013)
Chen, M., Mao, S., Liu, Y.: Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)
McKinsey Global Institute: Big Data: the next frontier for innovation, competition, and productivity. McKinsey & Company (2011)
Ward, J.S., Barker, A.: Undefined by data: a survey of big data definitions. arXiv preprint, arXiv:1309.5821 (2013)
De Mauro, A., Greco, M., Grimaldi, M.: A formal definition of big data based on its essential features. Libr. Rev. 65(3), 122–135 (2016)
Gantz, J., Reinsel, D.: Extracting value from chaos. IDC iView 1142(2011), 1–12 (2011)
Dumbill, E.: Making sense of big data. Big Data 1(1), (2013)
Prakashbhai, P.A., Pandey H.M.: Inference patterns from big data using aggregation, filtering and tagging - a survey. In: 5th International Conference - The Next Generation Information Technology Summit (Confluence) (2014)
Kościelniaka, H., Puto, A.: BIG DATA in decision making processes of enterprises. Procedia Comput. Sci. 65, 1052–1058 (2015)
Pauleen, D.J., Wang, W.Y.: Does big data mean big knowledge? KM perspectives on big data and analytics. J. Knowl. Manag. 21(1), 1–6 (2017)
Gandomi, A., Haider, M.: Beyond the hype: big data concepts, methods, and analytics. Int. J. Inf. Manag. 35(2), 137–144 (2015)
Janssen, M., van der Voort, H., Wahyudi, A.: Factors influencing big data decision-making quality. J. Bus. Res. 70, 338–345 (2017)
Huang, L., Wu, C., Wang, B., Ouyang, Q.: Big-data-driven safety decision-making: a conceptual framework and its influencing factors. Saf. Sci. 109, 46–56 (2018)
Huang, L., Wu, C., Wang, B., Ouyang, Q.: A new paradigm for accident investigation and analysis in the era of big data. Process Saf. Prog. 37(1), 42–48 (2018)
Mari, L., Petri, D.: The metrological culture in the context of big data: managing data-driven decision confidence. IEEE Instrum. Meas. Mag. 20(5), 4–20 (2017)
Wang, G., Gunasekaran, A., Ngai, E.W., Papadopoulos, T.: Big data analytics in logistics and supply chain management: certain investigations for research and applications. Int. J. Prod. Econ. 176, 98–110 (2016)
Acharya, A., Singh, S.K., Pereira, V., Singh, P.: Big data, knowledge co-creation and decision making in fashion industry. Int. J. Inf. Manag. 42, 90–101 (2018)
Al Nuaimi, E., Al Neyadi, H., Mohamed, N., Al-Jaroodi, J.: Applications of Big Data to Smart Cities. J. Internet Serv. Appl. 6(1), 25 (2015)
Joh, E.E.: The new surveillance discretion: automated suspicion, big data, and policing. Harvard Law Policy Rev. 10, 15–42 (2016)
Fan, W., Bifet, A.: Mining big data: current status, and forecast to the future. ACM SIGKDD Explor. Newsl. 14(2), 1–5 (2013)
Ford, J.D., Tilleard, S.E., Berrang-Ford, L.A.M., Biesbroek, R., Lesnikowski, A.C., MacDonald, G.K., Hsu, A., Chen, C., Bizikova, L.: Opinion: Big Data has big potential for applications to climate change adaptation. Proc. Natl. Acad. Sci. 113(39), 10729–10732 (2016)
Wolfert, S., Ge, L., Verdouw, C., Bogaardt, M.J.: Big data in smart farming–a review. Agric. Syst. 153, 69–80 (2017)
Fuchs, M., Höpken, W., Lexhagen, M.: Big Data analytics for knowledge generation in tourism destinations–a case from Sweden. J. Destin. Mark. Manag. 3(4), 198–209 (2014)
Fyall, A., Garrod, B., Wang, Y.: Destination collaboration: a critical review of theoretical approaches to a multi-dimensional phenomenon. J. Destin. Mark. Manag. 1(1–2), 10–26 (2012)
Ye, F., Wang, Z.J., Zhou, F.C., Wang, Y.P., Zhou, Y.C.: Cloud-based big data mining & analyzing services platform integrating R. In: International Conference on Advanced Cloud and Big Data (2013)
Pébay, P., Thompson, D., Bennett, J., Mascarenhas, A.: Design and performance of a scalable, parallel statistics toolkit. In: IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum (2011)
Naqvi, R.: Data mining in educational settings. Pak. J. Eng. Technol. Sci. 4(2), 104–114 (2015)
upGrad: Top 10 most common data mining algorithms you should know, 02 December 2019. https://www.upgrad.com/blog/common-data-mining-algorithms/. Accessed 13 May 2020
Sharma, K., Shrivastava, G., Kumar, V.: Web mining: today and tomorrow. In: 3rd International Conference on Electronics Computer Technology (2011)
Domingos, P.: A few useful things to know about machine learning. Commun. ACM 55(10), 78–87 (2012)
Yaqoob, I., Hashem, I.A.T., Gani, A., Mokhtar, S., Ahmed, E., Anuar, N.B., Vasilakos, A.V.: Big data: from beginning to future. Int. J. Inf. Manag. 36(6), 1231–1247 (2016)
Simeone, O.: A very brief introduction to machine learning with applications to communication systems. IEEE Trans. Cogn. Commun. Netw. 4(4), 648–664 (2018)
Sahimi, M., Hamzehpour, H.: Efficient computational strategies for solving global optimization problems. Comput. Sci. Eng. 12(4), 74–83 (2010)
Geng, B., Li, Y., Tao, D., Wang, M., Zha, Z.J., Xu, C.: Parallel lasso for large-scale video concept detection. IEEE Trans. Multimed. 14(1), 55–65 (2011)
Gorodov, E.Y.E., Gubarev, V.V.E.: Analytical review of data visualization methods in application to big data. J. Electr. Comput. Eng. 2013, 1–8 (2013)
Tabassum, S., Pereira, F.S., Fernandes, S., Gama, J.: Social network analysis: an overview. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 8(5), 1–30 (2018)
Chen, C.P., Zhang, C.Y.: Data-intensive applications, challenges, techniques and technologies: a survey on big data. Inf. Sci. 275, 314–347 (2014)
Vaseekaran, G.: Big data battle : batch processing vs stream processing, 21 October 2017. https://medium.com/@gowthamy/big-data-battle-batch-processing-vs-stream-processing-5d94600d8103. Accessed 14 May 2020
Karim, S., Soomro, T.R., Burney, S.A.: Spatiotemporal aspects of big data. Appl. Comput. Syst. 23(2), 90–100 (2018)
Anuradha, J.: A brief introduction on big data 5Vs characteristics and Hadoop technology. Procedia Comput. Sci. 48, 319–324 (2015)
Awadallah, A.: Introducing Apache Hadoop: The Modern Data Operating System. Lecture given at Stanford University (2011)
Li, H., Fox, G., Qiu, J.: Performance model for parallel matrix multiplication with dryad: dataflow graph runtime. In: Proceedings of Second International Conference on Cloud and Green Computing (2012)
Eluri, V.R., Ramesh, M., Al-Jabri, A.S.M., Jane, M.: A comparative study of various clustering techniques on big data sets using Apache Mahout. In: Proceedings of 3rd MEC International Conference on Big Data and Smart City (ICBDSC) (2016)
Schelter, S., Owen, S.: Collaborative filtering with Apache Mahout. In: Proceedings of ACM RecSys Challenge (2012)
Vargas, V., Syed, A., Mohammad, A., Halgamuge, M.N.: Pentaho and Jaspersoft: a comparative study of business intelligence open source tools processing big data to evaluate performances. Int. J. Adv. Comput. Sci. Appl. (IJACSA) 7(10), 20–29 (2016)
Alzoubi, H., Ahmed, G.: Do TQM practices improve organisational success? A case study of electronics industry in the UAE. Int. J. Econ. Bus. Res. 17(4), 459 (2019). https://doi.org/10.1504/IJEBR.2019.10020194
Wayner, P.: 7 Top Tools for Taming Big Data, 18 April 2012. https://www.networkworld.com/article/2187788/7-top-tools-for-taming-big-data.html. Accessed 17 May 2020
Membrey, P., Plugge, E., Hawkins, D.: The Definitive Guide to MongoDB: The noSQL Database for Cloud and Desktop Computing. Apress, New York (2011)
Mehmood, T., Alzoubi, H.M., Alshurideh, M., Al-Gasaymeh, A., Ahmed, G.: Schumpeterian entrepreneurship theory: evolution and relevance. Acad. Entrep. J. 25(4), 1–10 (2019)
Alzoubi, H., Ahmed, G., Al-Gasaymeh, A., Kurdi, B.: Empirical study on sustainable supply chain strategies and its impact on competitive priorities: the mediating role of supply chain collaboration. Manag. Sci. Lett. 10(3), 703–708 (2019)
Samuels, D.: Skytree: machine learning meets big data. Silicon Valley Bus. J., 23 February 2012. https://www.bizjournals.com/sanjose/blog/2012/02/skytree-machine-learning-meets-big-data.html?page=all. Accessed 17 May 2020
Mujawar, S., Kulkarni, S.: Big data: tools and applications. Int. J. Comput. Appl. 115(23), 7–11 (2015)
Gounder, M.S., Iyer, V.V., Mazyad, A.A.: A survey on business intelligence tools for university dashboard development. In: Proceedings of the 3rd MEC International Conference on Big Data and Smart City (ICBDSC) (2016)
Murray, D.G.: Tableau Your Data!: Fast and Easy Visual Analysis with Tableau Software. Wiley, Indianapolis (2013)
Shang, W., Jiang, Z.M., Hemmati, H., Adams, B., Hassan, A.E., Martin, P.: Assisting developers of big data analytics applications when deploying on Hadoop clouds. In: Proceedings of 35th International Conference on Software Engineering (ICSE) (2013)
Sapna, U.G., Sharma, P.: A comparative study on big data analytics approaches and tools. Int. Res. J. Eng. Technol. (IRJET) 6(5), 6242–6247 (2019)
Alzoubi, H.M., Yanamandra, R.: Investigating the mediating role of Information sharing strategy on agile supply chain. Uncertain Supply Chain Manag. 8(2), 273–284 (2020)
Joghee, S., Alzoubi, H., Dubey, A.: Decisions effectiveness of FDI investment biases at real estate industry: empirical evidence from Dubai smart city projects. Int. J. Sci. Technol. Res. 9(3), 1245–1258 (2020)
Neumeyer, L., Robbins, B., Nair, A., Kesari, A.: S4: distributed stream computing platform. In: IEEE International Conference on Data Mining Workshops (2010)
Alzoubi, H., Alshurideh, M., Kurdi, B., Inairat, M.: Do perceived service value, quality, price fairness and service recovery shape customer satisfaction and delight? A practical study in the service telecommunication context. Uncertain Supply Chain Manag. 8(3), 439–462 (2020)
Chauhan, J., Chowdhury, S.A., Makaroff, D.: Performance evaluation of Yahoo! S4: a first look. In: Seventh International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, Victoria, BC, Canada (2012)
Dave, M., Gianey, H.K.: Analysis of big data for data-intensive applications. In: International Conference on Recent Advances and Innovations in Engineering (ICRAIE), Jaipur, India (2016)
Jan, B., Farman, H., Khan, M., Imran, M., Islam, I.U., Ahmad, A., Ali, S., Jeon, G.: Deep learning in big data analytics: a comparative study. Comput. Electr. Eng. 75, 275–287 (2019)
Alspaugh, S., Chen, B., Lin, J., Ganapathi, A., Hearst, M., Katz, R.: Analyzing log analysis: an empirical study of user log mining. In: 28th Large Installation System Administration Conference (LISA14), Seattle, USA (2014)
Alshurideh, M., Gasaymeh, A., Ahmed, G., Alzoubi, H., Kurd, B.: Loyalty program effectiveness: theoretical reviews and practical proofs. Uncertain Supply Chain Manag. 8(3), 599–612 (2020)
Kreps, J., Narkhede, N., Rao, J.: Kafka: a distributed messaging system for log processing. In: Proceedings of the NetDB (2011)
Rudolf, M., Paradies, M., Bornhövd, C., Lehner, W.: The graph story of the SAP HANA database. Datenbanksysteme für Business, Technologie und Web (BTW) 2037, 403–420 (2013)
Alzoubi, A.A., Alnuaimi, M., Ajelat, D., Alzoubi, H.M.: Towards intelligent organisations: an empirical investigation of learning orientation’s role in technical innovation. Int. J. Innov. Learn. 29(2), 207–221 (2021)
Färber, F., Cha, S.K., Primsch, J., Bornhövd, C., Sigg, S., Lehner, W.: SAP HANA database: data management for modern business applications. ACM SIGMOD Rec. 40(4), 45–51 (2012)
Heer, J., Kandel, S.: Interactive analysis of big data. ACM Mag. Stud. 19(1), 50–54 (2012)
Melnik, S., Gubarev, A., Long, J.J., Romer, G., Shivakumar, S., Tolton, M., Vassilakis, T.: Dremel: interactive analysis of web-scale datasets. In: Proceedings of the VLDB Endowment (2010)
Chandio, A.A., Tziritas, N., Xu, C.Z.: Big-data processing techniques and their challenges in transport domain. ZTE Commun. 13(1), 50–59 (2015)
Hausenblas, M., Nadeau, J.: Apache drill: interactive ad-hoc analysis at scale. Big Data 1(2), 100–104 (2013)
Alnuaimi, M.A., Alzoubi, H.M., Alnazer, N.N.: Analysing the appropriate cognitive styles and its effect on strategic innovation in Jordanian universities. Int. J. Bus. Excell. 13(1), 127–140 (2017)
Shoro, A.G., Soomro, T.R.: Big data analysis: Apache spark perspective. Global J. Comput. Sci. Technol. 15(1), 7–14 (2015)
Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Springer Science & Business Media, Heidelberg (2013)
Sysoev, O., Burdakov, O., Grimvall, A.: A segmentation-based algorithm for large-scale partially ordered monotonic regression. Comput. Stat. Data Anal. 55(8), 2463–2476 (2011)
Akour, I., Alshurideh, M., Kurdi, B., Ali, A., Salloum, S.: Using machine learning algorithms to predict people’s intention to use mobile learning platforms during the COVID-19 pandemic: machine learning approach. JMIR Med. Educ. 7(1), 1–17 (2021)
Yousuf, H., Zainal, A.Y., Alshurideh, M., Salloum, S.A.: Artificial intelligence models in power system analysis. In: Artificial Intelligence for Sustainable Development: Theory, Practice and Future Applications, pp. 231–242. Springer (2021)
AlShamsi, M., Salloum, S.A., Alshurideh, M., Abdallah, S.: Artificial intelligence and blockchain for transparency in governance. In: Artificial Intelligence for Sustainable Development: Theory, Practice and Future Applications, pp. 219–230. Springer (2021)
Kurdi, B.A., Alshurideh, M., Salloum, S.A.: Investigating a theoretical framework for e-learning technology acceptance. Int. J. Electr. Comput. Eng. 10(6), 6484–6496 (2020)
Almaazmi, J., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: The effect of digital transformation on product innovation: a critical review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 731–741 (2020)
Alshurideh, M., Al Kurdi, B., Salloum, S.A.: Digital transformation and organizational operational decision making: a systematic review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 708–719 (2020)
Al Mehrez, A.A., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: Internal factors affect knowledge management and firm performance: a systematic review. In: International Conference on Advanced Intelligent Systems and Informatics, pp. 632–643 (2020)
Alshurideh, M., Al Kurdi, B., Salloum, S.A., Arpaci, I., Al-Emran, M.: Predicting the actual use of m-learning systems: a comparative approach using PLS-SEM and machine learning algorithms. Interact. Learn. Environ. 1–15 (2020)
Alhashmi, S.F.S., Alshurideh, M., Al Kurdi, B., Salloum, S.A.: A systematic review of the factors affecting the artificial intelligence implementation in the health care sector. In: AISC, vol. 1153 (2020)
Salloum, S.A., Alshurideh, M., Elnagar, A., Shaalan, K.: Machine learning and deep learning techniques for cybersecurity: a review. In: AISC, vol. 1153 (2020)
AlShurideh, M., Alsharari, N.M., Al Kurdi, B.: Supply chain integration and customer relationship management in the airline logistics. Theor. Econ. Lett. 9(02), 392–414 (2019)
Alshurideh, M., Salloum, S.A., Al Kurdi, B., Al-Emran, M.: Factors affecting the social networks acceptance: an empirical study using PLS-SEM approach. In: 8th International Conference on Software and Computer Applications, pp. 1–5 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Naqvi, R., Soomro, T.R., Alzoubi, H.M., Ghazal, T.M., Alshurideh, M.T. (2021). The Nexus Between Big Data and Decision-Making: A Study of Big Data Techniques and Technologies. In: Hassanien, A.E., et al. Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2021). AICV 2021. Advances in Intelligent Systems and Computing, vol 1377. Springer, Cham. https://doi.org/10.1007/978-3-030-76346-6_73
Download citation
DOI: https://doi.org/10.1007/978-3-030-76346-6_73
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-76345-9
Online ISBN: 978-3-030-76346-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)