Abstract
Data analytics projects have brought countless benefits and solutions to the world. As a result, many organizations have attempted to adopt data analytics in order to reap the benefits of these implementations and move forward with projects that involve big data or data science. However, research has shown that more than 50% of these projects fail—either due to incomplete projects or lacking expected business value. Data analytics is often perceived as a complex concept due to the focus on big data, which is characterized by large, disaggregated volumes of data, velocity, and the variety of data (to name a few). The objective of this study was to identify the challenges associated with data analytics projects being implemented. The contribution lies in the fact that, if organizations can identify potential challenges, precautions can be made to diminish the chance of possible pitfalls, therefore improving chances of successful project implementation. A Systematic Literature Review was done in order to identify academic publications relating to selected search terms, followed by a thematic analysis on the search results to identify challenges associated with data analytics projects. The major, most prevalent challenges identified included poor data quality, lack of management support, and miscommunication.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
H. Geng, Internet of Things and Data Analytics Handbook (Wiley, Canada, 2017)
P. Russom, Big Data Analytics—TDWI Best Practices Report. Introduction to Big Data Analytics. Fourth Quarter, vol. 19 (2011), pp. 1–34
A. Cartelli, Socio-technical theory and knowledge construction: towards new pedagogical paradigms? Issues Inform. Sci. Inf. Technol. 4, 001–014 (2007). https://doi.org/10.28945/928
EMC Education Services, Data Science & Big Data Analytics: Discovering, Analyzing, Visualizing and Presenting Data (2015). https://doi.org/10.30748/soi.2018.153.08
H. Geng, Internet of Things and Data Analytics Handbook (2017)
C.L. Aasheim, S. Williams, P. Rutner, A. Gardiner, Data analytics vs. data science: a study of similarities and differences in undergraduate programs based on course descriptions. J. Inf. Syst. Educ. 26, 103–115 (2015)
P. Galetsi, K. Katsaliaki, S. Kumar, Values, challenges and future directions of big data analytics in healthcare: a systematic review. Soc. Sci. Med. 241, 112533 (2019). https://doi.org/10.1016/j.socscimed.2019.112533
R.Y. Zhong, S.T. Newman, G.Q. Huang, S. Lan, Big data for supply chain management in the service and manufacturing sectors: challenges, opportunities, and future perspectives. Comput. Ind. Eng. 101, 572–591 (2016). https://doi.org/10.1016/j.cie.2016.07.013
C. Garattini, J. Raffle, D.N. Aisyah, F. Sartain, Z. Kozlakidis, Big data analytics, infectious diseases and associated ethical impacts. Philos. Technol. 32, 69–85 (2019). https://doi.org/10.1007/s13347-017-0278-y
A. Boland, M.G. Cherry, R. Dickson, Doing a Systematic Review: A Student’s Guide (2017)
D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6 (2009)
B.J. Oates, Researching Information Systems and Computing (Sage, London, 2006)
F. Sejahtera, W. Wang, M. Indulska, S. Sadiq, Enablers and inhibitors of effective use of big data: insights from a case study harmonized messaging view project effective use of big data view project, in PACIS 2018 Proceedings (2018), p. 27
L. RodrÃguez-Mazahua, C.A. RodrÃguez-EnrÃquez, J.L. Sánchez-Cervantes, J. Cervantes, J.L. GarcÃa-Alcaraz, G. Alor-Hernández, A general perspective of big data: applications, tools, challenges and trends. J. Supercomput. 72, 3073–3113 (2016). https://doi.org/10.1007/s11227-015-1501-1
Z.A. Al-Sai, R. Abdullah, M.H. Husin, Big data impacts and challenges: a review, in 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology. JEEIT 2019—Proceedings (2019), pp. 150–155. https://doi.org/10.1109/JEEIT.2019.8717484
S. Shyni, R. Joshitta, S. Mary, L. Arockiam, Applications of big data analytics for diagnosing diabetic mellitus: issues and challenges. Int. J. Recent Trends Eng. Res. IJRTER 2, 454–461 (2016)
I. Lee, Big data: dimensions, evolution, impacts, and challenges. Bus. Horiz. 60, 293–303 (2017). https://doi.org/10.1016/j.bushor.2017.01.004
S.U.R. Rehman, C.A.O. Qingren, A qualitative study of the challenges faced by organizations in big data implementation. Int. J. Mod. Res. Manag. 1, 1–13 (2017)
D.A. Kolkman, R. Sneep, Challenges to data science projects with SMEs: an analysis and decision support tool (2019)
W. Noonpakdee, A. Phothichai, T. Khunkornsiri, Challenges of big data implementation in a public hospital, in 2019 28th Wireless and Optical Communications Conference WOCC 2019—Proceedings (2019), pp. 1–5. https://doi.org/10.1109/WOCC.2019.8770562
C. Faverjon, A. Bernstein, R. Grütter, C. Nathues, H. Nathues, C. Sarasua, M. Sterchi, M.E. Vargas, J. Berezowski, A transdisciplinary approach supporting the implementation of a big data project in livestock production: an example from the swiss pig production industry. Front. Vet. Sci. 6, 1–11 (2019). https://doi.org/10.3389/fvets.2019.00215
L. Carlsson, D. Yu, Challenges of implementing big data in large organisations (2018)
S.S. Nawaz, A. Haleem, Impacts and challenges of big data: a review. Int. J. Psychosoc. Rehabil. 24, 479–487 (2020)
D.P. Acharjya, K. Ahmed, A survey on big data analytics: challenges, open research issues and tools. Int. J. Adv. Comput. Sci. Appl. 7 (2016). https://doi.org/10.14569/ijacsa.2016.070267
B. Khattak, A. Khan, K. Khan, W. Khan, M. Kamran, M. Fahad, Empirical analysis of recent advances, characteristics and challenges of big data. ICST Trans. Scalable Inf. Syst. 159621 (2018). https://doi.org/10.4108/eai.13-7-2018.159621
H. Barham, T. Daim, Identifying critical issues in smart city big data project implementation, in Proceedings of the 1st ACMEIGSCC Symposium on Smart Cities Communities SCC 2018 (2018). https://doi.org/10.1145/3236461.3241967
M. Talha, N. Elmarzouqi, A. Abou El Kalam, Quality and security in big data: challenges as opportunities to build a powerful wrap-up solution. J. Ubiquitous Syst. Pervasive Netw. 12, 09–15 (2020). https://doi.org/10.5383/juspn.12.01.002
I.A. Ajah, H.F. Nweke, Big data and business analytics: trends, platforms, success factors and applications. Big Data Cogn. Comput. 3, 1–30 (2019). https://doi.org/10.3390/bdcc3020032
C. Walls, B. Barnard, Success factors of big data to achieve organisational performance: qualitative research. Expert J. Bus. Manag. 8, 17–56 (2020)
M.O. Ojo, Big data analytics solution: the implementation challenges in the financial service industry, 66, 37–39 (2016)
A.M. Heidari, Exploration of Big Data in Procurement—Benefits and Challenges (2018), p. 67
M. Khan, Challenges with big data analytics in service supply chains in the UAE. Manag. Decis. 57, 2124–2147 (2019). https://doi.org/10.1108/MD-06-2018-0669
A.H. Johar, H. Khalid, Big data analytics adoption and implementation in public transportation: the gap in practise. Open Int. J. Inform. 7, 12–22 (2019)
D. Tykheev, Big data in marketing (2018)
D.A. Kolkman, R. Sneep, Challenges to Data Science Projects with SMEs (2019)
S. Coleman, R. Göb, G. Manco, A. Pievatolo, X. Tort-Martorell, M.S. Reis, How can SMEs benefit from big data? Challenges and a path forward. Qual. Reliab. Eng. Int. 32, 2151–2164 (2016). https://doi.org/10.1002/qre.2008
F.P. Sejahtera, W. Wang, M. Indulska, S. Sadiq, Enablers and inhibitors of effective use of big data: insights from a case study, in Proceedings of the 22nd Pacific Asia Conference on Information Systems—Opportunities and Challenges for the Digitized Society: Are We Ready?, PACIS 2018 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Milicevic, M., Eybers, S. (2022). The Challenges of Data Analytics Implementations: A Preliminary Literature Review. In: Saraswat, M., Roy, S., Chowdhury, C., Gandomi, A.H. (eds) Proceedings of International Conference on Data Science and Applications . Lecture Notes in Networks and Systems, vol 288. Springer, Singapore. https://doi.org/10.1007/978-981-16-5120-5_3
Download citation
DOI: https://doi.org/10.1007/978-981-16-5120-5_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-5119-9
Online ISBN: 978-981-16-5120-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)