Skip to main content

The Challenges of Data Analytics Implementations: A Preliminary Literature Review

  • Conference paper
  • First Online:
Proceedings of International Conference on Data Science and Applications

Abstract

Data analytics projects have brought countless benefits and solutions to the world. As a result, many organizations have attempted to adopt data analytics in order to reap the benefits of these implementations and move forward with projects that involve big data or data science. However, research has shown that more than 50% of these projects fail—either due to incomplete projects or lacking expected business value. Data analytics is often perceived as a complex concept due to the focus on big data, which is characterized by large, disaggregated volumes of data, velocity, and the variety of data (to name a few). The objective of this study was to identify the challenges associated with data analytics projects being implemented. The contribution lies in the fact that, if organizations can identify potential challenges, precautions can be made to diminish the chance of possible pitfalls, therefore improving chances of successful project implementation. A Systematic Literature Review was done in order to identify academic publications relating to selected search terms, followed by a thematic analysis on the search results to identify challenges associated with data analytics projects. The major, most prevalent challenges identified included poor data quality, lack of management support, and miscommunication.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. H. Geng, Internet of Things and Data Analytics Handbook (Wiley, Canada, 2017)

    Book  Google Scholar 

  2. P. Russom, Big Data Analytics—TDWI Best Practices Report. Introduction to Big Data Analytics. Fourth Quarter, vol. 19 (2011), pp. 1–34

    Google Scholar 

  3. A. Cartelli, Socio-technical theory and knowledge construction: towards new pedagogical paradigms? Issues Inform. Sci. Inf. Technol. 4, 001–014 (2007). https://doi.org/10.28945/928

  4. EMC Education Services, Data Science & Big Data Analytics: Discovering, Analyzing, Visualizing and Presenting Data (2015). https://doi.org/10.30748/soi.2018.153.08

  5. H. Geng, Internet of Things and Data Analytics Handbook (2017)

    Google Scholar 

  6. C.L. Aasheim, S. Williams, P. Rutner, A. Gardiner, Data analytics vs. data science: a study of similarities and differences in undergraduate programs based on course descriptions. J. Inf. Syst. Educ. 26, 103–115 (2015)

    Google Scholar 

  7. P. Galetsi, K. Katsaliaki, S. Kumar, Values, challenges and future directions of big data analytics in healthcare: a systematic review. Soc. Sci. Med. 241, 112533 (2019). https://doi.org/10.1016/j.socscimed.2019.112533

    Article  Google Scholar 

  8. R.Y. Zhong, S.T. Newman, G.Q. Huang, S. Lan, Big data for supply chain management in the service and manufacturing sectors: challenges, opportunities, and future perspectives. Comput. Ind. Eng. 101, 572–591 (2016). https://doi.org/10.1016/j.cie.2016.07.013

    Article  Google Scholar 

  9. C. Garattini, J. Raffle, D.N. Aisyah, F. Sartain, Z. Kozlakidis, Big data analytics, infectious diseases and associated ethical impacts. Philos. Technol. 32, 69–85 (2019). https://doi.org/10.1007/s13347-017-0278-y

    Article  Google Scholar 

  10. A. Boland, M.G. Cherry, R. Dickson, Doing a Systematic Review: A Student’s Guide (2017)

    Google Scholar 

  11. D. Moher, A. Liberati, J. Tetzlaff, D.G. Altman, Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6 (2009)

    Google Scholar 

  12. B.J. Oates, Researching Information Systems and Computing (Sage, London, 2006)

    Google Scholar 

  13. F. Sejahtera, W. Wang, M. Indulska, S. Sadiq, Enablers and inhibitors of effective use of big data: insights from a case study harmonized messaging view project effective use of big data view project, in PACIS 2018 Proceedings (2018), p. 27

    Google Scholar 

  14. L. Rodríguez-Mazahua, C.A. Rodríguez-Enríquez, J.L. Sánchez-Cervantes, J. Cervantes, J.L. García-Alcaraz, G. Alor-Hernández, A general perspective of big data: applications, tools, challenges and trends. J. Supercomput. 72, 3073–3113 (2016). https://doi.org/10.1007/s11227-015-1501-1

    Article  Google Scholar 

  15. Z.A. Al-Sai, R. Abdullah, M.H. Husin, Big data impacts and challenges: a review, in 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology. JEEIT 2019—Proceedings (2019), pp. 150–155. https://doi.org/10.1109/JEEIT.2019.8717484

  16. S. Shyni, R. Joshitta, S. Mary, L. Arockiam, Applications of big data analytics for diagnosing diabetic mellitus: issues and challenges. Int. J. Recent Trends Eng. Res. IJRTER 2, 454–461 (2016)

    Google Scholar 

  17. I. Lee, Big data: dimensions, evolution, impacts, and challenges. Bus. Horiz. 60, 293–303 (2017). https://doi.org/10.1016/j.bushor.2017.01.004

    Article  Google Scholar 

  18. S.U.R. Rehman, C.A.O. Qingren, A qualitative study of the challenges faced by organizations in big data implementation. Int. J. Mod. Res. Manag. 1, 1–13 (2017)

    Google Scholar 

  19. D.A. Kolkman, R. Sneep, Challenges to data science projects with SMEs: an analysis and decision support tool (2019)

    Google Scholar 

  20. W. Noonpakdee, A. Phothichai, T. Khunkornsiri, Challenges of big data implementation in a public hospital, in 2019 28th Wireless and Optical Communications Conference WOCC 2019—Proceedings (2019), pp. 1–5. https://doi.org/10.1109/WOCC.2019.8770562

  21. C. Faverjon, A. Bernstein, R. Grütter, C. Nathues, H. Nathues, C. Sarasua, M. Sterchi, M.E. Vargas, J. Berezowski, A transdisciplinary approach supporting the implementation of a big data project in livestock production: an example from the swiss pig production industry. Front. Vet. Sci. 6, 1–11 (2019). https://doi.org/10.3389/fvets.2019.00215

    Article  Google Scholar 

  22. L. Carlsson, D. Yu, Challenges of implementing big data in large organisations (2018)

    Google Scholar 

  23. S.S. Nawaz, A. Haleem, Impacts and challenges of big data: a review. Int. J. Psychosoc. Rehabil. 24, 479–487 (2020)

    Google Scholar 

  24. D.P. Acharjya, K. Ahmed, A survey on big data analytics: challenges, open research issues and tools. Int. J. Adv. Comput. Sci. Appl. 7 (2016). https://doi.org/10.14569/ijacsa.2016.070267

  25. B. Khattak, A. Khan, K. Khan, W. Khan, M. Kamran, M. Fahad, Empirical analysis of recent advances, characteristics and challenges of big data. ICST Trans. Scalable Inf. Syst. 159621 (2018). https://doi.org/10.4108/eai.13-7-2018.159621

  26. H. Barham, T. Daim, Identifying critical issues in smart city big data project implementation, in Proceedings of the 1st ACMEIGSCC Symposium on Smart Cities Communities SCC 2018 (2018). https://doi.org/10.1145/3236461.3241967

  27. M. Talha, N. Elmarzouqi, A. Abou El Kalam, Quality and security in big data: challenges as opportunities to build a powerful wrap-up solution. J. Ubiquitous Syst. Pervasive Netw. 12, 09–15 (2020). https://doi.org/10.5383/juspn.12.01.002

  28. I.A. Ajah, H.F. Nweke, Big data and business analytics: trends, platforms, success factors and applications. Big Data Cogn. Comput. 3, 1–30 (2019). https://doi.org/10.3390/bdcc3020032

    Article  Google Scholar 

  29. C. Walls, B. Barnard, Success factors of big data to achieve organisational performance: qualitative research. Expert J. Bus. Manag. 8, 17–56 (2020)

    Google Scholar 

  30. M.O. Ojo, Big data analytics solution: the implementation challenges in the financial service industry, 66, 37–39 (2016)

    Google Scholar 

  31. A.M. Heidari, Exploration of Big Data in Procurement—Benefits and Challenges (2018), p. 67

    Google Scholar 

  32. M. Khan, Challenges with big data analytics in service supply chains in the UAE. Manag. Decis. 57, 2124–2147 (2019). https://doi.org/10.1108/MD-06-2018-0669

    Article  Google Scholar 

  33. A.H. Johar, H. Khalid, Big data analytics adoption and implementation in public transportation: the gap in practise. Open Int. J. Inform. 7, 12–22 (2019)

    Google Scholar 

  34. D. Tykheev, Big data in marketing (2018)

    Google Scholar 

  35. D.A. Kolkman, R. Sneep, Challenges to Data Science Projects with SMEs (2019)

    Google Scholar 

  36. S. Coleman, R. Göb, G. Manco, A. Pievatolo, X. Tort-Martorell, M.S. Reis, How can SMEs benefit from big data? Challenges and a path forward. Qual. Reliab. Eng. Int. 32, 2151–2164 (2016). https://doi.org/10.1002/qre.2008

    Article  Google Scholar 

  37. F.P. Sejahtera, W. Wang, M. Indulska, S. Sadiq, Enablers and inhibitors of effective use of big data: insights from a case study, in Proceedings of the 22nd Pacific Asia Conference on Information Systems—Opportunities and Challenges for the Digitized Society: Are We Ready?, PACIS 2018 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sunet Eybers .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Milicevic, M., Eybers, S. (2022). The Challenges of Data Analytics Implementations: A Preliminary Literature Review. In: Saraswat, M., Roy, S., Chowdhury, C., Gandomi, A.H. (eds) Proceedings of International Conference on Data Science and Applications . Lecture Notes in Networks and Systems, vol 288. Springer, Singapore. https://doi.org/10.1007/978-981-16-5120-5_3

Download citation

Publish with us

Policies and ethics