Abstract
How can big data be leveraged to create value and what are the main barriers that prevent companies from benefiting from the full potential of data and analytics? This chapter describes the phenomenon of big data and how its use through data science is dramatically changing the basis of competition. The chapter also delves into the main organizational challenges faced by companies in extracting value from data, namely the promotion of a data-driven culture, the design of the internal and external structures, and the acquisition of the technical and behavioral skills required by big data professional roles. The aim and the structure of the book are illustrated. Shedding light on the human side of big data through the lense of emotional intelligence, the book aims to provide an in-depth understanding of the behavioral competencies that big data profiles require in order to achieve a higher performance.
The point is not to be dazzled by the volume of data, but rather to analyze it – to convert it into insights, innovations, and business value.
(Davenport 2014: 2)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
BARC. (2015). Big data use cases. Getting real on data monetization. Retrieved from https://www.sas.com/content/dam/SAS/bp_de/doc/studie/ba-st-barc-bigdata-use-cases-de-2359583.pdf
BARC. (2019). BI Trend Monitor 2019. The world’s largest survey of BI trends. Retrieved from https://www.sitsi.com › download
Beck, M., & Libert, B. (2017, February 15). The rise of AI makes emotional intelligence more important. Harvard Business Review.
Berners-Lee, T., & Shadbolt, N. (2011, December 31). There’s gold to be mined from all our data. The Times (pp. 1–2).
Bowers, M. R., Camm, J. D., & Chakraborty, G. (2018). The evolution of analytics and implications for industry and academic programs. INFORMS Journal on Applied Analytics, 48(6), 487–499.
Boyatzis, R. E. (2009). Competencies as a behavioral approach to emotional intelligence. Journal of Management Development, 28(9), 749–770.
Brynjolfsson E., Hitt L. M., & Kim H. H. (2011). Strength in numbers: How does data-driven decision making affect firm performance? Working paper, 2011. SSRN working paper. Available at SSRN: http://ssrn.com/abstract=1819486
Chen, C. L. P., & Zhang, C. Y. (2014). Data-intensive applications, challenges, techniques and technologies: A survey on big data. Information Sciences, 275, 314–347.
Chen, H., Chiang, R. H. L., & Storey, V. C. (2012). Business intelligence and analytics: From big data to big impact. MIS Quarterly, 36(4), 1165–1188.
Cleveland, W. S. (2001). Data science: An action plan for expanding the technical areas of the field of statistics. International Statistical Review, 69(1), 21–26.
Costa, C., & Santos, M. Y. (2017). The data scientist profile and its representativeness in the European e-competency framework and the skills framework for the information age. International Journal of Information Management, 37(6), 726–734.
Davenport, T. H. (2014). Big data at work: Dispelling the myths, uncovering the opportunities. Boston: Harvard Business Review Press.
Davenport, T. H., & Kim, J. (2013). Keeping up with the quants. Your guide to understanding and using analytics. Boston: Harvard Business Review Press.
Davenport, T. H., & Patil, D. J. (2012). Data scientist: The sexiest job of the 21st century. Harvard Business Review, 90(October), 70–76.
Davies, R. (2016). Big data and data analytics. The potential for innovation and growth. European Parliamentary Research Service.
De Mauro, A., Greco, M., & Grimaldi, M. (2016). A formal definition of big data based on its essential features. Library Review, 65(3), 122–135.
Dresner Advisory Services Publishers. (2017, December 20). Big data Analytics market study. Retrieved from https://www.microstrategy.com/getmedia/cd052225-be60-49fd-ab1c-4984ebc3cde9/Dresner-Report-Big_Data_Analytic_Market_Study-WisdomofCrowdsSeries-2017.pdf
Gandomi, A., & Haider, T. M. (2015). Beyond the hype: Big data concepts, methods, and analytics. International Journal of Information Management, 35, 137–144.
Gartner. (2018, February 5). Survey shows organizations are slow to advance in data and analytics. Retrieved from https://www.gartner.com/en/newsroom/press-releases/2018-02-05-gartner-survey-shows-organizations-are-slow-to-advance-in-data-and-analytics
George, G., Haas, M. R., & Pentland, A. (2014). Big data and management. Academy of Management Journal, 57(2), 321–325.
Goleman, D. (1998). Working with emotional intelligence. New York: Bantam Dell Pub Group.
Google Trends. (2019). Searches for the term Data Science. Retrieved 19 July 2019 from https://www.google.com/trends/explore#q=data%20science
Granville, V. (2014). Developing analytics talent. Becoming a data scientist. Indianapolis: Wiley.
Günther, W. A., Mehrizi, M. H. R., Huysman, M., & Feldberg, F. (2017). Debating big data: A literature review on realizing value from big data. Journal of Strategic Innovation Information Systems, 26(3), 191–209.
Jain, V. K. (2017). Big Data and Hadoop. New Delhi: Khanna Publishing.
Kane, G. C., Palmer, D., Phillips, A. N., Kiron, D., & Buckley, N. (2016). Aligning the organization for its digital future. Cambridge, Massachusetts, United States: MIT Sloan management review and Deloitte University Press.
Kim, J. Y., & Lee, C. K. (2016). An empirical analysis of requirements for data scientists using online job postings. International Journal of Software Engineering and Its Applications, 10(4), 61–172.
Kwon, O., Lee, N., & Shin, B. (2014). Data quality management, data usage experience and acquisition intention of big data analytics. International Journal of Information Management, 34(3), 387–394.
Lee, I. (2017). Big data: Dimensions, evolution, impacts, and challenges. Business Horizons, 60(3), 293–303.
Li, K. C., Hai, J., & Zomaya, A. (2017). Big data management and processing. New York: Imprint Chapman and Hall/CRC.
LinkedIn. (2018). LinkedIn Workforce Report. Retrieved from https://economicgraph.linkedin.com/resources/linkedin-workforce-report-december-2018
Marr, B. (2017, January 23). Really big data at Walmart: Real-time insights from their 40+ petabyte data cloud. Forbes.
McKinsey Analytics. (2018, January). Analytics comes of age. Retrieved from https://www.mckinsey.com/~/media/McKinsey/Business%20Functions/McKinsey%20Analytics/Our%20Insights/Analytics%20comes%20of%20age/Analytics-comes-of-age.ashx
McKinsey and Company. (2017, December). The 5 trademarks of agile organizations. Retrieved from https://www.mckinsey.com/business-functions/organization/our-insights/the-five-trademarks-of-agile-organizations
McKinsey Global Institute. (2016, December). The age of analytics: Competing in a data-driven world. Retrieved from https://www.mckinsey.com/business-functions/mckinsey-analytics/our-insights/the-age-of-analytics-competing-in-a-data-driven-world
Mishra, D., Luo, Z., Jiang, S., Papadopoulos, T., & Dubey, R. (2017). A bibliographic study on big data: Concepts, trends and challenges. Business Process Management Journal, 23(3), 555–573.
NewVantage Partners. (2019). Big data and AI executive survey 2019. Executive Summary of Findings. Retrieved from https://newvantage.com/wp-content/uploads/2018/12/Big-Data-Executive-Survey-2019-Findings-Updated-010219-1.pdf
Pigni, F., Piccoli, G., & Watson, R. (2016). Digital data streams: Creating value from the real-time flow of big data. California Management Review, 58(3), 5–25.
Rialti, R., Marzi, G., Ciappei, C., & Caputo, A. (2018). Reframing agile organization. Do big data analytics capabilities matter? Academy of Management Global Proceedings.
Sanders, N. R. (2016). How to use big data to drive your supply chain. California Management Review, 58(3), 26–48.
Sivarajah, U., Kamal, M. M., Irani, Z., & Weerakkody, V. (2016). Critical analysis of big data challenges and analytical methods. Journal of Business Research, 70, 263–286.
Vidgen, R., Shaw, S., & Grant, D. B. (2017). Management challenges in creating value from business analytics. European Journal of Operational Research, 261(2), 626–639.
World Economic Forum. (2018). The Future of Jobs Report 2018. Retrieved from http://www3.weforum.org/docs/WEF_Future_of_Jobs_2018.pdf
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2020 The Author(s)
About this chapter
Cite this chapter
Bonesso, S., Bruni, E., Gerli, F. (2020). The Organizational Challenges of Big Data. In: Behavioral Competencies of Digital Professionals. Palgrave Pivot, Cham. https://doi.org/10.1007/978-3-030-33578-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-33578-6_1
Published:
Publisher Name: Palgrave Pivot, Cham
Print ISBN: 978-3-030-33577-9
Online ISBN: 978-3-030-33578-6
eBook Packages: Business and ManagementBusiness and Management (R0)