Abstract
Big Data and Artificial Intelligence (BD&AI) have become so pervasive, and the opportunities they present so transformative, that they are viewed as essential for competitive growth. Since the number of firms adopting BD&AI technologies is growing exponentially, the demand for BD&AI practitioners is also growing at a rapid rate. However, several studies indicate that there is a BD&AI talent shortage and skills gap between labor market requirements and expertise available in the current workforce. This talent shortage and skills gap are now recognized as a crucial impediment in leveraging BD&AI for economic growth at the local, national, and global levels. This research aims to identify BD&AI workforce trends, gaps, and opportunities by using bibliometric analysis and extracting insights from job posting data. The study team first conducted bibliometric research and built word co-occurrence diagrams using BD&AI related articles published in high-impact journals to determine technological changes impacting various industry domains. The team then collected job postings data and summarized the skill sets required to be competitive in industries driven by BD&AI. Finally, the study team evaluated the curricula of BD&AI programs at various colleges and universities educating the future workforce and conducted a SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis to bridge the gaps between industry needs and academic training. This multi-step research framework forecasts oncoming technological changes in various industry clusters, workforce skills that are and will be needed, and provides recommendations for a workforce development roadmap so that businesses can gain a competitive advantage through the use of BD&AI.
Similar content being viewed by others
Notes
NJ call for research: https://nj.gov/governor/news/news/562018/approved/20181105a.shtml.
US government AI commitment: https://www.govconwire.com/2019/02/white-house-launches-american-ai-initiative-via-executive-order/.
References
Aasheim, C., Rutner, P., Williams, S., Gardiner, A., Rutner, P., & Gardiner, A. (2015). Big data analytics and data science undergraduate degree programs. In Proceedings of the Decision Sciences Institute Annual Meeting (pp. 338–359).
Agarwal, R., Chowdhury, M. M. H., & Paul, S. K. (2018). The Future of Manufacturing Global Value Chains, Smart Specialization and Flexibility. Global Journal of Flexible Systems Management, 19(1), 1–2
Agatonovic-Kustrin, S., & Beresford, R. (2000). Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research. Journal of Pharmaceutical and Biomedical Analysis, 22(5), 717–727
Ahmad, T. (2019). Scenario based approach to re-imagining future of higher education which prepares students for the future of work. Higher Education, Skills and Work-based Learning, 10(1), 217–238
Amado, A., Cortez, P., Rita, P., & Moro, S. (2018). Research trends on Big Data in Marketing: A text mining and topic modeling based literature analysis. European Research on Management and Business Economics, 24(1), 1–7
Anderson, A., Bravenboer, D., & Hemsworth, D. (2012). The role of universities in higher apprenticeship development. Higher Education, Skills and Work-based Learning, 2(3), 240–255
Appiah-Kubi, P., Johnson, M., & Trappe, E. (2019). Service Learning in Engineering Technology: Do Students Have Preferences on Project Types? - ProQuest. Journal of Engineering Technology, 36(1), 32–41
Arboleda, P. (2018). Consumers want connected medical devices, but demand for digital experts could put further strains on the talent pool for medtech. Deloitte. https://blogs.deloitte.com/centerforhealthsolutions/consumers-connected-medical-devices-demand-digital-experts-strains-talent-pool-medtech/. Accessed 10 February 2020
Asri, H., Mousannif, H., Al Moatassime, H., & Noel, T. (2015). Big data in healthcare: Challenges and opportunities. In Proceedings of 2015 International Conference on Cloud Computing Technologies and Applications. Institute of Electrical and Electronics Engineers Inc.
Baro, E., Degoul, S., Beuscart, R., & Chazard, E. (2015). Toward a literature-driven definition of big data in healthcare. BioMed Research International, 2015(1), 1–9
Beilby, J. (2018). Workforce Innovation: Embracing Emerging Technologies. Focus|Profesional, 47(8), 522–524.
Bharathi, S. V. (2017). Prioritizing and Ranking the Big Data Information Security Risk Spectrum. Global Journal of Flexible Systems Management, 18(3), 183–201
Bier, J., & Caram, C. (2019). The Finance Workforce in a Digital World. Deloitte. https://www2.deloitte.com/us/en/pages/finance-transformation/articles/future-of-finance-jobs-in-digital-world.html. Accessed 26 January 2021
Big Data Senior Steering Group. (2016). The Federal Big Data Research and Development Strategic Plan: The Networking and Information Technology Research and Developmet program. www.nitrd.gov. Accessed 30 October 2019
BioNJ. (2018). The New Jersey Biopharma Industry: A Prescription for Growth. https://bionj.org/wp-content/uploads/2018/02/BioNJ-Full-White-Paper-012918.pdf
Börner, K., Chen, C., & Boyack, K. W. (2005). Visualizing knowledge domains. Annual Review of Information Science and Technology, 37(1), 179–255
Cegielski, C. G., & Jones-Farmer, L. A. (2016). Knowledge, Skills, and Abilities for Entry-Level Business Analytics Positions: A Multi-Method Study. Decision Sciences Journal of Innovative Education, 14(1), 91–118
Cockcroft, S., & Russell, M. (2018). Big Data Opportunities for Accounting and Finance Practice and Research. Australian Accounting Review, 28(3), 323–333
Colombo, E., Mercorio, F., & Mezzanzanica, M. (2019). AI meets labor market: Exploring the link between automation and skills. Information Economics and Policy, 47, 27–37
European Commision. (2014). Horizon 2020: EU framework programme for research and innovation. International Journal of Disaster Resilience in the Built Environment, 5(2), 1–32
Committee on Envisioning the Data Science Discipline. (2018). Data Science for Undergraduates. Data Science for Undergraduates. National Academies Press. https://www.nap.edu/catalog/25104/data-science-for-undergraduates-opportunities-and-options
Courtois, J.-P. (2019). Harnessing the power of AI to transform agriculture – The Official Microsoft Blog. https://blogs.microsoft.com/blog/2019/08/07/harnessing-the-power-of-ai-to-transform-agriculture/. Accessed 3 November 2019
Davenport, T., & Kalakota, R. (2019). The potential for artificial intelligence in healthcare. Future Healthcare Journal, 6(2), 94–98
Di Vaio, A., Palladino, R., Hassan, R., & Escobar, O. (2020). Artificial intelligence and business models in the sustainable development goals perspective: A systematic literature review. Journal of Business Research, 121(1), 283–314
Donovan, F. (2017). Big data analytics is expected to have the biggest technology impact on the pharmaceutical industry in 2019, according to a survey of pharm professionals by GlobalData. HIT Infrastructure. https://hitinfrastructure.com/news/big-data-analytics-to-have-major-impact-on-pharma-next-year
Erevelles, S., Fukawa, N., & Swayne, L. (2016). Big Data consumer analytics and the transformation of marketing. Journal of Business Research, 69(2), 897–904
Grover, P., & Kar, A. K. (2017). Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature. Global Journal of Flexible Systems Management, 18(3), 203–229
Gunasekaran, A., Dubey, R., & Singh, S. P. (2016). Flexible Sustainable Supply Chain Network Design: Current Trends, Opportunities and Future. Global Journal of Flexible Systems Management, 17(2), 109–112
Hamet, P., & Tremblay, J. (2017). Artificial intelligence in medicine. Metabolism: Clinical and Experimental, 69(1), S36–S40.
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019). The practical implementation of artificial intelligence technologies in medicine. Nature Medicine, 25(1), 30–36
House of Lords, & Select Committee on Artificial Intelligence. (2018). AI in the UK: Ready, Willing and Able? Report of Session 2017–19.
Irani, Z., Sharif, A. M., Lee, H., Aktas, E., & Topaloğluvan’t Wout, T., & Huda, S., Z. (2018). Managing food security through food waste and loss: Small data to big data. Computers and Operations Research, 98(1), 367–383
Johnson, M. E., Albizri, A., & Jain, R. (2020). Exploratory analysis to identify concepts, skills, knowledge, and tools to educate business analytics practitioners. Decision Sciences Journal of Innovative Education, 18(1), 90–118
Johnson, M. E., & Berenson, M. L. (2019). Choosing among computational software tools to enhance learning in introductory business statistics. Decision Sciences Journal of Innovative Education, 17(3), 214–238
Kapareliotis, I., Voutsina, K., & Patsiotis, A. (2019). Internship and employability prospects: assessing student’s work readiness. Higher Education, Skills and Work-based Learning, 9(4), 538–549
Kent, J. (2018). Deep Learning, Big Data Fuel Medical Device for Predicting Seizures. Health IT Analytics. https://healthitanalytics.com/news/deep-learning-big-data-fuel-medical-device-for-predicting-seizures. Accessed 10 February 2020
Kokina, J., & Blanchette, S. (2019). Early evidence of digital labor in accounting: Innovation with Robotic Process Automation. International Journal of Accounting Information Systems, 35(100431), 1–12
Kuc-Czarnecka, M., & Olczyk, M. (2020). How ethics combine with big data: A bibliometric analysis. Humanities and Social Sciences Communications, 7(1), 1–9
LaborInsight. (2018). Labor Insight – Real Time Market Data. Burning Glass Technologies. https://www.burning-glass.com/products/labor-insight/
Lee, S. (2010). Citation Indexing: ISI’s Web of Science. The University of Oklahoma Libraries. https://www.ou.edu/webhelp/librarydemos/isi/
Li, B. H, Hou, B. C, Yu, W. T, Lu, X. B, & Yang, C. W. (2017). Applications of artificial intelligence in intelligent manufacturing: a review. Frontiers of Information Technology and Electronic Engineering, 18(1), 86–96
Lin, S. Y., Mahoney, M. R., & Sinsky, C. A. (2019). Ten ways artificial intelligence will transform primary care. Journal of General Internal Medicine, 34(8), 1626–1630
Loucks, J., Davenport, T., & Schatsky, D. (2018). State of AI in the Enterprise,. Deloitte Insights. https://www2.deloitte.com/content/dam/Deloitte/co/Documents/about-deloitte/DI_State-of-AI-in-the-enterprise-2nd-ed.pdf
New Jersey Business Magazine. (2017). CyberSeek details supply and demand of cybersecurity workers in NJ. New Jersey Business. https://njbmagazine.com/njb-news-now/cyberseek-details-supply-demand-cybersecurity-workers-nj/
Mazurowski, M. A. (2019). Artificial intelligence may cause a significant disruption to the radiology workforce. Journal of the American College of Radiology, 16(8), 1077–1082
Merigó, J. M., Muller, C., Modak, N. M., & Laengle, S. (2019) Research in Production and Operations Management: A University-Based Bibliometric Analysis, Global Journal of Flexible Systems Management, 20(1), 1–29.
Monegain, B. (2016). Amazon, Google, IBM, Microsoft join forces with MIT and Harvard on cloud-based genome analysis toolkit. Healthcare IT News. https://www.healthcareitnews.com/news/amazon-google-ibm-microsoft-join-forces-mit-and-harvard-cloud-based-genome-analysis-toolkit
Murthy, U. S., & Geerts, G. L. (2017). An REA ontology-based model for mapping big data to accounting information systems elements. Journal of Information Systems, 31(3), 45–61
O’Donovan, P., Leahy, K., Bruton, K., & O’Sullivan, D. T. J. (2015). Big data in manufacturing: a systematic mapping study. Journal of Big Data, 2(1), 1–22
Palmaccio, M., Dicuonzo, G., & Belyaeva, Z. S. (2020). The internet of things and corporate business models: A systematic literature review. Journal of Business Research (in press).
Patil, M., & Suresh, M. (2019). Modelling the enablers of workforce agility in IoT projects: A TISM approach. Global Journal of Flexible Systems Management, 20(2), 157–175
Pérez-Pérez, M., Kocabasoglu-Hillmer, C., Serrano-Bedia, A. M., & López-Fernández, M. C. (2019) Manufacturing and Supply Chain Flexibility: Building an Integrative Conceptual Model Through Systematic Literature Review and Bibliometric Analysis, Global Journal of Flexible Systems Management, 20(Suppl 1), S1–S23.
PwC. (2018). AI and digital labor in financial services. https://www.pwc.com/us/en/industries/financial-services/research-institute/top-issues/artificial-intelligence.html. Accessed 26 January 2021
Rajnai, Z., & Kocsis, I. (2017). Labor market risks of industry 4.0, digitization, robots and AI. In IEEE 15th International Symposium on Intelligent Systems and Informatics, Proceedings (pp. 343–346). Institute of Electrical and Electronics Engineers Inc.
Rao, A. S., Verweij, G., & Cameron, E. (2017). Sizing the prize: What’s the real value of AI for your business and how can you capitalise? PwC. https://www.pwc.com/gx/en/issues/analytics/assets/pwc-ai-analysis-sizing-the-prize-report.pdf.
Renzi, C., Leali, F., Cavazzuti, M., & Andrisano, A. O. (2014). A review on artificial intelligence applications to the optimal design of dedicated and reconfigurable manufacturing systems. International Journal of Advanced Manufacturing Technology, 72(1–4), 403–418
Thomson Reuters. (2010). Overview of Web of Science. https://clarivate.com/webofsciencegroup/solutions/web-of-science/. Accessed 25 January 2021
Rosendale, J. A. (2017). Gauging the value of MOOCs: An examination of American employers’ perceptions toward higher education change. Higher Education, Skills and Work-based Learning, 7(2), 141–154
Shukla, S. K., Sushil, and Sharma, M. K. (2019). Managerial Paradox Toward Flexibility: Emergent Views Using Thematic Analysis of Literature. Global Journal of Flexible Systems Management, 20(4), 349–370.
Singh, L. P., & Challa, R. T. (2016). integrated forecasting using the discrete wavelet theory and artificial intelligence techniques to reduce the bullwhip effect in a supply Chain. Global Journal of Flexible Systems Management, 17(2), 157–169
Singh, S., Akbani, I., & Dhir, S. (2020). Service innovation implementation: a systematic review and research agenda. Service Industries Journal, 40(7–8), 491–517
Singh, S., & Dhir, S. (2019). Structured review using TCCM and bibliometric analysis of international cause-related marketing, social marketing, and innovation of the firm. International Review on Public and Nonprofit Marketing, 16(2–4), 335–347
Singh, S., Dhir, S., Das, V. M., & Sharma, A. (2020). Bibliometric overview of the technological forecasting and social change journal: Analysis from 1970 to 2018. Technological Forecasting and Social Change, 154(2020–119963), 1–26
Spence, S., & Hyams-Ssekasi, D. (2015). Developing business students’ employability skills through working in partnership with a local business to deliver an undergraduate mentoring programme. Higher Education, Skills and Work-based Learning, 5(3), 299–314
Srivastava, S., Singh, S., & Dhir, S. (2020). Culture and International business research: A review and research agenda. International Business Review, 4(19), 101709–101711
Stone, P., Brooks, R., Brynjolfsson, E., Calo, R., Etzioni, O., Hager, G., et al. (2016). Artificial intelligence and life in 2030. Stanford University. Stanford University Stanford, CA. https://ai100.stanford.edu/2016-report
Sung, A., Leong, K., Sironi, P., O’Reilly, T., & McMillan, A. (2019). An exploratory study of the FinTech (Financial Technology) education and retraining in UK. Journal of Work-Applied Management, 11(2), 187–198
Tang, R., & Sae-Lim, W. (2016). Data science programs in US higher education: An exploratory content analysis of program description, curriculum structure, and course focus. Education for Information, 32(3), 269–290
Toorajipour, R., Sohrabpour, V., Nazarpour, A., Oghazi, P., & Fischl, M. (2021). Artificial intelligence in supply chain management: A systematic literature review. Journal of Business Research, 122(1), 502–517
Topol, E. J. (2019). High-performance medicine: The convergence of human and artificial intelligence. Nature Medicine, 25(1), 44–56
US Bureau of Economic Analysis. (2015). GDP & Personal Income. https://apps.bea.gov/iTable/index_regional.cfm. Accessed 30 October 2019
USM AI Professionals. (2020). How AI Technology Is Redefining the Manufacturing Workforce. https://www.usmsystems.com/ai-technology-in-manufacturing-industry/. Accessed 26 January 2021
Vance, A. (2009). Hadoop, Analytical Software, Finds Uses Beyond Search. The New York Times. https://www.nytimes.com/2009/03/17/technology/business-computing/17cloud.html. Accessed 26 January 2021
Varian, H. R. (2014). Big data: New tricks for econometrics. Journal of Economic Perspectives, 28(2), 3–28
Vasarhelyi, M. A., Kogan, A., & Tuttle, B. M. (2015). Big data in accounting: An overview. Accounting Horizons, 29(2), 381–396
Waltman, L., van Eck, N. J., & Noyons, E. C. M. (2010). A unified approach to mapping and clustering of bibliometric networks. Journal of Informetrics, 4(4), 629–635
Warren, J. D., Moffitt, K. C., & Byrnes, P. (2015). How big data will change accounting. Accounting Horizons, 29(2), 397–407
Weber, L. (2019). The Hybrid Skills that Tomorrows Jobs Will Require. Wall Street Journal
White House Office of Science and Technology Policy. (2018). Summary of the 2018 White House Summit on Artificial Intellience for American Industry. https://www.whitehouse.gov/wp-content/uploads/2018/05/Summary-Report-of-White-House-AI-Summit.pdf
Whitton, M. (2015). Scopus vs Web of Science. https://unisouthamptonlibrary.wordpress.com/2015/01/22/scopus-vs-web-of-science/. Accessed 25 January 2021
Wixom, B., Ariyachandra, T., Douglas, D., Goul, M., Gupta, B., Iyer, L., et al. (2014). The current state of business intelligence in academia: The arrival of big data. Communications of the Association for Information Systems, 34(1), 1–13
Yao, X., Zhou, J., Zhang, J., & Boer, C. R. (2017). From Intelligent Manufacturing to Smart Manufacturing for Industry 4.0 Driven by Next Generation Artificial Intelligence and Further on. In 5th International Conference on Enterprise Systems: Industrial Digitalization by Enterprise Systems (pp. 311–318).
Yu, K. H., Beam, A. L., & Kohane, I. S. (2018). Artificial intelligence in healthcare. Nature Biomedical Engineering, 2(10), 719–731
Zhong, R. Y., Newman, S. T., Huang, G. Q., & Lan, S. (2016). Big Data for supply chain management in the service and manufacturing sectors: Challenges, opportunities, and future perspectives. Computers and Industrial Engineering, 101(1), 572–591
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The Authors declare that there is no conflict of interest. All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
Disclosures and Declarations
This work was funded by New Jersey Governor Phil Murphy’s Future of Work Task Force. The research team are members of the New Jersey Big Data Alliance, a consortium of 17 higher education institutions in New Jersey which provides leadership in research, education, and outreach in advanced computation and Big Data for the state.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Johnson, M., Jain, R., Brennan-Tonetta, P. et al. Impact of Big Data and Artificial Intelligence on Industry: Developing a Workforce Roadmap for a Data Driven Economy. Glob J Flex Syst Manag 22, 197–217 (2021). https://doi.org/10.1007/s40171-021-00272-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40171-021-00272-y