Abstract
A key objective of global policies on Artificial Intelligence (AI) is to foster AI research for sustainable development (SD). In this paper, we analyze the inclusion of SD in AI research indexed by the IEEE Xplore database from 2000 to 2019. We address three critical questions: (1) To what extent is AI research addressing the sustainable development goals (SDGs)? (2) Which subject areas of AI show an emerging interest in SD? And (3) What patterns of collaboration between regions of the world are being stimulated by AI? Our scientometric analysis consists of (1) Identifying the number of AI papers that address SDGs in their titles, abstracts, and keywords. (2) Developing a composite indicator based on the number of documents produced, scientific impact, and inventive impact to distinguish areas with an emerging interest in SD; (3) Exploring co-authorship networks at three levels: region, income group, and country. The overall results show that a small share of papers is explicitly focused on SD. Our composite indicator allowed us to identify an emerging interest in SD from Ultrasonics, Ferroelectrics, and Frequency Control, Education, Consumer Electronics, Electrical Engineering, Electromagnetic Compatibility and Interference. Specifically, on AI subjects, we found emerging interests in Prediction Methods, Computation Theory, Machine Learning, Learning (artificial intelligence), and Biological Neural Networks. Inter-regional and inter-income group collaboration are limited, and network power is concentrated in a few countries. The results could be useful to improve the connection between technical knowledge, strategic planning for S&T investment, and SD policies.
Similar content being viewed by others
Data availability
Upon request, we can make available our database, but this cannot be disclosed publicly because of IEEE’s API terms and conditions.
Notes
The search was performed over all publication fields in the database, using “artificial intelligence”. The data was obtained through the IEEE Xplore API using PhP.
\(Accuracy = \frac{TP + TN}{{TP + TN + FP + FN}}\); \(Balanced accuracy = \frac{TP}{{TP + FN}} + \frac{TN}{{TN + FP}} / 2\)
\(Recall = \frac{TP}{{TP + FN}}\)
\(Precision = \frac{TP}{{TP + FP}}\)
\(F_{{\upbeta }} = \left( {1 + {\upbeta }^{2} } \right)\frac{Precision \times Recall}{{\left( {{\upbeta }^{2} \times Precision} \right) + recall}}\)
In the terms of this study, kappa can be described as \(k = \frac{{2 \times \left( {TP \times TN - FN \times FP} \right) }}{{\left( {TP + FP} \right) \times \left( {FP + TN} \right) + \left( {TP + FN} \right) \times \left( {FN + TN} \right) }}\)
References
Armitage, C. S., Lorenz, M., & Mikki, S. (2020). Mapping scholarly publications related to the sustainable development goals: Do independent bibliometric approaches get the same results? Quantitative Science Studies, 1(3), 1092–1108.
Bavelas, A. (1948). A mathematical model for group structures. Applied Anthropology, 7(3), 16–30.
Brandes, U. (2001). A faster algorithm for betweenness centrality. Journal of Mathematical Sociology, 25(2), 163–177.
Bautista-Puig, N., Aleixo, A. M., Leal, S., Azeiteiro, U., & Costas, R. (2021). Unveiling the research landscape of sustainable development goals and their inclusion in higher education institutions and research centers: major trends in 2000–2017. Frontiers in Sustainability, 2, 620743. https://doi.org/10.3389/frsus.2021.620743
Breschi, S., Lissoni, F., & Montobbio, F. (2005). From publishing to patenting. Do productive scientists turn into academic inventors? Revue D’économie Industrielle, 110, 75–102.
Cassi, L., Lahatte, A., Rafols, I., Sautier, P., & De Turckheim, E. (2017). Improving fitness: Mapping research priorities against societal needs on obesity. Journal of Informetrics, 11(4), 1095–1113.
Chavarro, D., Perez-Taborda, J. A., & Avila, A. (2021). Connecting Brain and Heart: Artificial Intelligence for Sustainable Development. In 18th International conference on scientometrics and informetrics ISSI 2021 (pp. 229–240). ISSI.
Chavarro, D., Ràfols, I., & Tang, P. (2018). To what extent is inclusion in the seb of science an indicator of journal ‘quality’? Research Evaluation, 27(2), 106–118.
Chavarro, D., Tang, P., & Ràfols, I. (2017a). Why researchers publish in non-mainstream journals: Training, knowledge bridging, and gap filling. Research Policy, 46(9), 1666–1680.
Chavarro, D., Vélez, M. I., Tovar, G., Montenegro, I., Hernández, A., & Olaya, A. (2017b). Los Objetivos de Desarrollo Sostenible en Colombia y el aporte de la ciencia, la tecnología y la innovación. Colciencias. https://minciencias.gov.co/sites/default/files/ctei_y_ods_-_documento_de_trabajo.pdf. Accessed 20 Jan 2021.
del Río Castro, G., Fernández, M. C. G., & Colsa, Á. U. (2020). Unleashing the convergence amid digitalization and sustainability towards pursuing the sustainable development goals (SDGs): A holistic review. Journal of Cleaner Production, 280, 122204.
European Commission. (2020). Emerging trends in STI policy. European Commission. https://stiplab.github.io/R2r/Emerging%20trends%20in%20STI%20policy.html. Accessed 1 Feb 2021.
European Commission. (2021). “Proposal for a Regulation of the European parliament and of the council laying down harmonised rules on artificial intelligence (Artificial Intelligence Act) and amending certain Union legislative acts”. https://eur-lex.europa.eu/resource.html?uri=cellar:e0649735-a372-11eb-9585-01aa75ed71a1.0001.02/DOC_1&format=PDF. Accessed 1 Feb 2021.
European Parliament. (2020). Ethics of artificial intelligence. European Parliament. https://www.europarl.europa.eu/RegData/etudes/STUD/2020/634452/EPRS_STU(2020)634452_EN.pdf. Accessed 2 Feb 2021.
European Patent Office. (2020). Patents and the fourth industrial revolution. European Patent Office. http://documents.epo.org/projects/babylon/eponet.nsf/0/06E4D8F7A2D6C2E1C125863900517B88/$File/patents_and_the_fourth_industrial_revolution_study_2020_en.pdf. Accessed 2 Feb 2021.
Elsevier (2020). Mapping research to advance the SDGs. Elsevier. https://www.elsevier.com/connect/sdg-report. Accessed 3 Feb 2021.
Freeman, L. C. (1977). A set of measures of centrality based on betweenness. Sociometry, 40(1), 35. https://doi.org/10.2307/3033543
Gardner, H. E. (2000). Intelligence reframed: Multiple intelligences for the 21st century. Hachette UK.
Gephi. (2021). GraphDistance (gephi-toolkit 0.9.2 API). https://gephi.org/gephi-toolkit/0.9.2/apidocs/org/gephi/statistics/plugin/GraphDistance.html. Accessed 1 Apr 2021.
Goodall, J. (2014). Interview. Brainpickings. https://www.brainpickings.org/2014/09/30/jane-goodall-empathy/. Accessed 4 Feb 2021.
Harari, Y. N. (2017). Reboot for the AI revolution. Nature News, 550(7676), 324.
IEEE. (2019). IEEE position statement on artificial intelligence. IEEE. https://globalpolicy.ieee.org/wp-content/uploads/2019/06/IEEE18029.pdf. Accessed 4 Apr 2021.
IEEE. (2021a). IEEE Thesaurus. IEEE. https://www.ieee.org/content/dam/ieee-org/ieee/web/org/pubs/ieee-thesaurus.pdf. Accessed 4 Apr 2021.
IEEE. (2021b). Artificial intelligence systems (AIS) related standards. IEEE. https://standards-ieee-org.ezproxy.utp.edu.co/initiatives/artificial-intelligence-systems/standards.html. Accessed 4 Apr 2021.
Kagermann, H., Anderl, R., Gausemeier, J., Schuh, G., & Wahlster, W. (Eds.). (2016). Industrie 4.0 in a global context: Strategies for cooperating with international partners. Herbert Utz Verlag.
King, R. (2011). Power and networks in worldwide knowledge coordination: The case of global science. Higher Education Policy, 24(3), 359–376.
Klavans, R., Boyack, K. W., & Murdick, D. A. (2020). A novel approach to predicting exceptional growth in research. ArXiv. arXiv:2004.13159.
Kshetri, N. (2020). Artificial intelligence in developing countries. IEEE Annals of the History of Computing, 22(04), 63–68.
Kwiek, M. (2020). What large-scale publication and citation data tell us about international research collaboration in Europe: Changing national patterns in global contexts. Studies in Higher Education, 1–21.
Mou, X. (2019). Artificial intelligence: Investment trends and selected industry uses. World Bank. http://documents1.worldbank.org/curated/en/617511573040599056/pdf/Artificial-Intelligence-Investment-Trends-and-Selected-Industry-Uses.pdf
Navarro, J. (2018). The digital transformation imperative. An IDB science and business innovation agenda for the new industrial revolution. IDB. https://publications.iadb.org/en/digital-transformation-imperative-idb-science-and-business-innovation-agenda-new-industrial. Accessed 4 Apr 2021.
Nilson, N. (2010). The quest for artificial intelligence. Cambridge University Press.
OECD. (2020). Principles of AI. OECD. http://www.oecd.org/going-digital/ai/principles/. Accessed 4 Feb 2021.
Olechnicka, A., Ploszaj, A., & Celinska-Janowicz, D. (2019). The geography of scientific collaboration. Routledge.
OSDG. (2021). Home page. OSDG. https://osdg.ai/. Accessed 4 Feb 2021.
Osoba, O. A., & Welser, I. V. W. (2017). An intelligence in our image: The risks of bias and errors in artificial intelligence. Rand Corporation. https://www.rand.org/pubs/research_reports/RR1744.html. Accessed 15 Feb 2021.
Planes-Satorra, S., & Paunov, C. (2019). The digital innovation policy landscape. OECD. https://doi.org/10.1787/6171f649-en
Powers, D. M. (2020). Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv preprint arXiv:2010.16061.
Ràfols, I., Noyons, E., Confraria, H., & Ciarli, T. (2021). Visualising plural mappings of science for sustainable development goals (SDGs). ISSI 2021 Proceedings, 1, 949–955. https://kuleuven.app.box.com/s/kdhn54ndlmwtil3s4aaxmotl9fv9s329. Accessed 20 Feb 2021.
Russell, S. (2010). Artificial intelligence: A modern approach. Prentice Hall.
Samoili, S., Lopez Cobo, M., Delipetrev, B., Martinez-Plumed, F., Gomez Gutierrez, E. and De Prato, G. (2021). AI Watch. Defining artificial intelligence 2.0. Publications Office of the European Union. https://doi.org/10.2760/019901.
Schwab, K. (2017). The fourth industrial revolution. World Economic Forum.
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., Chen, Y., Lillicrap, T., Hui, F., Sifre, L., van den Driessche, G., Graepel, T., & Hassabis, D. (2017). Mastering the game of Go without human knowledge. Nature, 550(7676), 354–359. https://doi.org/10.1038/nature24270
Simmons, A. B., & Chappell, S. G. (1988). Artificial intelligence-definition and practice. IEEE Journal of Oceanic Engineering, 13(2), 14–42.
Sørensen, J., Tadayoni, R., & Henten, A. (2016). 5G-Boundary object or battlefield? Communications & Strategies, 102, 63–87.
UN. (2021). THE 17 GOALS|Sustainable development. https://sdgs.un.org/goals. Accessed 28 Feb 2021.
UNESCO. (2015). UNESCO science report: Towards 2030. UNESCO.
UNIDO. (2018). Industry 4.0 – The opportunities behind the challenges. Unido. https://www.unido.org/sites/default/files/files/2018-11/UNIDO_GC17_Industry40.pdf. Accessed 28 Feb 2021.
van Raan, A. F. (2005). For your citations only? Hot topics in bibliometric analysis. Measurement: Interdisciplinary Research and Perspectives, 3(1), 50–62.
Wagner, C. (2008). The new invisible college. Brookings Institution Press.
World Bank. (2021). World bank country and lending groups—World Bank Data Help Desk. https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups. Accessed 3 Mar 2021.
Yamashita, I., Murakami, A., Cairns, S., & Galindo-Rueda, F. (2021). Measuring the AI content of government-funded R&D projects: A proof of concept for the OECD Fundstat initiative (OECD Science, Technology, and Industry Working Papers No. 2021/09; OECD Science, Technology and Industry Working Papers, Vol. 2021/09). https://doi.org/10.1787/7b43b038-en
Zellmer-Bruhn, M. E., Forbes, D. P., Sapienza, H. J., & Borchert, P. S. (2021). Lab, gig or enterprise? How scientist-inventors form nascent startup teams. Journal of Business Venturing, 36(1), 106074.
Acknowledgements
This paper substantially extends the proceedings paper presented at the ISSI 2021 conference (Chavarro et al., 2021). We thank the IEEE for offering their open API, OSDGs for their web service to classify papers through machine learning, especially to Gusté Statulevičiūtė and Lukas Pukelis from PPMI. We also thank the Free and Open-source software community: MariaDB, R, Gephi, and Notepad++ teams for making available their software. Special thanks to an anonymous reviewer and to Professor Wolfgang Glänzel for their excellent suggestions.
Funding
This work was supported by the Ministry of Science, Technology, and Innovation of Colombia (MinCiencias) under Grant 848-2019 and the Colombian Society of Engineering Physics (SCIF), Colombia.
Author information
Authors and Affiliations
Contributions
The authors contributed equally to this work.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interests to the best of their knowledge.
Rights and permissions
About this article
Cite this article
Chavarro, D., Perez-Taborda, J.A. & Ávila, A. Connecting brain and heart: artificial intelligence for sustainable development. Scientometrics 127, 7041–7060 (2022). https://doi.org/10.1007/s11192-022-04299-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-022-04299-5
Keywords
- Artificial intelligence
- Sustainable development
- Engineering and society
- Research policy
- Emerging technologies