Avoid common mistakes on your manuscript.
We would like to thank Sauer and colleagues for their insightful comments [1] on our recent article in Intensive Care Medicine, in which we proposed a federated infrastructure for intensive care unit (ICU) data across Europe [2]. We agree that artificial intelligence (AI) could perpetuate biases in clinical medicine, but we believe federated learning (FL) plays an important role in fostering responsible and equitable AI.
FL allows real-time analysis of diverse, sensitive clinical data from multiple ICUs, crucial in critical decision-making and broader healthcare scenarios like pandemics. The decentralized nature of FL preserves privacy and enables up-to-date use of dynamic AI models based on various data sources. Institutions can contribute their unique expertise and data while retaining control over it. Establishing diverse health datasets from multiple ICUs is crucial for responsible AI. Currently, 31% (152 out of 494) of ICU AI models are trained on large publicly available datasets, such as the MIMIC dataset, which may need to be more adequately represented in different subpopulations [3]. For example, less than 10% (18,719 out of 189,415) of the patients registered in the two largest ICU databases globally are African-American, with the majority being white male patients [4]. FL can enhance patient representation across Europe and beyond, fostering more diverse and inclusive health datasets. This cross-border data and model-sharing framework standardizes data sharing and access and serves as a fundamental data infrastructure for practical AI implementation within ICUs, enabling the comparability of clinical ICU data.
While FL promotes inclusive health datasets, it needs to fully address the complex issue of social patterning in data generation. Effective FL requires robust data governance, comprehensive data management policies, and consensus on adopting a standard data model. However, the crux of enhancing the fairness and safety of AI systems in healthcare lies in first establishing standards that promote informed decision-making. For example, the lack of ethnicity and socioeconomic data collection in most ICUs outside the United States of America complicates understanding dataset composition and detecting potential biases in AI.
Initiatives like STANDING Together are, therefore, crucial in advocating for the collection and representation of diverse demographic data, fostering inclusivity and diversity in health datasets [5]. Uniform and consistent collection of protected personal characteristics in global patient health records is crucial. FL offers a unique opportunity to address this issue globally by integrating ethical and legal data standards into the federated data infrastructure and bringing together diverse datasets worldwide while preserving privacy.
Maintaining transparency at all stages of model development and deployment is essential to build an ecosystem that uses FL to foster responsible AI. This includes setting data standards for representing diverse demographic data, creating diverse datasets from multiple institutions, and transparently documenting the specifics of the AI model before clinical deployment [6].
In conclusion, while FL can facilitate inclusive global data collection and AI integration, addressing deep-rooted biases in medical AI requires an in-depth, multifaceted strategy.
References
Sauer CM, Pucher G, Celi LA (2024) Why federated learning will do little to overcome the deeply embedded biases in clinical medicine. Intensive Care Med. https://doi.org/10.1007/s00134-024-07491-8
van Genderen ME, Cecconi M, Jung C (2024) Federated data access and federated learning: improved data sharing, AI model development, and learning in intensive care. Intensive Care Med 50:974–977. https://doi.org/10.1007/s00134-024-07408-5
van de Sande D, van Genderen ME, Huiskens J, Gommers D, van Bommel J (2021) Moving from bytes to bedside: a systematic review on the use of artificial intelligence in the intensive care unit. Intensive Care Med 47:750–760
Sauer CM, Dam TA, Celi LA, Faltys M, de la Hoz MAA, Adhikari L, Ziesemer KA, Girbes A, Thoral PJ, Elbers P (2022) Systematic review and comparison of publicly available ICU data sets-a decision guide for clinicians and data scientists. Crit Care Med 50:E581–E588
Ganapathi S, Palmer J, Alderman JE, Calvert M, Espinoza C, Gath J, Ghassemi M, Heller K, Mckay F, Karthikesalingam A, Kuku S, Mackintosh M, Manohar S, Mateen BA, Matin R, McCradden M, Oakden-Rayner L, Ordish J, Pearson R, Pfohl SR, Rostamzadeh N, Sapey E, Sebire N, Sounderajah V, Summers C, Treanor D, Denniston AK, Liu XX (2022) Tackling bias in AI health datasets through the STANDING together initiative. Nat Med 28:2232–2233
van Genderen ME, van de Sande D, Hooft L, Reis AA, Cornet AD, Oosterhoff JHF, van der Ster BJP, Huiskens J, Townsend R, van Bommel J, Gommers D, van den Hoven J (2024) Charting a new course in healthcare: early-stage AI algorithm registration to enhance trust and transparency. NPJ Digit Med 7:119
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This comment refers to the article available online at https://doi.org/10.1007/s00134-024-07408-5.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which permits any non-commercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc/4.0/.
About this article
Cite this article
van Genderen, M.E., van de Sande, D., Cecconi, M. et al. Federated learning: a step in the right direction to improve data equity. Intensive Care Med (2024). https://doi.org/10.1007/s00134-024-07525-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00134-024-07525-1