Skip to main content

Key Data Fabric and Data Mesh Capabilities

  • Chapter
  • First Online:
Data Fabric and Data Mesh Approaches with AI

Abstract

A state-of-the-art Data Fabric architecture and Data Mesh solution is unquestionably linked to the knowledge catalog as one of its prime components. What differentiates a modern knowledge catalog from traditional ones are AI-infused capabilities to automate tasks and to provide self-service capabilities. AI is without dispute an inevitable domain that characterizes a modern Data Fabric and Data Mesh. Infusing AI generates additional added value specifically for business users, such as delivering trustworthy AI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See References [1] and [2] for more information on knowledge catalogs and metadata management solutions available by different vendors.

  2. 2.

    See Reference [3] for Gartner’s market guide for active metadata management.

  3. 3.

    See Reference [4] for more information on data curation.

  4. 4.

    See Reference [5] for more information on semantic knowledge graphs in the context of a Data Fabric.

  5. 5.

    See Reference [6] for more information on Amazon Neptune.

  6. 6.

    See Reference [7] for more information on Neo4j.

  7. 7.

    See Reference [8] for more information on IBM Graph.

  8. 8.

    We further examine these and other quality metrics, for example, the F1 measure, in the section on trustworthy AI later in this chapter.

  9. 9.

    See References [9] and [10] for details on guidelines of the European Commission and the US Department of State regarding trustworthy AI.

  10. 10.

    See Reference [11] for more information on trustworthy AI, including social aspects.

  11. 11.

    We are using the terms fairness and bias interchangeably. However, fairness has a more social connotation, whereas bias is used more in a mathematical context.

  12. 12.

    See References [12] for more details on IBM Watson OpenScale, which this example is based on.

  13. 13.

    We elaborate on additional AI model quality metrics further in this chapter in the following.

  14. 14.

    Refer to Reference [13] for a comparison of the LIME and SHAP methods.

  15. 15.

    See References [14] and [15] for good introductions of ML, where the concepts of the confusion matrix, areas under the ROC and PR curves, etc. are explained.

  16. 16.

    See Chapter 7 for more information on activating the digital exhaust.

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hechler, E., Weihrauch, M., Wu, Y.(. (2023). Key Data Fabric and Data Mesh Capabilities. In: Data Fabric and Data Mesh Approaches with AI. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-9253-2_5

Download citation

Publish with us

Policies and ethics