Skip to main content

Automated Data Fabric and Data Mesh Aspects

  • Chapter
  • First Online:
Data Fabric and Data Mesh Approaches with AI

Abstract

The vigilant reader of this book has certainly noticed the distinguished focus that we have put on applying AI with automation and intelligent augmentation and optimization to nearly all aspects of a Data Fabric architecture and Data Mesh solution. There are indeed numerous areas of both concepts, which are increasingly optimized with AI-infused automation, such as automated workload performance prediction and runtime adjustment, automated capacity planning and resource demand estimation (e.g., CPU capacity, network bandwidth, memory sizes, etc.), automated query generation, intelligent information integration, automated data curation, and automated creation of data products.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Reference [1] for an example from IBM about performance and capacity planning.

  2. 2.

    See Reference [2] for more information on capacity planning for enterprise Data Fabrics.

  3. 3.

    All samples in this chapter are derived from the IBM Watson Knowledge Catalog.

  4. 4.

    See Reference [3] for a comprehensive list of metadata standards and Reference [4] for Egeria, an open metadata standard from the Linux Foundation.

  5. 5.

    See Reference [5] for mor information on automated metadata management.

  6. 6.

    See Reference [6] for more information on profiling data assets.

  7. 7.

    See Reference [7] for more information on applying ML to profiling.

  8. 8.

    See Reference [8] for a comparison of data profiling and data mining.

  9. 9.

    Please, refer to the example in Chapter 13, depicted in Figure 13-3.

  10. 10.

    See Reference [9] for more information on labeling and Reference [10] for more information on tagging for autonomous driving.

  11. 11.

    See Reference [11] for more information on data quality assessments and data quality dimensions.

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hechler, E., Weihrauch, M., Wu, Y.(. (2023). Automated Data Fabric and Data Mesh Aspects. In: Data Fabric and Data Mesh Approaches with AI. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-9253-2_14

Download citation

Publish with us

Policies and ethics