Skip to main content

Intelligent Cataloging and Metadata Management

  • Chapter
  • First Online:
Data Fabric and Data Mesh Approaches with AI

Abstract

Suppose you are a business analyst and you need to find the customer purchase records of a certain market in the last quarter from 1.3 million tables and billions of records to make a predictive analysis of the consumption trend in this region for the next quarter. How are you going to do it? This task is like looking for a needle in a haystack. What is even more frustrating is that when you finally find the relevant data after spending weeks on source data exploration, it is out of date, and new essential data is available. This example illustrates that it is not sufficient for companies to make data accessible; they also need to make it discoverable, understandable, and consumable in near real time to gain timely and relevant insights from the data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 16.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Reference [1] for more details on the metadata definition.

  2. 2.

    Please review Chapter 5, where we have introduced metadata in the context of generating active metadata.

  3. 3.

    See Reference [2] for more details on metadata management.

  4. 4.

    See Reference [3] for more information on intelligent data catalog tools.

  5. 5.

    Please, see Chapter 6 for more details on NLP.

  6. 6.

    See Reference [4] for more use cases about semantic search.

  7. 7.

    See Reference [5] for more details on data lineage and provenance.

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hechler, E., Weihrauch, M., Wu, Y.(. (2023). Intelligent Cataloging and Metadata Management. In: Data Fabric and Data Mesh Approaches with AI. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-9253-2_13

Download citation

Publish with us

Policies and ethics