Intelligent Cataloging and Metadata Management
Eberhard Hechler, Maryela Weihrauch, Yan Yun Wu · Apress eBooks · 2023
Suppose you are a business analyst and you need to find the customer purchase records of a certain market in the last quarter from 1.3 million tables and billions of records to make a predictive analysis of the consumption trend in this region for the next quarter. How are you going to do it? This task is like looking for a needle in a haystack. What is even more frustrating is that when you finally find the relevant data after spending weeks on source data exploration, it is out of date, and new essential data is available. This example illustrates that it is not sufficient for companies to make data accessible; they also need to make it discoverable, understandable, and consumable in near real time to gain timely and relevant insights from the data.