Data quality-based view selection in big data integration system
Samir Anter · International Journal of Business Intelligence and Data Mining · 2023
An integration system is an intermediate tool between a user and a set of distributed sources. It provides transparent access to information through an interface using a unique query language. This provides an illusion to the end user as if it is accessing a homogeneous central repository. In a hybrid system, one part of the data is queried on demand whereas another part is extracted, filtered and stored in a local database. This approach is very much promising for data access in the big data context. However, obtaining satisfactory results depends on the correct choice of data to materialise. Further this task is even more difficult in the big data context. In this article, a novel approach has been proposed to overcome the above problem which uses data quality to select views that will be materialised.