Incorporating completeness quality support in internet query systems
Sandra de F. Mendes Sampaio, Pedro Eduardo Fonseca Sampaio · Conference on Advanced Information Systems Engineering · 2007
There has been an exponential growth in the availability of data on the web and in the usage of systems and tools for querying and retrieving web data. Despite the considerable advances in search engines and other internet technologies for dynamically combining, integrating and collating web data, supporting a DBMS-like data management approach across multiple web data sources is still an elusive goal. To buck this trend, internet query systems − IQS [1] are being developed to enable DBMS-like query processing and data management over multiple web data sources, shielding the user from complexities such as information heterogeneity, unpredictability of data source response rates, and distributed query execution. The comprehensive query processing approach supported by IQS allows users to query a global information system without being aware of the sites structure, query languages, and semantics of the data repositories that store the relevant data for a given query [1]. Despite the significant amount of work in the development of the data integration and distributed query processing capabilities, internet query systems still suffer from inadequate data quality control mechanisms to address the management of quality of the data retrieved and processed by the IQS. Typical examples of data quality issues [2] that need to be addressed when supporting quality aware query processing over multiple web data sources are: Accuracy, Completeness and Timeliness. We are currently investigating how an internet query system can be extended to support a dynamic data quality aware query processing framework. In particular, we are developing Completeness extensions for the Niagara Internet Query System.