A Multi-ontology Synthetic Benchmark for the Semantic Web
Yingjie Li, Yang Yu, Jeff Heflin · 2010
Abstract. One important use case for the Semantic Web is the inte-gration of data across many heterogeneous ontologies. However, most Semantic Web Knowledge Bases are evaluated using the single ontology benchmark such as LUBM and UOBM. Therefore, there is a require-ment to develop a benchmark system that is able to evaluate not only single but also federated ontology systems for different uses with differ-ent configurations of ontologies. To support such a need, based on our earlier work, we present a multi-ontology synthetic benchmark system that takes a two-level profile as input to generate user-customized on-tologies together with related mappings and data sources. Meanwhile, a graph-based query generation algorithm and an owl:sameAs generation mechanism are also proposed. By using this benchmark, the Semantic Web systems can be evaluated against complex ontology configurations using the standard metrics of loading time, repository size, query re-sponse time and query completeness and soundness.