Uncertainty in Data Integration Systems: Automatic Generation of Probabilistic Relationships
Sonia Bergamaschi, Laura Po, Serena Sorrentino, Alberto Corni · 2010
This paper proposes a method for the automatic discovery of probabilistic relationships in the environment of data integration systems. Dynamic data integration systems extend the architecture of current data integration systems by modeling uncertainty at their core. Our method is based on probabilistic word sense disambiguation (PWSD), which allows to automatically lexically annotate (i.e. to perform annotation w.r.t. a thesaurus/lexical resource) the schemata of a given set of data sources to be integrated. From the annotated schemata and the relathionships defined in the thesaurus, we derived the probabilistic lexical relationships among schema elements. Lexical relationships are collected in the Probabilistic Common Thesaurus (PCT), as well as structural relationships. These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.