Optimal schemes for robust web extraction
Aditya Parameswaran, Nilesh N. Dalvi, Héctor García-Molina, Rajeev R. Rastogi · Proceedings of the VLDB Endowment · 2011
In this paper, we consider the problem of constructing wrappers for web information extraction that are robust to changes in websites. We consider two models to study robustness formally: theadversarialmodel, where we look at the worst-case robustness of wrappers, andprobabilisticmodel, where we look at the expected robustness of wrappers, as web-pages evolve. Under both models, we present efficient algorithms for constructing the provably most robust wrapper. By evaluating on real websites, we demonstrate that in practice, our algorithms are highly effective in coping up with changes in websites, and reduce the wrapper breakage by up to 500% over existing techniques.