Evaluation of webscraping tools for creating an embedded webwrapper
Joacim Olofsson · KTH Publication Database DiVA (KTH Royal Institute of Technology) · 2016
This report aims to evaluate three different tools for web data extraction in Java for the company Top of Europe. The tools used in the evaluation was jArvest, Jaunt and Selenium WebDriver. Through a case implementation which wrapped parts of a specific web application, web document data was to be automatically identified, extracted and structured. By using the results of the case implementation, the tools was contrasted and evaluated. The results discovered jArvest as non-functioning while the other alternatives provided similar performance but also offering somewhat different strengths. Jaunt provides a good interface to the HTTP protocol and has bigger possibilities for wrapping DOM elements while Selenium Web-Driver supports JavaScript, AJAX and some graphical interface aspects.