Traitor: associating concepts using the world wide web
Wanno Drijfhout, Oliver Jundt, Lesley Wevers, Djoerd Hiemstra · University of Twente Research Information · 2013
We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.