P2P Web Search: Make It Light, Make It Fly (Demo)
Matthias Bender, Tom Crecelius, Sebastian Michel, Josiane Xavier Parreira · Max Planck Institute for Plasma Physics · 2007
We propose a live demonstration of MinervaLight, a {P2P} Web search engine. MinervaLight combines the (previously separate) focused crawler {BINGO!} (to harvest Web data), the local search engine Top{X}, and our {P2P} Web search system {MINERVA} under one common user interface. The crawler unattendedly downloads and indexesWeb data, where the scope of the focused crawl can be tailored to the thematic interest profile of the user. The result of this process is a local search index, which is used by Top{X} to evaluate keyword queries. In the background, MinervaLight continuously computes compact statistical synopses that describe a user's local search index and publishes that information to a conceptually global, but physically fully decentralized directory. MinervaLight offers a search interface where users can submit queries to {MINERVA}. Sophisticated query routing strategies are used to identify the most promising peers for each query based on the statistical synopses in the directory. The query is forwarded to those judiciously chosen peers and evaluated based on their local indexes. These results are sent back to the query initiator and merged into a single result list. We give a live demonstration of the fully functional system and invite all visitors to join the demo with their personal notebook PCs.