Focused Crawling Algorithm Based on Multi-agent System
Xianyi Cheng · Jisuanji gongcheng · 2008
Focused crawling research is key to search engine technology.In this paper,a focused crawling algorithm based on multi-Agent system is presented,which presents a core issue of a theme key words filtering method based on ontology to collect the URL related to the themes.Semantic network based on the ontology is to achieve filtering of similar meaning.It also introduces keyword identification of different weights by HTML page tags and anchor text,which are important for the website forecast use.And system model based on the blackboard communication mechanism is explained.The experimental results show that the system has an increasing promotion in both precision and extension for crawling website.