A new fuzzy-based method to weigh the related concepts in semantic focused web crawlers
Omid Jalilian, Hassan Khotanlou · 2011
Semantic focused crawler computes the priority of pages crawling by web page semantic similarity with topic which is defined by ontology. Ontology is a new approach referred to as the main pivot of change from the present web to a new web called semantic web. The main problem about focused crawlers is to find a computation function of appropriate relevance based on which the crawler can estimate the similarity between topic and web document appropriately. In this paper a new method to weigh the concepts related to topic is suggested to be used as a main component in the architecture of semantic crawler to compute relevance of web page with the topic. The concepts related to the topic are retrieved by ontology graph and their weights are computed by a proposed fuzzy inference system. The results show that the proposed approach presents better precision rate compared with breadth-first and best-first search.