Research on Focused Crawler Based on Naive Bayes Algorithm
Yafu Xiao · Computer and Digital Engineering · 2012
Focused crawler is a key part of the focused search engine.This paper proposed a method of using Naive Bayes algorithm to identify topics,introduced the core part of the focused crawler,including the generation of seed URL collection,the page analysis and feature extraction and the topic identify.Compared the focused crawler based on Naive Bayes algorithm with the focused crawler base on links analysis and thesaurus,the experiment result proved that the focused crawler based on Naive Bayes algorithm has better accuracy and the method is feasible.It laid good foundation for the topic information collection.