Automatically Discovering Search Engines Based on a Spider
Peng Jin · Modern Electronics Technique · 2007
Automatically discovering search engines on the web is useful to build a large-scale meta search engines.Presents a method to discover Search Engines(SEs) automatically based on a spider,and extract meta information from them: use a spider whose crawling rules has been optimized to fetch pages,and identify search face by special rules from fetched pages,finally extract meta information.An experimental study shows this automatic discovering method is simple and effective with the precision of 97% and the recall 91%.