Research of Personalization Theme Crawler Based on Rule Engine
Yin Ting · Computer Technology and Development · 2011
Information on the internet is now rapid growth,people mainly rely on search engines to find information,continue to strengthen as the specialized,vertical search engines become the new tool,but the process of building specialized search engines is more complex.In order to solve focused crawler is not configured flexible on vertical search engines,adopt an integrated rules engine in the reptile on the way to control the reptiles through the rule base running,and use a higher degree of open source scalable Heritrix crawler project and open source rules engine project Drools,easy to build configuration,and high flexibility of individual reptiles,which will set the original theme from the tight coupling reptiles turned into loosely coupled,reducing the user configuration difficult.