Crawler with Search Engine based Simple Web Application System for Forum Mining
M. Maheswari, N. Tharminie · IOSR Journal of Computer Engineering · 2014
Now-a-days the growth of online users increased infinitely depending upon the information in web sources.Web mining is an important term to manage the data from web which has different categorization as structure, content, usage.In this paper web site fetcher that is the crawler and search engine design are developed using .NET based application.The URL, content those type of crawling approches clearly explained by that system in a varient way.The designed crawler performs two functions, URL Crawling (structure mining) by page classification and Content Crawling (content mining) by Pattern clustering.This type of Crawler design is supported for providing efficient way to retrieve the forum data to small scale search engine as possible.