Study of the platform of the discount merchandise based on the web crawler
Zhu Xiangca · Journal of Zhoukou Normal University · 2014
This paper goods data for mainstream e-commerce web site inquiries,in C++search engine Xapian technology designed for web crawler architecture commodity information based on the query,and download the mainstream commodity business webpage data by the improved SLASA algorithm and DNS Cache technology grasping,will get data through the baidu,google and other search engines and the pageRank algorithm for the two time after filtering is stored in the database,and then the data required by user by judging whether the right algorithm screening,screening out of the commodity will feedback information to the user,to facilitate the user to select the inexpensive goods.