Crawler and product discovery
Wei Jian. Peh · DR-NTU (Nanyang Technological University) · 2010
The Review and Opinion Search Engine, in short ROSE, aims to provide a centralized place to find all relevant reviews and opinions written by consumers from all over the world at different reviews websites. If consumers are looking for reviews for a specific product, they could just access the ROSE Web Portal either through a standard web browser or through their mobile web browsers to search for products along with all relevant reviews. Consumers will no longer need to search each review website individually and maintain bookmarks from various sites just to access a diverse collection of reviews. The ROSE Control Panel, in short ROSE CP, is the back-end system that is used to validate and verify the correctness of all the automated process in place to retrieve and process reviews and opinions from different websites. Additional processing are done in ROSE CP to determine the relevance of the reviews and correctness of product information downloaded by the ROSE Web Crawler. Ultimately, the main objective of ROSE is to provide end-users with the latest and most relevant and high-quality reviews and opinions written by consumers from a variety of review websites.