Performance improvement of web server through log files cleaning
International Journal of Latest Trends in Engineering and Technology · 2016
Mining the web data is one of the most challenging tasks in the area of data mining and management for research scholars because there is huge heterogeneous, less structured data available on the web.Web server's logs represent actual usage.Such data have been used for usage-based testing and quality assurance and also for understanding user behavior and guiding user interface design.By analyzing these logs, Web workload was characterized and used to suggest performance enhancements for Web servers.Data preparation techniques and algorithms can be used to process the raw Web server logs, and then mining can be performed to discover users' visitation patterns for further usability analysis.In this research proposal it is proposed to extract actual user behavior from Web server logs, capture user behavior and also proposed a method which can filter out plenty of irrelevant log values based on the complex prefix of their uniform resource locator.This work will improve data quality of web logs by further filtering out more URL requests comparing with traditional data cleaning methods and analyze the results.