Mass Log Analysis Method Based on File Strategy and SMCS
Xiaoli Zhang · Jisuanji gongcheng · 2012
Now the statistical analysis for the massive logs not only is time-consuming,but also requires higher hard configuration.For these questions,a method based on the file software strategy and SMCS algorithm is proposed in this paper.By the software strategy,the log file indexing and the association between the log file and log time are adopted in this method,so as to quicken the log extraction.In order to analyze the massive logs statistically and control the memory loss,hash tables,file merging and heap operation are used in the SMCS algorithm.By experiment of the real software,results indicate that the proposed method is faster than that of traditional statistical analysis by four times.