An Algorithm of Fast Frequent String Extracting Based on Level-wise Scan
Yumeng Zhang, Liu Chuan-han · 2008
String frequency statistics is a simple and effective method of extraction unlisted word.This paper presents an effective algorithm of extracting frequent strings.It uses a level-wise scan for finding rapidly frequent strings and modifies the valid frequency that string appears in text.Finally,those high-frequent strings that reach the threshold of average mutual information are extracted.Experimental results show that the method is effective and feasible.