Applying the Immunological Network Concept to Clustering Document Collections
Krzysztof Ciesielski, Mieczysław A. Kłopotek, Sławomir T. Wierzchoń · IGI Global eBooks · 2009
In this chapter the authors discuss an application of an immune-based algorithm for extraction and visualization of clusters structure in large collection of documents. Particularly a hierarchical, topic-sensitive approach is proposed; it appears to be a robust solution, both in terms of time and space complexity, to the problem of scalability of document map generation process. The approach relies upon extraction of a hierarchy of concepts, that is almost homogenous groups of documents described by unique sets of terms. To represent the content of each context a modified version the aiNet algorithm is employed; it was chosen because of its flexibility in representing natural clusters existing in a training set. To fasten the learning phase, a smart method of initialization of the immune memory was proposed as well as further modifications of the entire algorithm were introduced. Careful evaluation of the effectiveness of the novel text clustering procedure is presented in section reporting experiments.