The Role of the HDDI Collection Builder in Hierarchical Distributed Dynamic Indexing
Russell H. Bader, Miranda R. Callahan, Douglas A. Grim, J. T. Krause, William M. Pottenger · 2004
The global growth in popularity of the World Wide Web has been enabled in part by the availability of browserbased search tools which in turn have led to increased demand for advances in the field of textual data mining. Simultaneously, fully automatic content-based techniques of textual data management have been under development at a number of institutions. The time is thus ripe for the development of scalable knowledge management systems capable of handling extremely large and diverse textual collections distributed across multiple repositories. This paper introduces the HDDI Collection Builder, our custom developed solution for automatic feature extraction from such collections. The HDDI Collection Builder provides input features for several algorithms in distributed textual data mining.