Automatic Thesaurus Generation from Raw Text using Knowledge-Poor Techniques

Gregory Grefenstette · 1993

In addition to showing how lexical units are related within a field, domain-specific thesauri give an idea of what subjects are important to that field and are thus useful at many points in an information system. The major impediment to creation of thesauri has been the cost of their manual creation. We present here a number of automatic techniques that jointly produce a first draft of a thesaurus from any domain-defining collection of text. The techniques are knowledge-poor in that no domain knowledge is required for their use. We have successfully applied these techniques to over twenty corpora ranging from 1 to 6 megabytes. Results from the thesaurus produced from a collection of medical abstracts will also be presented here.

Read the paper · More papers on PaperTik