Emergence of Linguistic Representations by Independent Component Analysis
Timo Honkela, Aapo Hyvärinen, Jaakko J. Väyrynen · 2003
Our aim is to find syntactic and semantic relationships and ro les of words based on the analysis of corpora. We study three methods for analyzing words in contexts as potential methods for solving this task. The methods are latent semantic analysis, self-organizing map and independent component analysis. Latent semantic analysis is a simple method for automatic generation of concepts that are useful, e.g., in encoding documents for information retrieval purposes. However, these concepts cannot easily be interpreted by humans. Self-organizing maps can be used to generate an explicit diagram which characterizes the relationships between