A Markovian approach to distributional semantics with application to semantic compositionality
Édouard Grave, Guillaume Obozinski, Francis Bach · HAL (Le Centre pour la Communication Scientifique Directe) · 2014
In this article, we describe a new approach to distributional semantics. This approach relies on a generative model of sentences with latent variables, which takes the syntax into account by using syntactic dependency trees. Words are then represented as posterior distributions over those latent classes, and the model allows to naturally obtain in-context and out-of-context word representations, which are comparable. We train our model on a large corpus and demonstrate the compositionality capabilities of our approach on different datasets.