Classification using localized mixtures of experts
Perry D. Moerland · 1999
. A mixture of experts consists of a gating network that learns to partition the input space and of experts networks attributed to these dierent regions. This paper focuses on the choice of the gating network. First, a localized gating network based on a mixture of linear latent variable models is proposed that extends a gating network introduced by Xu et al. [9], based on Gaussian mixture models. It is shown that this localized mixture of experts model, can be trained with the Expectation Maximization algorithm. The localized model is compared on a set of classication problems, with mixtures of experts having single or multilayer perceptrons as gating network. It is found that the standard mixture of experts with feedforward networks as gate often outperforms the other models. 1 Introduction A mixture of experts [5] is a probabilistic model that can be interpreted as a mixture model for estimating conditional probability distributions. The model consists of a gating network that ...