Gibbsboost: a Boosting Algorithm using a Sequential Monte Carlo Approach
Yohei Nakada, Yusuke Mouri, Yasunori Hongo, Takashi Matsumoto · Machine learning for signal processing ... · 2006
This study proposes a novel boosting algorithm, GibbsBoost. A Gibbs distribution of a weaklearner sequence with a specific loss (energy) function is used in this algorithm as the posterior distribution in Bayesian learning. Weaklearner sequence samples are recursively drawn from the distribution via sequential Monte Carlo. The predictions are derived from a combination of the weaklearner sequence samples. The proposed algorithm is demonstrated by using a numerical example.