Training Conditional Random Fields for Maximum Labelwise Accuracy
Samuel S. Gross, Olga Russakovsky, Chuong B. Do, Serafim Batzoglou · The MIT Press eBooks · 2007
We consider the problem of training a conditional random field (CRF) to max-imize per-label predictive accuracy on a training set, an approach motivated by the principle of empirical risk minimization. We give a gradient-based procedure for minimizing an arbitrarily accurate approximation of the empirical risk under a Hamming loss function. In experiments with both simulated and real data, our optimization procedure gives significantly better testing performance than several current approaches for CRF training, especially in situations of high label noise. 1