MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration
David Anugraha, Garry Kuwanto, Lucky Susanto, Derry Tanti Wijaya, Genta Indra Winata · 2024
We present METAMETRICS-MT, an innovative metric designed to evaluate machine translation (MT) tasks by aligning closely with human preferences through Bayesian optimization with Gaussian Processes.METAMETRICS-MT enhances existing MT metrics by optimizing their correlation with human judgments.Our experiments on the WMT24 metric shared task dataset demonstrate that METAMETRICS-MT outperforms all existing baselines, setting a new benchmark for state-of-the-art performance in the referencebased setting.Furthermore, it achieves comparable results to leading metrics in the referencefree setting, offering greater efficiency.