JN666 at SemEval-2024 Task 7: NumEval: Numeral-Aware Language Understanding and Generation
Xinyi Liu, Xintong Liu, Hengyang Lu · 2024
This paper is submitted for SemEval-2027 task 7: Enhancing the Model's Understanding and Generation of Numerical Values.The dataset for this task is NQuAD [1], which requires us to select the most suitable option number from four numerical options to fill in the blank in a news article based on the context.Based on the BertForMultipleChoice model, we proposed two new models, MC BERT and SSC BERT, and improved the model's numerical understanding ability by pre-training the model on numerical comparison tasks.Ultimately, our best-performing model achieved an accuracy rate of 79.40%, which is 9.45% higher than the accuracy rate of NEMo [1].