Sentence simplification with ruGPT3
RANEPA Moscow, Russia, A. A. Shatilov, A. I. Rey, RANEPA Moscow, Russia · Computational Linguistics and Intellectual Technologies · 2021
This paper describes our solution for the RuSimpleSentEval shared task on sentence simplification held together with Dialogue 2021 сonference.Our approach was to filter the provided dataset, finetune the pretrained ruGPT3 model on it and select generated simple candidates based on cosine similarity and ROUGEL with a complex sentence as an input.The system achieved SARI 38.49 and took third place in the competition.We have reviewed and analyzed examples of simplified sentences produced by the model.The analysis showed that the sentences produced by the system lose the original meaning of the input sentence in about half of the cases.