Artificial text detection in Russian language: a BERT-based Approach
P. A. Posokhov, S. S. Skrylnikov, O. V Makhnytkina · Computational Linguistics and Intellectual Technologies · 2022
This paper describes our solution for the RuATD (Russian Artificial Text Detection) competition held within the Dialog 2022 conference. Our approach is based on the idea of transfer learning, using pre-trained RuRoBERTa, RuBERT, RuGPT3, RuGPT2 models. The final solution included Byte-level Byte-Pair Encoding tokenization, and a fine-tuned model RuRoBERTa model. The system got Accuracy metric value of 0.65 and took first place in the multiclass classification task.