UMUTeam at SemEval-2024 Task 8: Combining Transformers and Syntax Features for Machine-Generated Text Detection
Ronghao Pan, José Antonio García-Díaz, Pedro José Vivancos-Vicente, Rafael Valencia‐García · 2024
These working notes describe the UMUTeam's participation in Task 8 of SemEval-2024 entitled "Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection".This shared task aims at identifying machine-generated text in order to mitigate its potential misuse.This shared task is divided into three subtasks: Subtask A, a binary classification task to determine whether a given full-text was written by a human or generated by a machine; Subtask B, a multi-class classification problem to determine, given a full-text, who generated it.It can be written by a human or generated by a specific language model; and Subtask C, mixed human-machine text recognition.We participated in Subtask B, using an approach based on fine-tuning a pre-trained model, such as RoBERTa, combined with syntactic features of the texts.Our system placed 23rd out of a total of 77 participants, with a score of 75.350%, outperforming the baseline.