Compositional-structural, semantic and presuppositional-pragmatic parameters and defects of generated short texts in the GigaChat language neural network

Sergey V. Gusarenko, M. K. Gusarenko · Гуманитарные и юридические исследования · 2024

Introduction. The relevance of the study lies primarily in the fact that the increasingly active appeal of the widest circles of users to the generation of texts of different genres, properties and volumes using the so-called LLM (Large Language Model) creates the need to study the actual linguistic capabilities of these generative models, including the need for linguistic research of the texts they generate. It is also important that a large number of specialists from different fields actively use the generative capabilities of linguistic neural networks for purely professional purposes, which means that the quality of generated texts has acquired the status of a production factor and directly affects success in professional activities, which also indicates the relevance of our research. Materials and Methods. The texts of short stories were chosen as the object of study, since in a certain respect, such texts can be considered as archetypal structures that underlie texts of certain functional types (scripts, advertising texts and stories). Analysis. This state of affairs requires studying the generated stories, including in the aspect of the representation of frame structures in it, since this will allow us to get an idea of how texts of this type are structured from the point of view of standard linguistic semantics, including syntactic semantics. Results. It has been established that, despite all grammatical, structural-semantic and compositional adequacy, the texts of short stories generated in GigaChatPro, created by the network on a certain topic or according to a certain frame, may contain violations in global semantic organization, generated by both presuppositional-pragmatic violations and violations in text reference. Violations in the general functional pragmatics of the generated stories were also noted: pronounced edification and the length of sentences up to 5-7 words are characteristic of stories for children of primary school age, despite the fact that the themes of these stories initially do not correspond to their age interests.

Read the paper · More papers on PaperTik