Abstractive Text Summarization Using Bert and Adversarial Learning
Abhijith Prakash, Gannamaneni Rohith, J Umamageswaran · 2024
In recent years, the rise in textual data has necessitated the demand and development of efficient text summarization techniques. In order to provide text summaries that are accurate, useful, coherent, informative, and factually accurate, this work introduces a novel framework that combines adversarial learning with BERT's (Bidirectional Encoder Repre-sentations from Transformers) advanced language understanding capabilities. Our methodology is based on the application of a discriminator designed to differentiate between summaries generated by humans and machines. This discriminator directs the generator to produce summaries that mimic the writing styles of humans, improving the summaries' quality and naturalness. We propose a new hybrid loss function that combines adversarial loss with conventional evaluation measures, including ROUGE (Recall-Oriented Understudy for Gisting Evaluation), in addition to the adversarial framework. This dual approach ensures that the model maintains high grammatical accuracy and coherence while simultaneously producing semantically rich summaries. This research has important implications for many applications in Natural Language Processing, especially those that need to extract information from large text data efficiently.