Text classification of COVID-19 reviews based on pre-training language model
Juxing Di, Zixu Liu, Yang Yang · 2022 IEEE 2nd International Conference on Power, Electronics and Computer Applications (ICPECA) · 2022
This experiment analyzed 100,000 epidemic-related microblogs officially provided by the CCF. Using Enhanced Representation through Knowledge Integration (ERNIE), the effect of pre-training model on extracting Chinese semantic information was improved. After that, the deep pyramid network (DPCNN) was merged with ERNIE to save computing costs. Enhanced feature extraction performance for long-distance text. This model was the most effective in the comparison test of six emotional three-category tasks, which improved the accuracy of BERT pre-training model by 7%.