Hierarchical Multiple Granularity Attention Network for Long Document Classification
Yongli Hu, Wen Xiang Ding, Tengfei Liu, Junbin Gao, Yanfeng Sun, Baocai Yin · 2022 International Joint Conference on Neural Networks (IJCNN) · 2022
Long document classification has aroused tremendous attention in the field of Nature Language Processing, due to the exponential increasing of publications. Although the common text classification methods can be extended for long document classification, they are confined to the length of text and do not have enough expressiveness to model the structure of the long document. To solve these problems, we proposed a hierarchical multiple granularity attention network for long document classification, in which the word and section level features are extracted and fused to represent the complex structure of the long document. Furthermore, a feature-based section pooling module is adopted to eliminate redundant text information and accelerate the computing. A series of experiments are conducted to evaluate the proposed method. The experimental results verify that our method is effective, efficient and competitive compared with the related state-of-the-art methods.