Improved Text Classification using Long Short-Term Memory and Word Embedding Technique
Amol C. Adamuthe · International Journal of Hybrid Information Technology · 2020
Text classification is an important problem for spam filtering, sentiment analysis, news filtering, document organizations, document retrieval and many more.The complexity of text classification increases with some classes and training samples.The main objective of this paper is to improve the accuracy of text classification with long short-term memory with word embedding.Experiments were conducted on seven benchmark datasets namely IMDB, Amazon review full score, Amazon review polarity, Yelp review polarity, AG news topic classification, Yahoo!Answers topic classification, DBpedia ontology classification with the different number of classes and training samples.Different experiments are conducted to evaluate the effect of each parameter on LSTM.Results show that 100 batch size, 50 epochs, Adagrad optimizer, 5 hidden nodes, 100-word vector length, 2 LSTM layers, 0.001 L2 regularizations, 0.001 learning rate give the higher accuracy.The results of LSTM are compared with the literature.For IMDB, Amazon review full score, Yahoo!Answers topic classification dataset the results obtained are better than literature.Results of LSTM for Amazon review polarity, Yelp review polarity, AG news topic classification are close to bestknown results.For the DBpedia ontology classification dataset the accuracy is more than 91% but less than best known.