Regular Collocation Features Extraction Method in Online Reviews Sentiment Analysis
Wang Zu-hu · Industrial Engineering and Engineering Management · 2014
Precise sentiment orientation classification models and the extraction of effective and stable features from the review context are two essential factors which can affect the performance of online review sentiment analysis. Among various complicated features due to language complexity,regular collocation features are found to play important roles in that their structured expressions and show great impact on the sentiment orientation aside from conventional word bag and trigger pair features.In order to extract the complicated features for online reviews sentiment analysis,two novel approaches are presented in this paper to capture effectively the regular collocation features from the review of corpora—mutual information and average mutual information combined. Regular collocation features extracted are incorporated into sentiment analysis models as inputs to implementing the review sentiment analysis. The experiment on real hotel online reviews achieve generally higher precision,improves the performance of SVM models by 0. 34% and that of the Nave Bayes models by 1. 27%,respectively.As for the extraction of regular collocation features,two aspects were considered as essential to expressing effectively the complicated constraint of the review sentiment orientation from(1) internal stability of the regular collocation structure,which accounts for the substantial existence of the regular collocation aside from traditional word bags or trigger pairs,and(2) external effectiveness of the regular collocations which accounts for the contribution to the sentiment orientation classification. The mutual information method used in this paper measures external effectiveness while the average mutual information computation and its filtering performs the measurement of internal stability of regular collocations. The rough set based method ensures the internal stability and external effectiveness by α approximation rough rule extraction strategy and a maximum likelihood estimate of the regular collocations distribution.On the implementation,the approach presented has the non-uniform distribution occurrence of the sentiment features within the review. Variable precision strategies on the rough sets approach was introduced instead of the original rough rule strategy. It was found in the experiments that variable precision strategies on the rough sets approach did achieve the best sentiment analysis performance88. 38% via SVM models by the threshold value 0. 85. Those results show that in dealing with the online review with non-uniform distribution occurrence of sentiment features. The variable precision strategy avoids the true voice of the minority and helps discriminate the whole sentiment orientation of the review. When dealing with the online review with uniform distribution occurrence of the sentiment features,α approximation would be a better choice to replace the original maximum likelihood estimate in the pursuit of a better sentiment analysis. A combination of mutual information and average mutual information approach would also be an optional strategy in the pursuit of comparative performance but with less computation under the same condition.