The research and implementation of keyword extraction algorithm based on LDA
Chengxia Liu · Third International Conference on Electronics and Communication; Network and Computer Technology (ECNCT 2021) · 2022
In this paper, the basic principle of LDA （Latent Dirichlet Allocation）Algorithm is studied and the posterior probability distribution of topics in the document θm and the posterior probability distribution of words in the topic φzm,n is deduced from the Dirichlet distribution with parameter alpha and beta. And the parameters of LDA model are generated by Gibbs sampling results θ and φ。 Then, the accuracy of the final subject words under different iteration times is compared, and the whole keyword extraction algorithm process based on LDA is realized in Python. Finally, the results are visually displayed with keyword cloud.