SNS crawler engine for topic expansion
Sang‐Yun Lee, Jeong-Woo Son, Won-Ju Park, Sun-Joong Kim · 2016
In this paper, we will propose SNS crawler engine for topic expansion. The Smart Broadcasting Platform uses only subtitle, and scripts in extracting topic. But, there are not sufficient words in them in order for adopting it to various domains. Therefore, it needs to include more data sources for extracting richer topics. We will also introduce the system architecture of SNS crawler engine, describe the functional blocks, and show the implementation results. The proposed SNS crawler engine can collect text data from blog, Twitter, and web sites according to the keyword, period, term, and etc. registered in advance.