Tibetan Web Information Collection System
Guixian Xu, Dunhao Zhong, Xu Liang Gao, Yuan Chang Lin, Xiaobing Zhao, Guosheng Yang · 2012
Nutch is an open source web-search software project. This paper introduces a system called Tibetan web information collection system, which bases on Apache Nutch. It points out original program's shortcomings and proposes an improved method, which can utilize the Nutch to deal with Tibetan web pages and generate the files that we need. Besides, this paper shows how to update the data regularly and delete the duplicate data. It is useful and helpful for the study of Tibetan information processing.