System Description of BJTU-NLP SMT for NTCIR-9 PatentMT
Junjie Jiang, Jinan Xu, Youfang Lin, Yujie Zhang · NTCIR · 2011
例如|v ,|wd 用|p 具有|v 广谱抗|n 微生物|n 活性|b 的|ude1 聚腈基丙烯酸酯|n 膜覆盖 |n 皮肤|n 表面|n 的|ude1 不可|v 缝合|v 性|ng小|a 伤口|n 将|d 会|v 减弱|v 伤口|n 感染|v 的|ude1 可能|n 。|wj on|IN the|DT other|JJ hand|NN ,|, a|DT cable|NN 324|CD is|VBZ connected|VBN to|TO the|DT movable|JJ plate|NN 321|CD .|. 一方|接続詞、|特殊可動|名詞プレート|名詞 321|名詞に|助詞は|助詞ケーブル|名 詞 324|名詞が|助詞接続|名詞さ|動詞れて|接尾辞いる|接尾辞。|特殊 Preprocessing: • English sentence: tokenizer.perl, lowercase.perl, Stanford POS Tagger. • Chinese Sentence: ICTCLAS2011. • Japanese sentence: Mecab. • Before building the translation model, long sentences with more than 90 words are removed. Training: • The GIZA++ is applied to align words. • Parameter of phrase alignment heuristic is “grow-diag-final”. • Parameter of reordering model is “msd-bidirectional-fe”. • The SRILM toolkit is used to build trigram models with Kneser-Ney smoothing. Tuning: • MERT Decode: • Moses Post-Processing: • Japanese output: Remove the spaces. • English outputs: detokenizer.perl, recaser in Moses toolkit. Chinese Unknown Word Prediction Using SVM According to the characteristics of the patent documents, we used a SVM based method that predicted the unknown words for the result of word segmentation and tagging by ICTCLAS2011. First of all, we manually marked unknown words boundary to construct training corpus. Then, we used SVM tool to train the model. And finally, we predicted the unknown words of input sentence. Example Training Data: +1 优选/v/O 的/ude1/O 亚/b/B-S 乙烯/n/B-I 基芳/n/B-I 族/ng/B-E 单体/n/O 包括/v/O -1 优选/v/O 的/ude1/B-S 亚/b/B-I 乙烯/n/B-I 基芳/n/B-I 族/ng/B-E 单体/n/O 包括/v/O -1 优选/v/O 的/ude1/O 亚/b/B-S 乙烯/n/B-I 基芳/n/B-I 族/ng/B-I 单体/n/B-E 包括/v/O Test Data: 0 自/p/O C1-C10/x/O 亚/b/B-S 烷基/n/B-E ,/wd/O C6-C12/x/O 0 自/p/O C1-C10/x/B-S 亚/b/B-I 烷基/n/B-E ,/wd/O C6-C12/x/O 0 自/p/O C1-C10/x/O 亚/b/B-S 烷基/n/B-I ,/wd/B-E C6-C12/x/O Results: 0.86 自/p/O C1-C10/x/O 亚/b/B-S 烷基/n/B-E ,/wd/O C6-C12/x/O -0.75 自/p/O C1-C10/x/B-S 亚/b/B-I 烷基/n/B-E ,/wd/O C6-C12/x/O -0.59 自/p/O C1-C10/x/O 亚/b/B-S 烷基/n/B-I ,/wd/B-E C6-C12/x/O