On Sentence Segmentation and Punctuation Model for Ancient Books on Agriculture
Hou Han-qing · Zhongwen xinxi xuebao · 2008
The collation of ancient books on agriculture has arouse the attention of the research circle.But the automatic sentence segmentation and punctuation model for these books have been less touched.This article probes into this issue and summarizes certain patterns on sentence splitting and punctuation model for ancient books on agriculture.It is proposed that the sentence is initially segmented by syntax words(like empty word,conjunction and modal words) and synonyms indication words.Then antonyms,cited books indications,time sequence,quantifiers, pleonasms and verb-object structure are employed for further sentence segmentation and punctuation fill-up.Also the comparative sentence supplies an auxiliary means of judgment of complex sentences and punctuation of clauses.Finally the terms in agriculture and the stop punctuation list are applied to improve the readability of these books after marking the punctuations.In experiments,the average precision of the punctuation model reaches 48% and 35% respectively,which shows the feasibility and the potentially of the proposed method.