A hybrid approach to Urdu verb phrase chunking
Wajid Ali, Sarmad Hussain · 2010
A variety of verb phrases exist in Urdu includ-ing simple verb phrases, conjunct verb phrases and compound verb phrases. This paper ex-plains the structure of Urdu verb phrases, and details a series of experiment to automatically tag them. Initially, a rule based model is de-veloped using 21 linguistic rules for automatic VP chunking. A 100,000 word Urdu corpus is manually tagged with VP chunk tags. The corpus is then used to develop a hybrid ap-proach using HMM based statistical chunking and correction rules. The technique is en-hanced by changing chunking direction and merging chunk and POS tags. The automati-cally chunked data is compared with manually tagged held-out data to identify and analyze the errors. Based on the analysis, correction rules are extracted to address the errors. By applying these rules after statistical tagging, further improvement is achieved in chunking accuracy. The results of all experiments are reported with maximum overall accuracy of 98.44 % achieved using hybrid approach with extended tagset. 1