Building a Rule-Based Malay Text Segmentation Tool

Bali Ranaivo-Malançon · 2011

This paper presents the different problems that need to be taken into account in building a rule-based Malay text segmentation tool that can split a text into sentences and tokens. The tool was compared to English and Malay tokenisers to highlight the characteristics of Malay texts.

Read the paper · More papers on PaperTik