A Toolkit for Text Extraction and Analysis for Natural Language Processing Tasks
Tshephisho Joseph Sefara, Mahlatse S Mbooi, Katlego Mashile, Thompho Rambuda, Mapitsi Roseline Rangata · 2022
Text extraction is an important part of natural language processing (NLP) tasks. Most NLP tasks like text classification, machine translation, text-to-speech, text-based language identification, text summarization, and named-entity recognition involve the use of textual data. Such data is limited for low-resourced languages making it difficult to experiment advanced NLP techniques on these languages. This paper presents a Python-based toolkit for text analysis and text extraction from different types of images, documents, and audio files. The toolkit is built as a library that has functions that can be imported and utilized for text extraction.