Pre-processing and Exploratory Data Analysis for NLP
Rachel Wagner-Kaiser, Tim Cerino · 2025
This chapter covers common processing techniques for the most common natural language processing (NLP) tasks, including cleaning, pre-processing, transformation, and augmentation. This chapter also covers exploratory data analysis of NLP data, recommending common approaches and techniques for understanding a corpus, including data confirmation, basic metrics, statistical analyses, and in-depth corpus exploration. There is an emphasis on critical thinking and data understanding.