Automatic Segmentation of Texts and Corpora
Cyril Labbé, Dominique Labbé, P. Hubert · Journal of Quantitative Linguistics · 2004
Segmentation of large textual corpora is one of the major questions asked of literary studies. We present a combination of two relevant methods. First, vocabulary growth analysis highlights the main discontinuities in a work. Second, these results are supplemented with the analysis of variations in vocabulary diversity within corpora. A segmentation algorithm, associated with a test of validity, indicates the optimal succession in distinct stages. This method is applied to Racine's works and various other works in French.