Improving Automatic Categorization of Technical vs. Laymen Medical Words using FastText Word Embeddings
Hanna Pylieva, Artem Chernodub, Natalia Grabar, Thierry Hamon · HAL (Le Centre pour la Communication Scientifique Directe) · 2018
Detection of difficult for understanding words is a crucial task for ensuring the proper understanding of medical texts such as diagnoses and drug instructions. In this paper, we study usage of recently developed word embeddings, which contain context information for words together with other linguistic and non-linguistic features, for improving the detection of difficult medical words. We propose new cross-validation scenarios in order to test the generalization ability of the medical words difficulty detection from different perspectives and provide the experimental study of previously used methods for feature extraction together with recently proposed FastText embeddings. We found that for known words and unknown users FastText embeddings surely improves the detection of word understandability reaching 85.9 F-score (up to 2.9 F-score improvement).