Social Media Medical Concept Normalization using RoBERTa in Ontology Enriched Text Similarity Framework
Katikapalli Subramanyam Kalyan, S. Sangeetha · 2020
Pattisapu et al. (2020) formulate medical concept normalization (MCN) as text similarity problem and propose a model based on RoBERTa and graph embedding based target concept vectors.However, graph embedding techniques ignore valuable information available in the ontology like concept description and synonyms.In this work, we enhance the model of Pattisapu et al. ( 2020) with two novel changes.First, we use retrofitted target concept vectors instead of graph embedding based vectors.It is the first work to leverage both concept description and synonyms to represent concepts in the form of retrofitted target concept vectors in text similarity framework based social media MCN.Second, we generate both concept and concept mention vectors with same size which eliminates the need of dense layers to project concept mention vectors into the target concept embedding space.Our model outperforms existing methods with improvements up to 3.75% on two standard datasets.Further when trained only on ontology synonyms, our model outperforms existing methods with improvements up to 14.61%.We attribute these improvements to the two novel changes introduced.