Multilingual Molecular Representation Learning via Contrastive Pre-training
Zhihui Guo, Pramod Sharma, Andy Martinez, Liang Du, Robin Abraham · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · 2022
Molecular representation learning plays an essential role in cheminformatics.Recently, language model-based approaches have gained popularity as an alternative to traditional expertdesigned features to encode molecules.However, these approaches only utilize a single molecular language for representation learning.Motivated by the fact that a given molecule can be described using different languages such as Simplified Molecular Line Entry System (SMILES), the International Union of Pure and Applied Chemistry (IUPAC), and the IU-PAC International Chemical Identifier (InChI), we propose a multilingual molecular embedding generation approach called MM-Deacon (multilingual molecular domain embedding analysis via contrastive learning).MM-Deacon is pre-trained using SMILES and IUPAC as two different languages on large-scale molecules.We evaluated the robustness of our method on seven molecular property prediction tasks from MoleculeNet benchmark, zero-shot crosslingual retrieval, and a drug-drug interaction prediction task.