STMAD:A Simple Multimodal Anomaly Detection for Thyroid Medical Information
Wentong Xu, Chao Fu, Jing Yu, Caifeng Si, Zuoyong Li, Chaochao Li, Haoyi Fan · 2024
Anomaly detection has been widely explored by training an out-of-distribution detector with only normal data. Medical image analysis, as a common tool, faces the challenge of how to further enhance the detection performance for thyroid cancer, especially with the application of various deep learning methods in the thyroid-related field. In this paper, we validate the effectiveness of sonographic feature descriptions (textual information) for thyroid cancer diagnosis. Building on this, we propose a simple multimodal self-supervised framework that leverages both textual and image modalities for thyroid cancer anomaly detection. Results on a private dataset demonstrate the effectiveness and superiority of our proposed method compared to advanced methods.