Attention-based Multilayer Linear Diffusion Model
<p>Yixuan Zhang</p> · Academic Journal of Computing & Information Science · 2024
In recent years, two major issues in recommendation systems have received extensive attention from researchers: (1) The incompleteness of user interaction data: In recommendation systems, user interaction data is often incomplete. (2) Difficulty in accurately reflecting users' true preferences through interactions: User interaction data may suffer from selection biases, with some interactions possibly being noise, leading to misinterpretation of user preferences by the recommendation system. To address these challenges, we propose an Attention-based Multilayer Linear Diffusion Model (AMLDM). Specifically, we gradually introduce pre-defined Gaussian noise into the forward process to disrupt users' interaction histories. Subsequently, through multiple attention-based linear layers, we iteratively restore the damaged interaction histories incurred during th e forward process, ensuring that the distribution of the repaired interaction history aligns with the original distribution of user interaction history. By injecting an appropriate amount of noise into users' interaction histories, we enhance the robustness of the recommendation system and learn users' true preferences during the reverse process. Comparative analysis with several benchmark recommendation system models demonstrates the significant advantages of our proposed algorithm in recommendation performance.