Adaptive Divergence-Based Non-Negative Latent Factor Analysis of High-Dimensional and Incomplete Matrices From Industrial Applications
Ye Yuan, Xin Luo, MengChu Zhou · IEEE Transactions on Emerging Topics in Computational Intelligence · 2024
High-Dimensional andIncomplete (HDI) data are commonly seen in various big-data-related applications concerning the inherent non-negativity interactions among numerous nodes. ANon-negativeLatentFactorAnalysis (NLFA) model performs efficient representation learning to such HDI data. However, existing NLFA models all adopt a static divergence metric like Euclidean distance orα-βdivergence to build its learning objective, which evidently restricts its scalability in representing HDI data from different domains. Aiming at addressing this critical issue, this study proposes anAdaptiveDivergence-basedNon-negativeLatent-factor-analysis (ADNL) model with three-fold ideas: a) generalizing the objective function with theα-β-divergence to expand its potential of representing various HDI data; b) facilitating a smooth non-negative bridging function to connect the optimization variables with output latent factors for keeping non-negativity; and c) making the divergence parameters adaptive through position-transitional particle swarm optimization, thereby facilitating adaptive divergence in the learning objective to achieve high scalability. Empirical studies on six HDI datasets from real applications demonstrate that an ADNL model outperforms the state-of-the-art models in both estimation accuracy and computational efficiency for missing data of an HDI matrix.