Functional Gradient Descent for n-Tuple Regression
Rafael F. Katopodis, Priscila M. V. Lima, Felipe M. G. França · ESANN 2021 proceedings · 2021
n-tuple neural networks have been in the past applied to a wide range of learning domains.However, for the particular area of regression, existing systems have displayed two shortcomings: little flexibility in the objective function being optimized and an inability to handle nonstationarity in an online learning setting.A novel n-tuple system is proposed to address these issues.The new architecture leverages the idea of functional gradient descent, drawing inspiration from its use in kernel methods.Furthermore, its capabilities are showcased in two reinforcement learning tasks, which involves both nonstationary online learning and task-specific objective functions.