Value Function Approximation in Reinforcement Learning Using the Fourier Basis
George Konidaris, Sarah Osentoski, Philip S. Thomas · Proceedings of the AAAI Conference on Artificial Intelligence · 2011
We describe the Fourier basis, a linear value function approximation scheme based on the Fourier series. We empirically demonstrate that it performs well compared to radial basis functions and the polynomial basis, the two most popular fixed bases for linear value function approximation, and is competitive with learned proto-value functions.