Time-series information and learning
Daniil Ryabko · 2013
Given a time series X1, ..., Xn, ... taking values in a large (high-dimensional) space X, we would like to find a function f from X to a small (low-dimensional or finite) space Y such that the time series f(X1), ..., f(Xn), ... retains all the information about the time-series dependence in the original sequence, or as much as possible thereof. This goal is formalized in this work, and it is shown that the target function f can be found as the one that maximizes a certain quantity that can be expressed in terms of entropies of the series (f(Xi))i ϵ N. This quantity can be estimated empirically, and does not involve estimating the distribution on the original time series (Xi)i ϵ N.