Universal estimation of the optimal probability distributions for data compression of discrete memoryless sources with fidelity criterion
H. Koga, S. Arimoto · 2002
Output probability distributions of the test channels play important roles in data compression of discrete memoryless sources with fidelity criterion. In this paper a universal algorithm for estimating the output probability distributions is proposed. Sample size required by the algorithm is evaluated under a criterion of estimation similar to that of PAC learning in the computational learning theory.