Simplicity, information, Kolmogorov complexity and prediction
Paul M. B. Vitanyi, Ming Li · Cambridge University Press eBooks · 2002
In contrast to statistical entropy which measures the quantity of information in an average object of a given probabilistic ensemble, Kolmogorov complexity is the quantity of absolute information in an individual object. It is a novel notion of randomness and resolves problems in probability theory, statistical information theory, and philosophy.