A class of statistics based on the information concept
Lucien G. Preuss · Communication in Statistics- Theory and Methods · 1980
The methodic use of Shannon's entropy as a basic concept, complementing probability, leads to a new class of statistics which provides, inter alia, a measure of mutual dissimilarity y between several frequency distributions. Application to contin-gency tables with any number of dimensions yields a dimension-less, standardised contingency coefficient which depends on the direction of inference and will combine multiplicatively with the number of observed events. This class of statistics further in-cludes a continuous modification W of the number of degrees of freedom in a table, and a measure Q of its overall information content. Numerical illustrations and comparisons with former re-sults are worked out. Direct applications include the optimal partition of a quasicontinuum into cells by maximizing Q, the ordering of unordered tables by minimising local values of y, and a tentative absolute weighting of inductive inference based on the minimal necessary shift, required by an hypothesis, between the actually observed data and a set of assumed future events.