An Introduction to Information Theory
Michael B. Marcus · Mathematics Magazine · 1963
Information theory is concerned with developing a framework for the study of communication systems and their capacity to transmit messages in the presence of natural disturbances. The information function or entropy of a message source gives a quantitative measure of the usefulness of the source for transmitting messages. The capacity of the channel over which the message is being transmitted, gives a measure of the most efficient communication of information possible under given conditions. This subject is developed in a purely mathematical fashion and by making reference to descriptive concepts in electrical engineering.