One-pass text compression with a subword dictionary
Matti Jakobsson · Journal of the American Society for Information Science · 1988
A new one-phase technique for compression text files is presented as a modification of the Ziv and Lempel compression scheme. The method replaces parts of words in a text by references to a fixed-size dictionary which contains the subwords of the text already compressed. An essential part of the technique is the concept of reorganization. Its purpose is to drop from the dictionary the parts which are never used. The reorganization principle is based on observations of information theory and structural linguistics. By the reorganization concept the method can adapt to any text file with no a priori knowledge of the nature of the text. © 1988 John Wiley & Sons, Inc.