Batch-Layer Method for Data Transformation Before Compression
Alexey Viktorovitch Levenets, Ilya Bogachev, Damir Zaitsev · 2024
The article proposes a method for preliminary processing of measurement data. The substance of the method lies in transforming the source data set into a formally unrelated data set; the samples of the set are formed from bits belonging to different samples of the original data. The proposed method allows one to obtain a more ordered set of samples compared to the original data. As a rule, an increase in orderliness results in an increase in the compression efficiency of the transformed data compared to the original data. Research was conducted on measurement data obtained from information and measuring systems of several energy facilities. In the work, two types of data were studied - conditionally stationary and conditionally non-stationary, differing by the width of the dynamic range. Also, in addition to the original data, their difference series were studied. The results of the study are presented, showing that the maximum effect of the transformation is obtained when processing conditionally non-stationary data. Processing conditionally stationary data leads to an insignificant increase in the compression efficiency. Directions for further research of the method are proposed.