A Compressed Storage System for Power Communication Network Traffic Data Based on Microservices Architecture
Xi He, Rundong Gan, Ce Wang, Xianfeng Zhu, Qidi Hu, Yuxu Chen · 2024
When dealing with large amounts of data, ensuring data consistency and synchronization may become a non-negligible problem due to the fact that the services in the microservice architecture are distributed on different servers. Therefore, this paper proposes a compressed storage system for power communication network traffic data based on microservice architecture. While coping with the massive amount of data generated in power communication networks, the system is combined with statistical methods to realize an efficient and reversible data compression and fusion model by encoding and converting the raw data. It supports protocol-independent and adaptive abnormal behavior detection. Experimental results show that the system combines the flexibility of microservice architecture and the advantages of data compression technology to realize efficient data storage and transmission.