Application of Consistent Hash Based on Virtual Node in Traffic Big Data
Miao Wang, Quanling Sun · 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP) · 2022
With the development of internet and artificial intelligence, the data volume of all industries has increased exponentially. How to store these massive data has become the core problem at this stage. Taking traffic big data as an example, this paper introduces the framework of distributed storage and consistent hashing technology. At the same time, an improved consistent hashing algorithm based on virtual node is proposed. It solves the hot spot problem in network storage and the problem of data skew caused by uneven node distribution. Experimental results show that this adaptive consistent hashing algorithm based on virtual node can provide better node allocation efficiency and better adaptability.