Research on the Application of Distributed Key-Value Storage Technology in Computer Database Platform
Yang Dawei, Yang Hengxiang, Hu Meihui, Jun Ma · 2022 IEEE 2nd International Conference on Power, Electronics and Computer Applications (ICPECA) · 2022
With the development of big data technology and the increasing demand for massive data storage and analysis, there are more and more mature distributed storage systems. In the era of big data, traditional databases and centralized storage technologies have problems such as low processing efficiency and slow processing speed when processing big data, which cannot meet the needs of modern information data processing. Big data distributed storage technology is a new type of data storage technology that enhances the data processing capacity of the database, improves the data processing efficiency of the database, accelerates the data processing speed of the database, and meets the needs of information data processing in the era of big data. Based on the analysis of the respective characteristics and architecture of HBase and Hive, this paper proposes a storage engine design method based on HBase-Hive integrated design based on the specific project of converged communication to solve the data security and data acquisition efficiency in the converged communication system. The unsatisfactory situation in other aspects. Through comparative experiments, it is shown that this design scheme improves the efficiency of system data query and acquisition, and also prepares for the development of subsequent data mining.