Research on Distributed Storage Method for Big Data of Geological and Mineral Resources Based on Hadoop
Jun Fang, Chaokui Li, Yanan Zhao, Keyan Xiao, Baiyan Wu · 2018
With the emergence of big data of TB and PB geological and mineral resources, the storage of large geological data has become a worldwide problem puzzling geologists. The traditional storage and service model of geological data is facing a great challenge. In this paper, a new data storage method of geology and mineral resources based on cloud computing environment is put forward combined with Hadoop. This method is compared with traditional Oracle database storage method. The experimental results show that the storage method proposed in this paper is more efficient than the traditional method. At the same time, it effectively solves the problem of small file storage in Hadoop storage. The research results provide a new technical support for the storage and management of geological and mineral data.