Optimization of Large Scale of Files Transfer in Meteorological Grid
Keddy Wornyo Dickson, Tinghuai Ma, Jin Wang, W. Tian, Hao Cao · 2013
This paper focuses on performance enhancement of large scale of small files transfer, which is critical to the performance of meteorological grid. GridFTP and compression techniques are used to optimize the efficiency. The transfer parameters are configured before transmission, such as extended block mode (Mode E), TCP buffer size. Compression is used to compress files into single file, in order to eliminate negotiating time before transmission. During the course of our research, we sacrifice the disk space for avoiding the vicious recurrence of compression-decompression-compression. In the end, the experiments show the advantages of our approach.