A fast input/output library for high resolution climate models
Xiaomeng Huang, W. Wang, Haohuan Fu, Guangwen Yang, bao wang, C. Zhang · 2013
Abstract. We describe the design and implementation of Climate Fast Input/Output (CFIO), a fast input/output (I/O) library for high resolution climate models. CFIO provides a simple method for modelers to overlap the I/O phase with the computing phase automatically, so as to shorten the running time of numerical simulations. To minimize the code modifications required for porting, CFIO provides similar interfaces and features to Parallel network Common Data Form (PnetCDF), which is one of the most widely used I/O libraries in climate models. We deployed CFIO in three high resolution climate models, including two ocean models (POP and LICOM) and one sea ice model (CICE). The experimental results show that CFIO improves the performance of climate models significantly versus the original serial I/O approach. When running with CFIO at 0.1° resolution with about 1000 CPU cores, we managed to reduce the running time by factors of 7.9, 4.6 and 2.0 for POP, CICE, and LICOM respectively. We also compared the performance of CFIO against PnetCDF in different scenarios. For scenarios with both data output operations and computations, CFIO decreases the I/O overhead by a factor of 5.1 compared to PnetCDF.