AHI-CALIOP Collocated Data for Training and Validation of Cloud Masking Neural Networks
Daniel Jamie Victor Robbins, Caroline Poulsen, Simon Proud, Steven T. Siems · Zenodo (CERN European Organization for Nuclear Research) · 2021
Collocated data between AHI at 2km resolution (nadir) and CALIOP 1km cloud product v4.20 used for training and validating cloud identification neural networks. The main training and validation data from 2019 is stored in monthly directories, whilst the collocated dataset used to compare the NN, JMA and BoM cloud mask performances is the file "superdf.h5". All collocated data is stored as .h5 files and was built using the Python Pandas package. In this archive, the data has been stored as compressed directories for each month or as a single compressed file in the case of "superdf.h5" using tar with bzip2 compression or just bzip2 compression respectively.