Key-Value Database Access Optimization For PMIx Standard Implementation

Artem Y. Polyakov, Alexandr V. Efimov, Konstantin E. Kramarenko, Kirill V. Pavsky · 2021 Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT) · 2021

This paper outlines our results in the field of distributed computing systems software stacks based on Process Management Interface eXascale (PMIx). PMIx standard represents the runtime environment information as a Key-Value Database (KVDb) thatis typical lylocatedin the shared memory of the compute nodes. An important specific of PMIx is the parallel and intensive read accesses to the KVDb with relatiwly infrequent updates. Locking schemes for synchronizing access to shared memory database with a predominance of reading operations are considered. In this paper, we propose two modifications of the reviewed locking scheme aimed at optimizing the throughput in the concurrent read-write access mode. The reduction in overhead is achieved by improving the signaling method, which reduces the number of atomic operations required to access the KVDb. A micro-benchmark has been developed that allows evaluating the performance of locking schemes. The results of the experiments showed an increase in the throughput of the synchronization scheme for both read and write operations.

Read the paper · More papers on PaperTik