Silent Data Access Protocol for NVRAM + RDMA Distributed Storage
Qingyue Liu, Peter Varman · 2020
Recent advances in hardware technologies raise new opportunities for architecting storage systems to exploit emerging NVRAM memory devices, fast remote-memory RDMA networking, and large numbers of processor cores. In this paper, we present Telepathy, a novel data access protocol for a distributed key-value storage system constructed around NVRAM and RDMA. Telepathy supports replicated data storage for fault tolerance and guarantees strong consistency while supporting high-volume concurrent read/write access from multiple client nodes. Our read protocol can perform largely silent consistent reads from any of the replica nodes holding an object, while our write protocol exploits remote atomic and non-volatile buffers to silently perform write contention resolution. Our experiments on an RDMA-enabled cluster using YCSB benchmarks show that Telepathy can achieve microsecond-range reads and writes with small tail latencies, GB-range data access bandwidth with small CPU utilization, and data consistency guarantees.