Dynamically Sharing Memory between Memcached Tenants using Tingo
AmirHossein Seyri, Abhisek Pan, Balajee Vamanan · 2019
Web applications utilize in-memory caching systems to reduce the load on backend databases and improve the performance of the system. These cache environments normally host multiple tenants simultaneously, signifying the need to efficiently manage the underlying physical memory allocation in these environments. Off-the-shelf caches statically divide the memory between tenants, which often leads to poor utilization and low hit rates for some of these tenants. In this work, we present Tingo, a multi-tenant cache environment designed to adequately manage the memory allocation of cache tenants to help them adapt to their workloads and optimize their hit ratios, by dynamically reallocating memory pages among them.