Fundy: A Scalable and Extensible Resource Manager for Cloud Resources
Xiaodi Ke, Cong Guo, Siqi Ji, Shane Bergsma, Zhenhua Hu, Lei Guo · 2021
Scalability is an important property for a resource manager in the cloud. It is challenging to manage large-scale cluster resources while serving a large number of requests. Moreover, cloud-based applications and new technologies result in changeable requirements, so a cloud resource manager needs to continuously evolve. This paper presents a novel architecture design for a scalable and extensible resource manager. Our resource manager named Fundy employs a microservices architecture based on an in-memory data grid. The in-memory data grid accelerates data processing and enables Fundy to easily scale out. The data grid facilitates Fundy's microservices-based architecture. Because of the architecture, it is possible to rapidly deploy new features in Fundy. Fundy also enables multiple schedulers to schedule different workloads on shared infrastructure. In addition, we introduce a new packing algorithm to improve the allocation quality of our scheduler and a tensor scheduling algorithm to speed up parallel processing of requests by orders of magnitude. Fundy has been deployed in our production public cloud. This paper includes evaluation based on real-world traces and the results highlight the advantages of Fundy.