A load balancing algorithm in multi-tenancy environment
Tao Zhao, Hailong Sun, Yu Gui Tang, Xudong Liu · 2013
Multi-tenancy brings new challenges to load balancing, since it incurs resource competition and different QoS requirements of hosted applications. Therefore, servers with multiple deployed applications need a proper request scheduling policy to guarantee their quality of service, e.g., response time. However, when under heavy loads, mean response time of some applications may become too high to be acceptable due to the mutual intervention among tenants. In this work, we propose a new load balancing algorithm, "Server Throughput Restriction(STR)", based on M/G/s/s+r queueing model, in order to guarantee each application's mean response time.