Cloud Resource Provisioning and Bottleneck Eliminating for Meshed Web Systems
Yamin Lei, Zhicheng Cai, Hang Wu, Rajkumar Buyya · 2020
Most of existing resource provisioning methods are designed for traditional Web applications with linear structures. However, Web systems with the meshed topology are becoming widespread. Meshed connections among different tiers make Virtual Machine (VM) provisioning and bottleneck elimination complex. In this paper, a Jackson network based Proactive and Reactive VM auto-scaling Method (JPRM) is proposed. In JPRM, request transition behaviors among tiers are modeled as a finite-state Markov stochastic process. A transition probability matrix is studied on-line to predict resource requirements based on M/M/N queuing models as proactive control. For reactive provisioning, the final increased request rate of each tier is determined based on stable state checking and Jackson equilibrium equation solving to eliminate bottleneck tiers and avoid bottleneck shifting. The JPRM is evaluated in a simulation environment established using CloudSim. Experimental results show that JPRM avoids bottleneck shifting with reasonable additional VM rental costs compared with existing methods.