Multi-level Scheduling Algorithm Based on Storm
Jie Wang, Siguang Hang, Jiwei Liu, Weihao Chen, Gang Hou · KSII Transactions on Internet and Information Systems · 2016
Hybrid deployment under current cloud data centers is a combination of online and offline services, which improves the utilization of the cluster resources.However, the performance of the cluster is often affected by the online services in the hybrid deployment environment.To improve the response time of online service (e.g.search engine), an effective scheduling algorithm based on Storm is proposed.At the component level, the algorithm dispatches the component with more influence to the optimal performance node.Inside the component, a reasonable resource allocation strategy is used.By searching the compressed index first and then filtering the complete index, the execution speed of the component is improved with similar accuracy.Experiments show that our algorithm can guarantee search accuracy of 95.94%, while increasing the response speed by 68.03%.