Content-aware URL Dispatch Algorithm for Web Server Cluster
Ying Gao · Jisuanji fangzhen · 2007
Content-aware service scheduling helps to balance the loads on Web server cluster. Most of the existing request dispatch algorithms firstly hash the requested URL, and then schedule the service according to certain load balancing rules. After analyzing the disequilibrium of Web flow distribution and the weakness of current URL hash algorithms, a URL dispatch Algorithm called LOCEP was proposed based on the URL lexicographic ordering and content evenly partitioning. The proposed algorithm accomplishes load balancing by first sorting all the URLs in their lexicographic order, then dividing these URLs into blocks of equal amount of contents and arranging them in increased order of access traffic, and finally grouping the blocks with the least access traffic and the blocks with the largest access traffic together and allocating them to the same back end server. Experimental results show that the algorithm obtains better load balancing than existing URL hash algorithms.