A Large Scale Data Transmission Control Mechanism across Data Centers
Wenjiang Ding, Wei Li, Runhuan Zhang, Qianqian Zhang, Chenhao Yang · 2017
With the rapid development of the information technology, the scale of data is quickly increasing, and the more and more data centers are built by research institutions or commercial organizations. In order to collect and analyze the data, the end-to-end transmission for the large scale of data across data centers need be implemented. However, the existing works are mainly based on TCP or UDP, and can not meet the actual demand. For TCP, the transmission efficiency is low due to the frequent three-way handshake and the mismatch between the sending window and the link capacity. For UDP, the transmission is unreliable and the compatibility of the improved methods is poor. In order to solve the above problems, an end-to-end transmission control model based on session management is proposed. In this model, two kinds of agents and the session management mechanism are adopted to localize TCP three-way handshake in the data center and improve the transmission efficiency of the large scale data across data centers, and the improved UDP is used to the long-distance transmission between the agents in order to enhance the reliability of the end-to-end transmission. The experimental results show that the transmission control mechanism presented in this paper can effectively reduce the transmission delay and improve the efficiency of transmission for the large scale data.