XGet: a highly scalable and efficient file transfer tool for clusters
Hugh Greenberg, Latchesar Ionkov, Ronald G. Minnich · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · 2008
As clusters rapidly grow in size, transferring files between nodes can no longer be solved by the traditional transfer utilities due to their inherent lack of scalability. In this paper, we describe a new file transfer utility called XGet, which was designed to address the scalability problem of standard tools. We compared XGet against four transfer tools: Bittorrent, Rsync, TFTP, and Udpcast and our results show that XGet's performance is superior to the these utilities in many cases.