In-Network Caching Assisted Error Recovery For File Transfers
Nagmat Nazarov, Engin Arslan · 2022
Silent data corruption poses permanent data loss risk for file transfers as receiver server can accept and store corrupted data as genuine. Researchers proposed end-to-end integrity verification to recover from silent errors but recovery process requires entire file to be transmitted, which degrades the performance of transfers significantly. This paper takes advantage of programmable network devices to implement innetwork caching for file transfers such that silent errors can be recovered quickly and scarce network bandwidth can be used more efficiently. In the proposed design, data packets are mirrored to cache server as they pass through programmable devices such that when the receiver detects an error, it can retrieve the file from in-network cache instead of downloading from the source again. Our preliminary results show that in-network caching can shorten error recover duration by 50% and improve overall transfer performance by around 20%.