Research on duplication deletion based on data storage
He Le · Railway Computer Application · 2013
Data duplication deletion was called single instance storage or intelligent compression. In order to reduce the consumption of space, first to segment files, then use SHA-1 algorithm for the detection of duplicate data segments, finally, establish data dictionary for the storage of single instance of the data segment and compress it. Thus, a lot of storage space was saved, effective data storage and data backup were implemented. Through the analysis of the key technology of data duplication, it was found the shortage of existing technology, and then improved. This technology was widely used in the area of data storage, brought the revolutionary breakthrough, and it could effectively save the cost of data storage hard disk.