Content-Based Deduplication of Data Using Erasure Technique for RTO Cloud
Shweta Pal, Kiran More, Priya Dudhale Pise · 2018 International Conference On Advances in Communication and Computing Technology (ICACCT) · 2018
Data DE-duplication has an important role in reducing storage consumption to make it reasonably priced to manage in today's explosive data growth. There are problems like a specific file with same name, but different content may be present on the server, so user may get in trouble in downloading and uploading the files and due to network problems files may get corrupted. To overcome all these problems, we have proposed a system in which we are using History Aware Inline De-duplication algorithm for checking duplicity of data before uploading data on the server. MD5 algorithm would be used to generate the hash value of the data. Erasure coding would be used for encoding and storing data and for the recovery purpose when data will get corrupted. To evaluate the performance of system, experiment would be carried out on multiple files. For securing the file we are using data soft destruction. In order to achieve target of data effectively, we are using the algorithm of data folding to realize more efficient data soft destruction, which uses the sequence of data to override itself.