A Concise Study on Data Duplication Removal using File Checksum
Debashree Sadagar, Mir Aadil · Zenodo (CERN European Organization for Nuclear Research) · 2022
The goal of the project is to develop software that uses file checksums to prevent data duplication. Notepad++ and Visual WAMP Server were used to create the project. It is used to design and develop project software. My SQL was used to construct and maintain all databases. The project's main goal is to reduce the amount of duplicates in one type of NoSQL database, particularly the key-value store, to improve process performance so that the backup window is not impacted, and to design for horizontal scaling so that it can compete on a Cloud Platform.