Batch Processing Algorithms for NewSQL-based Big Data Systems
Naveen Kumar Vadlamudi, Wendy Osborn · 2025
Migration of sharded database systems requires a solid understanding of the fundamentals of database and data engineering. Currently, migration strategies for sharded database systems are not documented in the literature. In this paper, we will look at the algorithms for sharded systems, and we evaluate them by comparing its efficiency and performance. Our algorithms aim primarily to reduce the processing time to migrate big data encapsulated in large organizations. By reducing the processing time organizations will not only reduce their cloud bill, but it also makes data available faster for reports, and also for training AI models.