Problems of Message Routing Algorithms in Streaming Data Processing Systems
George G. Bulychev, Alexey V. Chernykh · Radioelectronics Nanosystems Information Technologies · 2022
Existing problems of routing algorithms, such as high overhead costs for scaling components and low fault tolerance of the system, are considered. An algorithm is proposed that eliminates the shortcomings of the existing ones due to the rejection of a centralized router and the strict separation of pipelines within the system. The algorithm is based on adding a special token to the message. For the proposed algorithm, the performance improvement is mathematically proved, and the practical load on the system is simulated to confirm the obtained theoretical results.