Code Distributed Computing for Hierarchical MapReduce Systems
Chengkang Pang, Youlong Wu · 2023
This paper focuses on a hierarchical MapReduce distributed computing network, where distributed workers connect with multiple relay nodes to form several clusters, and the relay nodes communicate with each other via a central server. In the MapReduce tasks, the workers are assigned to compute output functions with the help of relays and the central server. We consider the case where the server can not store data (e.g., a switch node), and propose a file placement and coded shuffle scheme to reduce the uplink and downlink communication loads.