Genetic-Based Two Granularity Ordering Methods for Multiple Workflow Scheduling
Feng Li, Wen Jun Tan, Moon Gi Seok, Wentong Cai · IEEE Access · 2023
In cloud computing, multiple workflow scheduling is important to optimize resource allocation and utilization for concurrent executions of diverse workflows across different applications. While previous research has focused on clustering-based resource allocation to reduce communication overheads by grouping tasks, it often overlooks the significance of task execution ordering, limiting overall performance optimization. To address the limitation, we propose two genetic-based approaches, considering task and cluster-level characteristics, to introduce novel ordering techniques for multi-workflow scheduling under cluster-based resource allocation. By comparing two granularity ordering methods, we offer valuable insights for efficient task management in multi-workflow environments. Our experiments demonstrate that the proposed approaches, especially the task granularity-based ordering method, outperform existing primary clustering methods, particularly for scenarios involving a large number of workflows or highly parallel workflows.