FaaSCTDO: Collaborative Task-Data Orchestration for Serverless Workflows
Neng Yang, Haitao Zhang, Yepeng Zhang · 2023
The use of Function-as-a-Service (FaaS) platforms for executing complex serverless workflows has gained significant popularity. However, the stateless nature of FaaS requires functions to rely on remote storage to store their state, leading to performance overhead and reduced efficiency. Previous approaches using excess memory resources as caches can cause resource contention and decreased task execution performance. Moreover, the impact of workflow orchestration approaches on latency has not been fully explored. To address these challenges, we propose FaaSCTDO, a framework for collaborative task and data orchestration in serverless workflows. FaaSCTDO provides developers with comprehensive lifecycle management capabilities, treating data as orchestratable objects. It groups tasks and data with high data correlation together and allocates them on the same server node, leveraging data locality to expedite function access to data.