Mitigating Serverless Tail Latency: A Comprehensive Study of Factors and Strategies
Anisha Kumari, Ranjan Kumar Behera, Bibhudatta Sahoo · 2023
Serverless computing has gained widespread popularity due to its ability to dynamically allocate resources and abstract away the underlying infrastructure, allowing developers to focus on writing code without the need to manage servers. However, one challenge in serverless computing is tail latency, which refers to the time taken by the slowest requests to complete. High tail latency can result in poor user experience and decreased application performance. This research paper aims to explore techniques and best practices to reduce tail latency in serverless computing environments. We have reviewed the existing literature, identify the key factors affecting tail latency, and analyze various approaches and strategies to mitigate tail latency in serverless computing. Some real-world use cases and practical recommendations for developers and practitioners in term of tail latency in serverless computing to optimize the performance of serverless applications are also presented.