μManycore: A Cloud-Native CPU for Tail at Scale
Jovan Stojkovic, C.Richard Liu, Muhammad Mateen Shahbaz, Josep Torrellas · 2023
Microservices are emerging as a popular cloud-computing paradigm. Microservice environments execute typically-short service requests that interact with one another via remote procedure calls (often across machines), and are subject to stringent tail-latency constraints. In contrast, current processors are designed for traditional monolithic applications. They support global hardware cache coherence, provide large caches, incorporate microarchitecture for long-running, predictable applications (such as advanced prefetching), and are optimized to minimize average latency rather than tail latency.