Improving the responsiveness of internet services with automatic cache placement
Alexander Rasmussen, Emre Kıcıman, Benjamin Livshits, Madanlal Musuvathi · 2009
The backends of today's Internet services rely heavily on caching at various layers both to provide faster service to common requests and to reduce load on back-end components. Cache placement is especially challenging given the diversity of workloads handled by widely deployed Internet services. This paper presents TOOL, an analysis technique that automatically optimizes cache placement. Our experiments have shown that near-optimal cache placements vary significantly based on input distribution.