Reducing file system tail latencies with Chopper
Jun He, Duy V. M. Nguyen, Andrea Carol Arpaci-Dusseau, Remzi H. Arpaci-Dusseau · 2015
We present Chopper, a tool that efficiently explores the vast input space of file system policies to find behav-iors that lead to costly performance problems. We fo-cus specifically on block allocation, as unexpected poor layouts can lead to high tail latencies. Our approach utilizes sophisticated statistical methodologies, based on Latin Hypercube Sampling (LHS) and sensitivity analy-sis, to explore the search space efficiently and diagnose intricate design problems. We apply Chopper to study the overall behavior of two file systems, and to study Linux ext4 in depth. We identify four internal design issues in the block allocator of ext4 which form a large tail in the distribution of layout quality. By removing the underly-ing problems in the code, we cut the size of the tail by an order of magnitude, producing consistent and satisfactory file layouts that reduce data access latencies. 1