Mixing Hadoop and HPC workloads on parallel filesystems

Esteban Molina-Estolano, Maya B. Gokhale, Carlos Maltzahn, John M. May, John Bent, Scott Brandt · 2009

MapReduce-tailored distributed filesystems---such as HDFS for Hadoop MapReduce---and parallel high-performance computing filesystems are tailored for considerably different workloads. The purpose of our work is to examine the performance of each filesystem when both sorts of workload run on it concurrently.

Read the paper · More papers on PaperTik