A Non-Shared Metadata Management Scheme for Large Distributed File Systems
Jong-Byeon Yun, Yang-Bun Park, Seok-Jae Lee, Su-Min Jang, Jaesoo Yoo, Hong-Yeon Kim, Young‐Kyun Kim · Jeongbo gwahaghoe nonmunji. si'seu'tem mich i'lon · 2009
Most of large-scale distributed file systems decouple a metadata operation from read and write operations for a file. In the distributed file systems, a certain server named a metadata server (MDS) maintains metadata information in file system such as access information for a file, the position of a file in the repository, the namespace of the file system, and so on. But, the existing systems used restrictive metadata management schemes, because most of the distributed file systems designed to focus on the distributed management and the input/output performance of data rather than the metadata. Therefore, in the existing systems, the metadata throughput and expandability of the metadata server are limited. In this paper, we propose a new non-shared metadata management scheme in order to provide the high metadata throughput and scalability for a cluster of MDSs. First, we derive a dictionary partitioning scheme as a new metadata distribution technique. Then, we present a load balancing technique based on the distribution technique. It is shown through various experiments that our scheme outperforms existing metadata management schemes in terms of scalability and load balancing.