Efficient storage management for distributed storage system
Myat Pwint Phyu, Ni Lar Thein · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · 2011
As storage systems grow larger and more complex, the traditional block-based file systems cannot satisfy the large workload. More recent distributed file systems have adopted architectures based on object-based storage. This paper presents a framework of efficient storage management for distributed storage system. In object storage side, low-level storage tasks and data distribution must be managed and in metadata server side, we will manage how to scale the metadata. Due to the high space efficiency and fast query response, bloom filters have been widely utilized in recent storage systems. So, we will also utilize bloom-filter based approach to manage metadata by taking the advantages of bloom-filter and the semantic-based scheme will also be used to narrow the managed workload. In this paper, we will neglect the data distribution of object-based storage side.