Building a Parallel Cloud Storage System using OpenStack’s Swift Object Store and Transformative Parallel I/O

Andrew J. Burns, Kaleb D. Lora, E.M De La Paz Martinez, Martel L. Shorter · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · 2012

Our project consists of bleeding-edge research into replacing the traditional storage archives with a parallel, cloud-based storage solution. It used OpenStack's Swift Object Store cloud software. It's Benchmarked Swift for write speed and scalability. Our project is unique because Swift is typically used for reads and we are mostly concerned with write speeds. Cloud Storage is a viable archive solution because: (1) Container management for larger parallel archives might ease the migration workload; (2) Many tools that are written for cloud storage could be utilized for local archive; and (3) Current large cloud storage practices in industry could be utilized to manage a scalable archive solution.

Read the paper · More papers on PaperTik