A distributed parallel storage architecture and its potential application within EOSDIS
William E. Johnston, Brian Tierney, Jay Feuquay, Tony Butzer · University of North Texas Digital Library (University of North Texas) · 1994
We describe the architecture, implementation, use, and potential use of a scalable, high-performance, distributed-parallel data storage system developed in the ARPA funded MAGIC gigabit testbed 1 . A collection of wide area distributed disk servers operate in parallel to provide logical block level access to large data sets. Operated primarily as a network -based cache, the architecture supports cooperation among independently owned resources to provide fast, large-scale, on-demand storage to support data handling, simulation, and computation. 1.0 Introduction We have designed and implemented a wide area network-based, distributed-parallel storage system ("DPSS") as part of an ARPA funded collaboration known as the MAGIC gigabit testbed [1], and as part of DOE's high speed distributed computing program. This technology has been quite successful in the MAGIC environment, and it has the potential for enhancing data rich environments like EOSDIS (see [2] and Figure 7). The DPSS provid...