Streaming Exascale Data over 100Gbps Networks
Mehmet Balman · eScholarship (California Digital Library) · 2012
Data--intensive computing is one of the crosscutting themes in today's computer research.Many scientific activities depend on large--scale data analysis, scientific simulations, and verification of experimental results.Moreover, experimental facilities are distributed around the world, and scientific communities need to engage in large collaborative efforts.Consequently, there have been recent efforts to improve the network infrastructure to support increasing demand for information sharing between geographically distributed data centers.One of these efforts is the Advance Network Initiative (ANI 1 ) supported by the US Department of Energy (DoE) to deploy 100Gbps interconnects between national laboratories.As a part of the ANI project, ESnet 2 and Internet2 3 worked together to deliver a 100Gbps prototype network available for researchers at the Supercomputing (SC11) conference.This network, as shown in Figure 1, provided a 100Gbps connection between the National Energy Research Scientific Computing Center (NERSC 4 ) in Oakland, California; the Argonne Leadership Class Facility (ALCF 5 ) near Chicago; and Oak Ridge Leadership Class Facility (OLCF 6 ) in Oak Ridge, Tennessee.