A Web services data analysis Grid
William A. Watson, Ian Bird, Jie Chen, Bryan Hess, Andy Kowalski, Ying Chen · Concurrency and Computation Practice and Experience · 2002
Abstract The trend in large‐scale scientific data analysis is to exploit computational, storage and other resources located at multiple sites, and to make those resources accessible to the scientist as if they were a single, coherent system. Web technologies driven by the huge and rapidly growing electronic commerce industry provide valuable components to speed the deployment of such sophisticated systems. Jefferson Lab, where several hundred terabytes of experimental data are acquired each year, is in the process of developing a Web‐based distributed system for data analysis and management. The essential aspects of this system are a distributed data Grid (site independent access to experimental, simulation and model data) and a distributed batch system, augmented with various supervisory and management capabilities, and integrated using Java and XML‐based Web services. Copyright © 2002 John Wiley & Sons, Ltd.