Optimizing SAS tasks for Grid Architectures
Aitor Ibarra, Daniel Tapiador, F. Félix, C. Gabriel, C. Arviset, J. Hoar, Sana Ullah Ansari · 2006
Aitor Ibarra, Daniel Tapiador, Fernando F´elix, Carlos Gabriel,Christophe Arviset, John HoarEuropean Space Agency, ESAC, Madrid, SpainSalim AnsariEuropean Space Agency, ESTEC, Noordwijk, The NetherlandsAbstract.We present the first prototype of a XMM-Newton pipeline processingtask parallelized at a CCD level, which can be run in a GRID system.By using the GridWay application, the processing of the XMM-Newtondata is distributed across the Virtual Organization constituted by threedifferent research centres (ESAC, ESTEC, Complutense Madrid Univer-sity).1. IntroductionThe advent of Virtual Observatories (Williams 2004) will allow the astronomersaround the world the access to an unprecedented amount of scientific data. Theprocessing of those data will be carried out, in most cases, by using the compu-tational resources supplied by the Data Provider to the scientific community.Due to the large amount of data available, it is crucial that the Data Providercould manage their hardware resources in an optimal way, if they do not wantthe data processing to slow down. In this context, GRID technology offers thecapabilityofmanagingnotonlytheuserqueriesretrievingdatafromthearchive,but also the online processing of that data. By using GRID architectures, thisonline processing can be a bottleneck, depending on the data software reductionused.TheScienceArchiveshostedattheEuropeanSpaceAstronomyCentre(ESAC)and particularly the XMM-Newton Science Archive (XSA), give the scientificcommunity the possibility to process the data on-the-fly