Re-Architecting the HST Data Management Systems
J. Edwin Huizinga, Faith Abney, Willie Miller · Space OPS 2004 Conference · 2004
The HST Data Management Systems (HST-DMS) at the Space Telescope Science Institute (STScI) encompass the development, integration and test, and operational environments to process the science and engineering data from the Hubble Space Telescope, ingest it into the archive and distribute raw and calibrated data to General Observers, mirror sites and the astronomical community at large. Last year, we re-architected the HST-DMS to create a flexible, scalable and highly reliable solution centered around an EMC storage area network (SAN), and a multi-domain SunFire 15K. Over the past year, we have reaped the benefits of this new architecture, which enabled us to deploy a completely new distribution system after end-to-end performance tests and with minimal disruption to our operations. The flexibility of the SunFire and EMC architectures also allows us to support short term, compute and data intensive projects such as the final processing of all data for the Hubble Ultra Deep Field, without impacting routine operations.