Mixing cloud and grid resources for many task computing
David Abramson · 2011
Over the past 15 years we have developed a sophisticated tool set for solving large parameter sweep and search applications using a Many Task approach. This tool family, called Nimrod, makes it easy to create computational experiments in which multiple independent scenarios are explored. Nimrod supports complete state-space exploration (so called full parameter sweeps), guided search (using non-linear optimization techniques) and design-of-experiment schemes (for reducing the search space). All of these work by creating many tasks, and farming them out to computational units distributed (potentially) over a Grid. We have run many real world case studies over local clusters and the Grid.