Planning Data Intensive Workflows on Inter-domain Resources Using the Network Service Interface (NSI)
Zhiming Zhao, Jeroen van der Ham, A. Taal, Ralph Koning, Cosmin Dumitru, Adianto Wibisono, Paola Grosso, Cees de Laat · 2012
The recent emergence of advanced network infrastructures for e-Science enables tuning of network performance at the application level. The Network Service Interface (NSI) has been created as a result of collaborative development of network and application engineers primarily associated with the Research and Education (R&E) community. The NSI allows workflow systems not only to check available service points for a workflow engine to schedule executions, but also to reserve and provision network connections among those service points. However, the current NSI services are proposed mainly from the network resource management perspective, which concerns little about the programming model of applications. In this paper we extend our previous system called NEtWork QoS Planner (NEWQoSPlanner) by adding inter domain network resource selection and provisioning using NSI. We will discuss how NEWQoSPlanner invokes network services to achieve dynamic resource optimization for workflows, and how to apply such planner in heterogeneous infrastructures.