ServMark: A Framework for Testing Grid Services
Cătălin Dumitrescu, Alexandru Iosup, Hashim Mohamed, Dick H. J. Epema, Matei Ripeanu, Nicolae Ţăpuş, Ioan Raicu, Ian T Foster · 2007
The dynamicity, the heterogeneity, or simply the sheer scale of today’s grids expose in grid services problems of performance, functionality, and reliability. While testing under realistic conditions is a proven industrial method, little has been done in grids in this direction. Early testing in real grids reveals failure rates from 10% and up to 45% [1], [2], [3], and functionality problems of around 1 every 3 tests for widelyinstalled grid services [4]1. To further the development of grid services testing in large-scale settings, we present in this work the SERVMARK framework. In SERVMARK, we address two orthogonal research questions : (1) How to test a large-scale, distributed, and (grid)service-based environment? and (2) How to generate realistic testing traces for a wide-range of testing scenarios?. To the best of our knowledge, and as the main contribution of this work, ours is the first approach that answers both questions in the context of functionality testing and system tuning, of performance testing, and of reliability testing.