MONDO-SAM: A framework to systematically assess MDE scalability
Benedek Izsó, Gábor Szárnyas, István Ráth, Dániel Varró · 2014
Processing models efficiently is an important productivity factor in Model-Driven Engineering (MDE) processes. In or-der to optimize a toolchain to meet scalability requirements of complex MDE scenarios, reliable performance measures of different tools are key enablers that can help selecting the best tool for a given workload. To enable systematic and re-producible benchmarking across different domains, scenar-ios and workloads, we propose MONDO-SAM, an extensi-ble MDE benchmarking framework. Beyond providing eas-ily reusable features for common benchmarking tasks that are based on best practices, our framework puts special em-phasis on metrics, which enables scalability analysis along different problem characteristics. To illustrate the practical applicability of our proposal, we demonstrate how different variants of a model validation benchmark featuring several MDE tools from various technological domains have been integrated into the system. 1.