Statistical analysis of changes for synthesizing realistic test models
Hamed Shariat Yazdi, Pit Pietsch, Timo Kehrer, Udo Kelter · 2013
Abstract: Tools and methods in the context of Model-Driven Engineering have to be evaluated and tested. Unfortunately, adequate test models are scarcely available in many application domains, and available models often lack required properties. Test model generators have been proposed recently to overcome this deficiency. Their ba-sic principle is to synthesize test models by controlled application of edit operations from a given set of edit operation definitions. If test models are created by randomly selecting edit operations, then they become quite unnatural and do not exhibit real-world characteristics; generated sequences of edit operation should rather be similar to realistic model evolution. To this end, we have reverse-engineered a carefully se-lected set of open-source Java projects to class diagrams and computed the differences between subsequent revisions in terms of various edit operations, including generic low-level graph edit operations and high-level edit operations such as model refactor-ings. Finally, we statistically analyzed the distribution of the frequency of these edit operations. We have checked the fitness of 60 distributions in order to correctly rep-resent the statistical properties. Only four distributions have been able to adequately describe the observed evolution. The successful distributions are being used to config-ure our model generator in order to produce more realistic test models. 1