Flaws and frauds in the evaluation of IDS/IPS technologies
Stefano Zanero · Virtual Community of Pathological Anatomy (University of Castilla La Mancha) · 2007
In this paper, we will briefly review the problem of IDS and IPS performance evaluation, demonstrating how flawed current approaches to evaluation are, both in academia and in the industry.We will show all the issues in current testing methodologies, as well as key reasons to distrust claimed performance rates of current IDS systems.We will also show how practical testing architectures can be created to compare systems, and how they can be used in academic and industrial evaluations.