A tool to certify dynamic benchmarks
Jonathan Carrero, Ismael Rodrı́guez, Fernando Rubio · 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC) · 2022
Benchmarks are useful to allow evaluating the usefulness of new algorithms. However, care has to be taken to avoid cheating in case the users know the benchmarks in advance. In this paper, we present a blockchain-based tool that allows the generation of dynamic benchmarks. Moreover, it provides a verifiable certification about the moment when the benchmark was created, the researcher who asked for it, how much time was spent before solving it, etc. By using it, we can safely deal with the use of dynamic benchmarks without requiring a trusted third party.