Dynamic network functional comparison via approximate-bisimulation
Francesco Donnarumma, Aniello Murano, Roberto Prevete · 2015
Abstract: It is generally unknown how to formally determine whether different neural networks have a similar behaviour. This question intimately relates to the problem of finding a suitable sim-ilarity measure to identify bounds on the input-output response dis-tances of neural networks, which has several interesting theoretical and computational implications. For example, it can allow one to speed up the learning processes by restricting the network parameter space, or to test the robustness of a network with respect to param-eter variation. In this paper we develop a procedure that allows to compare neural structures among them. In particular, we con-sider dynamic networks composed of neural units characterised by non-linear differential equations, described in terms of autonomous continuous dynamic systems. The comparison is established by im-porting and adapting from the formal verification setting the concept of δ−approximate bisimulations techniques for non-linear systems. We have positively tested the proposed approach over continuous time recurrent neural networks (CTRNNs).