Reducing Complexity of Rule Extraction from Prediction RNNs trough Domain Interaction
Henrik Jacobsson, Tom Ziemke · Diva portal (Dalarna University Library) · 2003
This paper presents a quantitative investigation of the differences between rule extraction through breadth first search and through sampling the states of the RNN in interaction with its domain. We show that for an RNN trained to predict symbol sequences in formal grammar domains, the breadth first search is especially inefficient for languages sharing properties with realistic real world domains. We also identify some important research issues, needed to be resolved to ensure further development in the field of rule extraction from RNNs.