Evaluating the Ability of LSTMs to Learn Context-Free Grammars
Luzi Sennhauser, Robert C. Berwick · 2018
While long short-term memory (LSTM) neural net architectures are designed to capture sequence information, human language is generally composed of hierarchical structures.This raises the question as to whether LSTMs can learn hierarchical structures.We explore this question with a well-formed bracket prediction task using two types of brackets modeled by an LSTM.