Network in Sequential Form: Combine Tree Structure Components into Recurrent Neural Network
Swaleha Zubair, Anjani Kumar Singha · IOP Conference Series Materials Science and Engineering · 2021
Abstract Smaller units nestled in larger units-a natural language that is hierarchically ordered. Smaller sections are replaced because of the completion of the bigger constituencies. The basic LSTM architecture does not have a clear choice for modeling the hierarchy of components as separate neurons do not require knowledge to be monitored on various time scales. The idea in this paper is to introduce inductive bias by grouping the neurons. The modifications we create to the master input vector are changed in all neurons following the order of the specified neuron and forget windows. Four activities on which we can achieve strong care unattended sorting, logical inference, and language modeling and guided syntax evaluation.