Gated Orthogonal Recurrent Units: On Learning to Forget

© 2019 Massachusetts Institute of Technology. We present a novel recurrent neural network (RNN)based model that combines the remembering ability of unitary evolution RNNs with the ability of gated RNNs to effectively forget redundant or irrelevant information in its memory. We achieve this by extend...

Full beskrivning

Bibliografiska uppgifter
Huvudupphovsmän: Jing, Li, Gulcehre, Caglar, Peurifoy, John, Shen, Yichen, Tegmark, Max, Soljacic, Marin, Bengio, Yoshua
Övriga upphovsmän: Sloan School of Management
Materialtyp: Artikel
Språk:English
Publicerad: MIT Press - Journals 2021
Länkar:https://hdl.handle.net/1721.1/135148