Gated Orthogonal Recurrent Units: On Learning to Forget
© 2019 Massachusetts Institute of Technology. We present a novel recurrent neural network (RNN)based model that combines the remembering ability of unitary evolution RNNs with the ability of gated RNNs to effectively forget redundant or irrelevant information in its memory. We achieve this by extend...
| Main Authors: | , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
MIT Press - Journals
2021
|
| Online Access: | https://hdl.handle.net/1721.1/135148 |