Compressing deep neural networks by matrix product operators

A deep neural network is a parametrization of a multilayer mapping of signals in terms of many alternatively arranged linear and nonlinear transformations. The linear transformations, which are generally used in the fully connected as well as convolutional layers, contain most of the variational par...

Full description

Bibliographic Details
Main Authors: Ze-Feng Gao, Song Cheng, Rong-Qiang He, Z. Y. Xie, Hui-Hai Zhao, Zhong-Yi Lu, Tao Xiang
Format: Article
Language:English
Published: American Physical Society 2020-06-01
Series:Physical Review Research
Online Access:http://doi.org/10.1103/PhysRevResearch.2.023300