Deep neural network initialization with sparsity inducing activations

Deep neural network initialization with sparsity inducing activations

Bibliographic Details
Main Authors:	Price, I, Daultry Ball, N, Jones, AC, Chun Hei Lam, S, Tanner, J
Format:	Conference item
Language:	English
Published:	OpenReview 2024

Similar Items

Sparsity-Aware Orthogonal Initialization of Deep Neural Networks
by: Kiara Esguerra, et al.
Published: (2023-01-01)

ACSL : adaptive correlation-driven sparsity learning for deep neural network compression
by: He, Wei, et al.
Published: (2021)

Exploiting sparsity for neural network verification
by: Newton, M, et al.
Published: (2021)

Twofold Sparsity: Joint Bit- and Network-Level Sparsity for Energy-Efficient Deep Neural Network Using RRAM Based Compute-In-Memory
by: Foroozan Karimzadeh, et al.
Published: (2024-01-01)

The impact of sparsity in low-rank recurrent neural networks.
by: Elizabeth Herbert, et al.
Published: (2022-08-01)

Backpropagation With Sparsity Regularization for Spiking Neural Network Learning
by: Yulong Yan, et al.
Published: (2022-04-01)

Understanding the effects of data parallelism and sparsity on neural network training
by: Lee, N, et al.
Published: (2020)

Deep neural networks with dependent weights: Gaussian process mixture limit, heavy tails, sparsity and compressibility
by: Lee, H, et al.
Published: (2023)

Effect of sparsity on network stability in random neural networks obeying Dale's law
by: Isabelle D. Harris, et al.
Published: (2023-11-01)

Sparsity Increases Uncertainty Estimation in Deep Ensemble
by: Uyanga Dorjsembe, et al.
Published: (2021-04-01)

SAUC: Sparsity-Aware Uncertainty Calibration for Spatiotemporal Prediction with Graph Neural Networks
by: Zhuang, Dingyi, et al.
Published: (2024)

Topics in Sparsity and Compression: From High dimensional statistics to Overparametrized Neural Networks
by: Benbaki, Riade
Published: (2023)

Distillation Sparsity Training Algorithm for Accelerating Convolutional Neural Networks in Embedded Systems
by: Penghao Xiao, et al.
Published: (2023-05-01)

Efficient Deep Learning with Sparsity: Algorithms, Systems, and Applications
by: Liu, Zhijian
Published: (2024)

A sparsity preserving genetic algorithm for extracting diverse functional 3D designs from deep generative neural networks
by: James D. Cunningham, et al.
Published: (2020-01-01)

An argument for sparsity
by: Zeitlyn, D
Published: (2023)

Enhancement of Convolutional Neural Network Hardware Accelerators Efficiency Using Sparsity Optimization Framework
by: Hemalatha Kurapati, et al.
Published: (2024-01-01)

Quantization and sparsity-aware processing for energy-efficient NVM-based convolutional neural networks
by: Han Bao, et al.
Published: (2022-08-01)

Deep learning-based method for mobile social networks with strong sparsity for link prediction
by: HE Yadi, et al.
Published: (2024-06-01)

Deep learning-based method for mobile social networks with strong sparsity for link prediction
by: Yadi HE, Linfeng LIU
Published: (2024-06-01)

Techniques for exploiting the sparsity of the Network Admittance matrix /
by: 430132 Sato, Nabuo, et al.

Modeling ideological salience and framing in polarized online groups with graph neural networks and structured sparsity
by: Hofmann, V, et al.
Published: (2022)

A Comparative Study of Sparsity Promoting Techniques in Neural Network for Modeling Non-Linear Dynamics
by: Emil Johannesen Haugstvedt, et al.
Published: (2023-01-01)

Sparsity in an artificial neural network predicts beauty: Towards a model of processing-based aesthetics.
by: Nicolas M Dibot, et al.
Published: (2023-12-01)

Multi-Level Graph Neural Network With Sparsity Pooling for Recognizing Parkinson’s Disease
by: Xiaobo Zhang, et al.
Published: (2023-01-01)

Sparsity-inducing optimal control via differential dynamic programming
by: Dinev, T, et al.
Published: (2021)

Nonparametric Sparsity and Regularization
by: Mosci, Sofia, et al.
Published: (2011)

Nonparametric Sparsity and Regularization
by: Rosasco, Lorenzo Andrea, et al.
Published: (2013)

The applications of sparsity in classification
by: Tuong, Nguyen Xuan.
Published: (2011)

Sparsity-Based Spatial Interpolation in Wireless Sensor Networks
by: Yan Yao, et al.
Published: (2011-02-01)

SparseRT: Accelerating Unstructured Sparsity on GPUs for Deep Learning Inference
by: Wang, Ziheng
Published: (2022)

Dense for the price of sparse: improved performance of sparsely initialized networks via a subspace offset
by: Price, I, et al.
Published: (2021)

Compositional Sparsity of Learnable Functions
by: Poggio, Tomaso, et al.
Published: (2024)

Edge-exchangeable graphs and sparsity
by: Campbell, Trevor David, et al.
Published: (2020)

Representative Selection with Structured Sparsity
by: Wang, Hongxing, et al.
Published: (2017)

Sparsity driven ultrasound imaging.
by: Tuysuzoglu, A, et al.
Published: (2012)

On the sparsity of synthetic control method
by: Qiang Chen, et al.
Published: (2024-12-01)

Intrinsic Sparsity of Kantorovich solutions
by: Hosseini, Bamdad, et al.
Published: (2022-10-01)

An On-Chip Fully Connected Neural Network Training Hardware Accelerator Based on Brain Float Point and Sparsity Awareness
by: Tsung-Han Tsai, et al.
Published: (2023-01-01)

Block-sparsity-aware LMS algorithm for network echo cancellation
by: Wei, Ye, et al.
Published: (2018)