Revisiting Orthogonality Regularization: A Study for Convolutional Neural Networks in Image Classification

Revisiting Orthogonality Regularization: A Study for Convolutional Neural Networks in Image Classification

Recent research in deep Convolutional Neural Networks(CNN) faces the challenges of vanishing/exploding gradient issues, training instability, and feature redundancy. Orthogonality Regularization(OR), which introduces a penalty function considering the orthogonality of neural networks, could be a rem...

Full description

Bibliographic Details
Main Authors:	Taehyeon Kim, Se-Young Yun
Format:	Article
Language:	English
Published:	IEEE 2022-01-01
Series:	IEEE Access
Subjects:	Deep neural network (DNN) kernel orthogonality regularization convolutional neural network (CNN) regularization image classification
Online Access:	https://ieeexplore.ieee.org/document/9804718/

Similar Items

FocusedDropout for Convolutional Neural Network
by: Minghui Liu, et al.
Published: (2022-07-01)

Structured Pruning of Convolutional Neural Networks via L1 Regularization
by: Chen Yang, et al.
Published: (2019-01-01)

Convolutional Neural Network-Based Natural Image and MRI Classification Using Gaussian Activated Parametric (GAP) Layer
by: Bijen Khagi, et al.
Published: (2021-01-01)

Feature Mining: A Novel Training Strategy for Convolutional Neural Network
by: Tianshu Xie, et al.
Published: (2022-03-01)

Regularized CNN Feature Hierarchy for Hyperspectral Image Classification
by: Muhammad Ahmad, et al.
Published: (2021-06-01)

Bridgeout: Stochastic Bridge Regularization for Deep Neural Networks
by: Najeeb Khan, et al.
Published: (2018-01-01)

Frequency Regularization: Reducing Information Redundancy in Convolutional Neural Networks
by: Chenqiu Zhao, et al.
Published: (2023-01-01)

Learning Sparse Convolutional Neural Network via Quantization With Low Rank Regularization
by: Xin Long, et al.
Published: (2019-01-01)

Deep Convolutional Neural Network Regularization for Alcoholism Detection Using EEG Signals
by: Hamid Mukhtar, et al.
Published: (2021-08-01)

Nhận dạng tiếng nói điều khiển với convolutional neural network (CNN)
by: Thái Thuận Thương
Published: (2021-08-01)

Evidence-Based Regularization for Neural Networks
by: Giuseppe Nuti, et al.
Published: (2022-11-01)

An effective classifier based on convolutional neural network and regularized extreme learning machine
by: Chunmei He, et al.
Published: (2019-09-01)

Pruning Convolutional Filters Using Batch Bridgeout
by: Najeeb Khan, et al.
Published: (2020-01-01)

EEG-based identification system using deep neural networks with frequency features
by: Yasaman Akbarnia, et al.
Published: (2024-02-01)

A New Convolutional Kernel Classifier for Hyperspectral Image Classification
by: Mohsen Ansari, et al.
Published: (2021-01-01)

An Entropy Metric for Regular Grammar Classification and Learning with Recurrent Neural Networks
by: Kaixuan Zhang, et al.
Published: (2021-01-01)

Digging for gold: evaluating the authenticity of saffron (Crocus sativus L.) via deep learning optimization
by: Ahmed Elaraby, et al.
Published: (2023-09-01)

Regional Patch-Based Feature Interpolation Method for Effective Regularization
by: Soojin Jang, et al.
Published: (2020-01-01)

Improving Image-Based Plant Disease Classification With Generative Adversarial Network Under Limited Training Set
by: Luning Bi, et al.
Published: (2020-12-01)

Neural Networks Regularization With Graph-Based Local Resampling
by: Alex D. Assis, et al.
Published: (2021-01-01)

Implications of Pooling Strategies in Convolutional Neural Networks: A Deep Insight
by: Sharma Shallu, et al.
Published: (2019-09-01)

CNNSplice: Robust models for splice site prediction using convolutional neural networks
by: Victor Akpokiro, et al.
Published: (2023-01-01)

On two recent nonconvex penalties for regularization in machine learning
by: Sujit Vettam, et al.
Published: (2022-05-01)

Orthogonal Features Extraction Method and Its Application in Convolution Neural Network
by: LI Chen, LI Jianxun
Published: (2021-10-01)

Hyperspectral Remote Sensing Image Classification Using Deep Convolutional Capsule Network
by: Runmin Lei, et al.
Published: (2021-01-01)

Multiscale Adaptive Convolution for Hyperspectral Image Classification
by: Qi Ren, et al.
Published: (2022-01-01)

Hyperspectral Image Classification Promotion Using Dynamic Convolution Based on Structural Re-Parameterization
by: Chen Ding, et al.
Published: (2023-11-01)

Enhanced Convolutional-Neural-Network Architecture for Crop Classification
by: Mónica Y. Moreno-Revelo, et al.
Published: (2021-05-01)

Brain serotonergic fibers suggest anomalous diffusion-based dropout in artificial neural networks
by: Christian Lee, et al.
Published: (2022-10-01)

The Optimization of Transfer Learning Convolutional Neural Network Model with PCA and t-SNE Algorithms for Classification and Recognition of CIFAR-10 Image
by: Rastri Prathivi
Published: (2020-08-01)

Digital Hologram Watermarking Based on Multiple Deep Neural Networks Training Reconstruction and Attack
by: Ji-Won Kang, et al.
Published: (2021-07-01)

Regularized Chained Deep Neural Network Classifier for Multiple Annotators
by: Julián Gil-González, et al.
Published: (2021-06-01)

Synergistic 2D/3D Convolutional Neural Network for Hyperspectral Image Classification
by: Xiaofei Yang, et al.
Published: (2020-06-01)

Smooth Group <i>L</i><sub>1/2</sub> Regularization for Pruning Convolutional Neural Networks
by: Yuan Bao, et al.
Published: (2022-01-01)

Empirical Evaluation of the Effect of Optimization and Regularization Techniques on the Generalization Performance of Deep Convolutional Neural Network
by: Ivana Marin, et al.
Published: (2020-11-01)

A Spectral Feature Based Convolutional Neural Network for Classification of Sea Surface Oil Spill
by: Bingxin Liu, et al.
Published: (2019-03-01)

Deep Learning Based on Fourier Convolutional Neural Network Incorporating Random Kernels
by: Yuna Han, et al.
Published: (2021-08-01)

Rotation Invariance Regularization for Remote Sensing Image Scene Classification with Convolutional Neural Networks
by: Kunlun Qi, et al.
Published: (2021-02-01)

SFFNet: Staged Feature Fusion Network of Connecting Convolutional Neural Networks and Graph Convolutional Neural Networks for Hyperspectral Image Classification
by: Hao Li, et al.
Published: (2024-03-01)

Spatial-Spectral Graph Regularized Kernel Sparse Representation for Hyperspectral Image Classification
by: Jianjun Liu, et al.
Published: (2017-08-01)