Stochastic gradient descent with random label noises: doubly stochastic models and inference stabilizer

Stochastic gradient descent with random label noises: doubly stochastic models and inference stabilizer

Random label noise (or observational noise) widely exists in practical machine learning settings. While previous studies primarily focused on the effects of label noise to the performance of learning, our work intends to investigate the implicit regularization effects of label noise, under mini-batc...

Full description

Bibliographic Details
Main Authors:	Haoyi Xiong, Xuhong Li, Boyang Yu, Dongrui Wu, Zhanxing Zhu, Dejing Dou
Format:	Article
Language:	English
Published:	IOP Publishing 2024-01-01
Series:	Machine Learning: Science and Technology
Subjects:	stochastic gradient descent continuous-time analysis dynamical systems
Online Access:	https://doi.org/10.1088/2632-2153/ad13ba

Similar Items

Counterexamples for Noise Models of Stochastic Gradients
by: Vivak Patel
Published: (2023-12-01)

Recent Advances in Stochastic Gradient Descent in Deep Learning
by: Yingjie Tian, et al.
Published: (2023-01-01)

Damped Newton Stochastic Gradient Descent Method for Neural Networks Training
by: Jingcheng Zhou, et al.
Published: (2021-06-01)

A Geometric Interpretation of Stochastic Gradient Descent Using Diffusion Metrics
by: Rita Fioresi, et al.
Published: (2020-01-01)

Distributed Stochastic Gradient Descent With Compressed and Skipped Communication
by: Tran Thi Phuong, et al.
Published: (2023-01-01)

Pipelined Stochastic Gradient Descent with Taylor Expansion
by: Bongwon Jang, et al.
Published: (2023-10-01)

Modified‎ ‎Step‎ ‎Size‎ ‎for‎ ‎Enhanced‎ ‎Stochastic Gradient Descent‎: ‎Convergence and Experiments
by: Mahsa Soheil shamaee, et al.
Published: (2024-09-01)

A Novel Sine Step Size for Warm-Restart Stochastic Gradient Descent
by: Mahsa Soheil Shamaee, et al.
Published: (2024-12-01)

Adaptive Gradient Estimation Stochastic Parallel Gradient Descent Algorithm for Laser Beam Cleanup
by: Shiqing Ma, et al.
Published: (2021-05-01)

Stochastic Gradient Descent for Kernel-Based Maximum Correntropy Criterion
by: Tiankai Li, et al.
Published: (2024-12-01)

The Improved Stochastic Fractional Order Gradient Descent Algorithm
by: Yang Yang, et al.
Published: (2023-08-01)

Public Security Video Surveillance Image Restoration Based on Stochastic Gradient Descent Algorithm
by: Yuxiao MENG, et al.
Published: (2022-11-01)

Adaptive Stochastic Gradient Descent Method for Convex and Non-Convex Optimization
by: Ruijuan Chen, et al.
Published: (2022-11-01)

Estimation of simultaneous equation models by backpropagation method using stochastic gradient descent
by: Belén Pérez-Sánchez, et al.
Published: (2024-10-01)

Adaptive Stochastic Conjugate Gradient Optimization for Backpropagation Neural Networks
by: Ibrahim Abaker Targio Hashem, et al.
Published: (2024-01-01)

Stochastic gradient descent algorithm preserving differential privacy in MapReduce framework
by: Yihan YU, et al.
Published: (2018-01-01)

Stochastic gradient descent algorithm preserving differential privacy in MapReduce framework
by: Yihan YU, et al.
Published: (2018-01-01)

Stochastic resetting mitigates latent gradient bias of SGD from label noise
by: Youngkyoung Bae, et al.
Published: (2025-01-01)

Mutual Information Based Learning Rate Decay for Stochastic Gradient Descent Training of Deep Neural Networks
by: Shrihari Vasudevan
Published: (2020-05-01)

Belief-Rule-Base Inference Method Based on Gradient Descent With Momentum
by: Yu Guan, et al.
Published: (2021-01-01)

Adaptive Human–Machine Evaluation Framework Using Stochastic Gradient Descent-Based Reinforcement Learning for Dynamic Competing Network
by: Jinbae Kim, et al.
Published: (2020-04-01)

Forest fire risk assessment model optimized by stochastic average gradient descent
by: Zexin Fu, et al.
Published: (2025-01-01)

aSGD: Stochastic Gradient Descent with Adaptive Batch Size for Every Parameter
by: Haoze Shi, et al.
Published: (2022-03-01)

Performance Evaluation of Gradient Descent Optimizers in Estuarine Turbidity Estimation with Multilayer Perceptron and Sentinel-2 Imagery
by: Naledzani Ndou, et al.
Published: (2024-10-01)

Fractional Stochastic Search Algorithms: Modelling Complex Systems via AI
by: Bodo Herzog
Published: (2023-04-01)

Semi-Stochastic Gradient Descent Methods
by: Jakub Konečný, et al.
Published: (2017-05-01)

Beyond Stochastic Gradient Descent for Matrix Completion Based Indoor Localization
by: Wafa Njima, et al.
Published: (2019-06-01)

GIS-Based Comparative Study of the Bayesian Network, Decision Table, Radial Basis Function Network and Stochastic Gradient Descent for the Spatial Prediction of Landslide Susceptibility
by: Junpeng Huang, et al.
Published: (2022-03-01)

Gradient Descent Batch Clustering for Image Classification
by: Jae-Sam Park
Published: (2023-07-01)

A Novel Framework for Abnormal Risk Classification over Fetal Nuchal Translucency Using Adaptive Stochastic Gradient Descent Algorithm
by: Deepti Verma, et al.
Published: (2022-10-01)

On the Convergence of Stochastic Process Convergence Proofs
by: Borja Sánchez-López, et al.
Published: (2021-06-01)

Fed-DeepONet: Stochastic Gradient-Based Federated Training of Deep Operator Networks
by: Christian Moya, et al.
Published: (2022-09-01)

Function approximation method based on weights gradient descent in reinforcement learning
by: Xiaoyan QIN, et al.
Published: (2023-08-01)

Function approximation method based on weights gradient descent in reinforcement learning
by: Xiaoyan QIN, Yuhan LIU, Yunlong XU, Bin LI
Published: (2023-08-01)

A Static Security Region Analysis of New Power Systems Based on Improved Stochastic–Batch Gradient Pile Descent
by: Jiahui Wu, et al.
Published: (2024-04-01)

Phase Optimized Computer-Generated Holographic Video Calculation With Frame Interpolation Using Gradient Descent Algorithm
by: Gyeongsu Jin, et al.
Published: (2024-01-01)

Enhanced Support Vector Machine Methods Using Stochastic Gradient Descent and Its Application to Heart Disease Dataset
by: Ghadeer Mahdi, et al.
Published: (2024-01-01)

A Scalable Bayesian Sampling Method Based on Stochastic Gradient Descent Isotropization
by: Giulio Franzese, et al.
Published: (2021-10-01)

H2O-Based Stochastic Gradient Descent Grid Search Using Ridge Regression Techniques for Traffic Flow Forecasting
by: Rajalakshmi Gurusamy, et al.
Published: (2024-05-01)

Multi-Depth Computer-Generated Hologram Based on Stochastic Gradient Descent Algorithm with Weighted Complex Loss Function and Masked Diffraction
by: Jiale Quan, et al.
Published: (2023-03-01)