On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD
One crucial factor behind the success of deep learning lies in the implicit bias induced by noise inherent in gradient-based training algorithms. Motivated by empirical observations that training with noisy labels improves model generalization, we delve into the underlying mechanisms behind stochastic gradient descent (SGD) with label noise. Focusing on a two-layer over-parameterized linear network, we analyze the learning dynamics of label noise SGD, unveiling a two-phase learning behavior. In
Record details
Published: 11 March 2026
Source: arXiv
Category: Research
Topics: Bias & fairness
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detection
arXiv · 11 March 2026
Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck
arXiv · 11 March 2026
The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training
arXiv · 11 March 2026
Does Reasoning Make Search More Fair? Comparing Fairness in Reasoning and Non-Reasoning Rerankers
arXiv · 11 March 2026
The Algorithmic Blind Spot: Bias, Moral Status, and the Future of Robot Rights
arXiv · 10 March 2026
Procedural Fairness via Group Counterfactual Explanation
arXiv · 11 March 2026
How to cite this record
ethics.ai (11 March 2026), “On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD,” evidence record 7397, https://ethics.ai/record/7397 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.