SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models
The post-training pipeline for diffusion models currently has two stages: supervised fine-tuning (SFT) on curated data and reinforcement learning (RL) with reward models. A fundamental gap separates them. SFT optimizes the denoiser only on ground-truth states sampled from the forward noising process; once inference deviates from these ideal states, subsequent denoising relies on out-of-distribution generalization rather than learned correction, exhibiting the same exposure bias that afflicts aut
Record details
Published: 14 April 2026
Source: arXiv
Category: Research
Topics: Bias & fairness · Safety & alignment
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural Alignment
arXiv · 14 April 2026
Retrieval-Augmented Generation Must Move Beyond Factual Grounding to Represent Diverse Opinions
arXiv · 13 April 2026
LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety
arXiv · 13 April 2026
Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations
arXiv · 13 April 2026
A Multi-Domain Red Teaming Framework for Safety, Robustness, and Fairness Evaluation of Medical Large Language Models
arXiv · 15 April 2026
Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance
arXiv · 12 April 2026
How to cite this record
ethics.ai (14 April 2026), “SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models,” evidence record 5873, https://ethics.ai/record/5873 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.