SafeSteer: Localized On-Policy Distillation for Efficient Safety Alignment
Aligning Large Language Models (LLMs) with human values often degrades their general capabilities, termed the alignment tax. Existing methods mitigate this by balancing dual objectives, which heavily rely on massive general-purpose data or auxiliary reward models. In this paper, we argue that, because safety features are inherently sparse within the output distribution, alignment requires localized modifications rather than global trade-offs. To this end, we propose SafeSteer, which performs on-
Record details
Published: 1 June 2026
Source: arXiv
Category: Research
Topics: Regulation · Safety & alignment
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Constitutional On-Policy Safe Distillation
arXiv · 2 June 2026
Beyond Static Priors: Dynamic Neural Guidance for Large-Scale Ant Colony Optimization
arXiv · 2 June 2026
AlignAtt4LLM: Fast AlignAtt for Decoder-Only LLMs at IWSLT 2026 Simultaneous Speech Translation Task
arXiv · 2 June 2026
Silent Failures in Federated Personalization of Foundation Models
arXiv · 31 May 2026
BiasGRPO: Stabilizing Bias Mitigation in High-Variance Reward Landscapes via Group-Relative Policy Optimization
arXiv · 3 June 2026
Prompts for Public-Sector LLMs Should Be Governed as Commons
arXiv · 30 May 2026
How to cite this record
ethics.ai (1 June 2026), “SafeSteer: Localized On-Policy Distillation for Efficient Safety Alignment,” evidence record 3279, https://ethics.ai/record/3279 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.