Constitutional Midtraining: Content Presence Drives Alignment Gains
arXiv:2607.26654v1 Announce Type: cross Abstract: Post-training alignment is often shallow, eroding under fine-tuning. Whether midtraining interventions, cleanly isolated from post-training, can produce durable alignment remains untested. We test this via constitutional midtraining: inserting principled, values-based content into midtraining against a replay-only control at 120B scale. Our 394M-token constitutional corpus, built from Anthropic's Constitution, uses a 2x2 factorial design (curricu
Record details
Published: 30 July 2026
Source: arXiv cs.CY
Category: Research
Topics: Safety & alignment
Retrieved: 30 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Constitutional Midtraining: Content Presence Drives Alignment Gains
arXiv · 29 July 2026
Geopolitical alignment: Endorsement effects in large language models
arXiv · 10 July 2026
A systematic review of toxicity in large language models: definitions, datasets, detectors, detoxification methods and challenges
Artificial Intelligence Review · 2 July 2026
MultiTurnPSB: Evaluating Multi-Turn Jailbreak Attacks an dClassifier-Based Defenses for Medical AI Safety
arXiv · 30 May 2026
How Well Do Models Follow Their Constitutions?
arXiv · 22 May 2026
Can AI Make Conflicts Worse? An Alignment Failure in LLM Deployment Across Conflict Contexts
arXiv · 21 May 2026
How to cite this record
ethics.ai (30 July 2026), “Constitutional Midtraining: Content Presence Drives Alignment Gains,” evidence record 14522, https://ethics.ai/record/14522 (originally published by arXiv cs.CY).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.