The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
Concept formation in transformer language models is depth-extended, not a single-layer event: concepts emerge gradually across a contiguous region of the residual stream. Mechanistic interpretability methods identify the single layer of peak class separation -- the "best layer" -- capturing a snapshot rather than the process itself. We introduce the Concept Allocation Zone (CAZ): the depth interval within which a concept becomes measurably separable, the region allocated to its geometric express
Record details
Published: 24 May 2026
Source: arXiv
Category: Research
Topics: Safety & alignment · Privacy
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Measuring the Depth of LLM Unlearning via Activation Patching
arXiv · 23 May 2026
Limited Marginal Benefit of Reasoning-Heavy LLM Deployment in ESG Narrative Scoring: A 4-Model Consensus Study on Japanese Listed Firms
arXiv · 22 May 2026
How Far Will They Go? Red-Teaming Online Influence with Large Language Models
arXiv · 20 May 2026
Differentially Private Preference Data Synthesis for Large Language Model Alignment
arXiv · 29 May 2026
Federated Variational Preference Alignment with Gumbel-Softmax Prior for Personalized User Preferences
arXiv · 29 May 2026
Silent Failures in Federated Personalization of Foundation Models
arXiv · 31 May 2026
How to cite this record
ethics.ai (24 May 2026), “The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth,” evidence record 3790, https://ethics.ai/record/3790 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.