Evidence record 3790 · automatically gathered

The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth

Concept formation in transformer language models is depth-extended, not a single-layer event: concepts emerge gradually across a contiguous region of the residual stream. Mechanistic interpretability methods identify the single layer of peak class separation -- the "best layer" -- capturing a snapshot rather than the process itself. We introduce the Concept Allocation Zone (CAZ): the depth interval within which a concept becomes measurably separable, the region allocated to its geometric express

Record details

Published: 24 May 2026
Source: arXiv
Category: Research
Topics: Safety & alignment · Privacy
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

How to cite this record

ethics.ai (24 May 2026), “The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth,” evidence record 3790, https://ethics.ai/record/3790 (originally published by arXiv).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.