Evidence record 1457 · automatically gathered

Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation

Demand for low-precision inference, including NVFP4-based approaches, has grown as large language models are increasingly deployed in latency and cost constrained production environments. Quantization-aware distillation (QAD) helps recover accuracy lost under low bit quantization by training a quantized student to match the output distribution of a frozen higher precision teacher via a KL-divergence loss. In this work, we first provide a representation level diagnosis of QAD: output matching alo

Record details

Published: 4 June 2026
Source: arXiv
Category: Research
Topics: Healthcare · Children & education · Environment
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

How to cite this record

ethics.ai (4 June 2026), “Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation,” evidence record 1457, https://ethics.ai/record/1457 (originally published by arXiv).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.