On-Policy Self-Distillation without Any Supervision
On-policy (Self-)Distillation (OPD / OPSD) has shown strong potential for post-training large language models (LLMs). However, existing methods still rely heavily on external supervision, including ground-truth signals, environmental feedback, or guidance from larger models, and therefore fall short of genuine "self"-distillation. In this study, we show that on-policy self-distillation can be achieved using only a model's own generations via internal consistency. We propose unsupervised on-polic
Record details
Published: 8 August 2026
Source: HuggingFace Daily Papers
Category: Research
Topics: Regulation · Environment
Retrieved: 12 August 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Business Arena: Benchmarking LLM Agents in a Realistic Marketplace
HuggingFace Daily Papers · 8 August 2026
OpenLoopEvolve: A Verifiable Self-Evolution Framework for Loop Policies in Long-Horizon Complex Tasks
arXiv · 10 August 2026
Social Media as a Driver of Obesity in Children and Adolescents (Aged 6-18 Years): It Is Time for Regulatory Action
JMIR (Journal of Medical Internet Research) · 10 August 2026
EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
arXiv cs.AI · 6 August 2026
IADD-TR: Intervention-Aware Dynamics Decoupling with Targeted Regularization for Model-Based Reinforcement Learning
arXiv cs.LG · 11 August 2026
EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
HuggingFace Daily Papers · 5 August 2026
How to cite this record
ethics.ai (8 August 2026), “On-Policy Self-Distillation without Any Supervision,” evidence record 18385, https://ethics.ai/record/18385 (originally published by HuggingFace Daily Papers).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.