Visual Contrastive Self-Distillation
On-policy self-distillation (OPSD) is promising as it removes the external teacher required by on-policy distillation (OPD), yet it still needs asymmetric information between teacher and student to ensure that the self-teacher provides a stronger learning signal than the student. Existing methods create this asymmetry either through privileged answers or visual evidence. We ask whether both can be removed, yielding a simpler form of OPSD driven purely by input conditioning. For this purpose, we
Record details
Published: 23 July 2026
Source: arXiv cs.AI
Category: Research
Topics: Regulation · Children & education
Retrieved: 25 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
X$^3$-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment
arXiv cs.LG · 23 July 2026
Open Veins of Algorithmic Auditing: Why AI Assessment Lags Behind Its Deployment in the Global South
arXiv · 23 July 2026
Exploring the Design Space of LLM-Based Programming Support in CS Education: A Scoping Review through the Lens of Assistance Governance
arXiv cs.HC · 23 July 2026
Did Alice Do Wrong? Cross-Cultural Differences in Student Perceptions of Generative AI Use in University Computing Education
arXiv cs.CY · 23 July 2026
Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization
arXiv · 24 July 2026
Visual Contrastive Self-Distillation
HuggingFace Daily Papers · 22 July 2026
How to cite this record
ethics.ai (23 July 2026), “Visual Contrastive Self-Distillation,” evidence record 13465, https://ethics.ai/record/13465 (originally published by arXiv cs.AI).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.