FATE: Frame-Level Audio-Visual Temporal Embedding
When a dog opens its mouth and barks, humans naturally recognize what the sound is and when it occurs. Building audio-visual models with this same ability requires representations that capture both semantic and temporal alignment. Current approaches fall short on one side or the other: embedding models match semantic but lose temporal information; synchronization models capture temporal offsets but lack semantic understanding. To bridge this gap, we propose FATE, Frame-level Audio-visual Tempora
Record details
Published: 1 August 2026
Source: HuggingFace Daily Papers
Category: Research
Topics: Safety & alignment
Retrieved: 11 August 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Experience-Calibrated Contrastive Decoding for Mitigating Hallucinations in LM-Based Text-to-Speech
arXiv cs.LG · 1 August 2026
AI Alignment and Fiduciary Obligation
arXiv alignment query · 1 August 2026
OpenART: Scaling Agent Red Teaming via Open-Ended Environment Evolution
arXiv red teaming query · 1 August 2026
xMICD: Explainable Representation of Multiple ICD Codes
arXiv cs.LG · 2 August 2026
Mind the Gap: Zero-Query Jailbreaks via Filter-Generator Discrepancy in Text-to-Image Systems
arXiv red teaming query · 2 August 2026
Decoy Images Amplify Caption-Mediated Defenses Against Encoded Jailbreaks
arXiv red teaming query · 2 August 2026
How to cite this record
ethics.ai (1 August 2026), “FATE: Frame-Level Audio-Visual Temporal Embedding,” evidence record 17982, https://ethics.ai/record/17982 (originally published by HuggingFace Daily Papers).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.