AcuityBench: Evaluating Clinical Acuity Identification and Uncertainty Alignment
We introduce AcuityBench, a benchmark for evaluating whether language models identify the appropriate urgency of care from user medical presentations. Existing health benchmarks emphasize medical question answering, broad health interactions, or narrow workflow-specific triage tasks, but they do not offer a unified evaluation of acuity identification across these settings. AcuityBench addresses this gap by harmonizing five public datasets spanning user conversations, online forum posts, clinical
Record details
Published: 12 May 2026
Source: arXiv
Category: Research
Topics: Safety & alignment · Healthcare
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Rethinking external validation for the target population: Capturing patient-level similarity with a generative model
arXiv · 11 May 2026
The Open-Box Fallacy: Why AI Deployment Needs a Calibrated Verification Regime
arXiv · 11 May 2026
Acceptance Cards:A Four-Diagnostic Standard for Safe Fine-Tuning Defense Claims
arXiv · 11 May 2026
ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
arXiv · 11 May 2026
Dimensional Balance Improves Large Scale Spatiotemporal Prediction Performance
arXiv · 11 May 2026
ProtoMedAgent: Multimodal Clinical Interpretability via Privacy-Aware Agentic Workflows
arXiv · 13 May 2026
How to cite this record
ethics.ai (12 May 2026), “AcuityBench: Evaluating Clinical Acuity Identification and Uncertainty Alignment,” evidence record 4517, https://ethics.ai/record/4517 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.