Toward Human Rights Benchmarking for LLMs: A Pilot Methodology
arXiv:2608.10268v1 Announce Type: cross Abstract: Large language models (LLMs) increasingly mediate legal determinations over what human rights are realized, and how. Yet, no evaluation benchmark exists to assess whether they can reason correctly about human rights law. To this end, we report our efforts to develop a robust and scalable methodology for creating HumRightsBench: the first expert-validated, scenario-based benchmark for evaluating reasoning grounded in the obligation structure of in
Record details
Published: 12 August 2026
Source: arXiv cs.CY
Category: Research
Topics: Regulation
Retrieved: 12 August 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Most biomedical publications show signs of LLM-assisted writing
arXiv cs.CY · 12 August 2026
Policy Convergence and Divergence Across National and Within Regional AI Strategies: A Policy Design Element Analysis
arXiv cs.CY · 12 August 2026
Inferential Capability Does Not Determine Legal Scope
arXiv cs.CY · 12 August 2026
Who Gets Heeded? An Obligation-Level Audit of Responsiveness in EPA Rulemaking
arXiv cs.CY · 12 August 2026
Beyond Memory: A Transactional Continuity Kernel for Long-Lived AI Agents
arXiv · 12 August 2026
When Offline Evaluation Misleads: A Diagnostic Protocol for Reward and Policy Selection in Delayed-Feedback Contextual Bandits
arXiv cs.LG · 12 August 2026
How to cite this record
ethics.ai (12 August 2026), “Toward Human Rights Benchmarking for LLMs: A Pilot Methodology,” evidence record 18362, https://ethics.ai/record/18362 (originally published by arXiv cs.CY).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.