AI ethics evidence index Search
Source-linked daily record
Evidence record 333 · automatically gathered

Meta-Benchmarks for Financial-Services LLM Evaluation

Public LLM leaderboards optimise for global average performance and do not capture the specific cognitive demands of financial-services work: a model that leads on MMLU-Pro may underperform on document-grounded compliance reasoning, and a coding leader may handle multi-turn customer interactions poorly. We present a meta-benchmarking framework that organises 452 publicly reported benchmarks into 41 O*NET Generalized Work Activities and aggregates those into 38 BIAN banking business domains spann

Record details

Published: 2 July 2026
Source: arXiv
Category: Research
Topics: Regulation · Finance, VC & PE
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

Also mentions Meta · Shared topic: Regulation

Facebook and Instagram have to dismantle these addictive design features, says EU watchdog

Fast Company Tech · 10 July 2026

Also mentions Meta · Shared topic: Finance, VC & PE

Helpfulness Hurts: Domain-Dependent Degradation of Mid-Trained Compassion Values Under Post-Training

arXiv cs.CY · 14 July 2026

Also mentions Meta · Shared topic: Regulation

Efficacy of Various Virtual Reality Exposure Therapies for Chronic Low Back Pain: Systematic Review and Network Meta-Analysis

JMIR (Journal of Medical Internet Research) · 22 July 2026

Also mentions Meta · Shared topic: Regulation

Closed-Loop Validation-Repair for Healthcare Interoperability: A Multi-Model Study of Schema Compliance in Clinical LLMs

arXiv cs.AI · 27 July 2026

Also mentions Meta · Shared topic: Regulation

AMR-SD: Asymmetric Meta-Reflective Self-Distillation for Token-Level Credit Assignment

arXiv · 18 May 2026

Also mentions Meta · Shared topic: Regulation

Algorithmic Constitutionalism

arXiv · 16 May 2026

How to cite this record

ethics.ai (2 July 2026), “Meta-Benchmarks for Financial-Services LLM Evaluation,” evidence record 333, https://ethics.ai/record/333 (originally published by arXiv).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.