AI ethics evidence index Search
Source-linked daily record
Evidence record 4611 · automatically gathered

MedMeta: A Benchmark for LLMs in Synthesizing Meta-Analysis Conclusion from Medical Studies

Large language models (LLMs) have saturated standard medical benchmarks that test factual recall, yet their ability to perform higher-order reasoning, such as synthesizing evidence from multiple sources, remains critically under-explored. To address this gap, we introduce MedMeta, the first benchmark designed to evaluate an LLM's ability to generate conclusions from medical meta-analyses using only the abstracts of cited studies. MedMeta comprises 81 meta-analyses from PubMed (2018--2025) and ev

Record details

Published: 10 May 2026
Source: arXiv
Category: Research
Topics: Healthcare
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

Also mentions Meta · Shared topic: Healthcare

Eligibility-Aware Evidence Synthesis: An Agentic Framework for Clinical Trial Meta-Analysis

arXiv · 3 April 2026

Also mentions Meta · Shared topic: Healthcare

Artificial Intelligence for Evidence Synthesis of Emerging Biologics to Improve Skeletal Health in Osteogenesis Imperfecta: Systematic Review and Meta-Analysis

JMIR (Journal of Medical Internet Research) · 10 July 2026

Also mentions Meta · Shared topic: Healthcare

The Relation Between eHealth Literacy and Online Health Information–Seeking Behavior: Systematic Review and Meta-Analysis

JMIR (Journal of Medical Internet Research) · 15 July 2026

Also mentions Meta · Shared topic: Healthcare

Efficacy of Various Virtual Reality Exposure Therapies for Chronic Low Back Pain: Systematic Review and Network Meta-Analysis

JMIR (Journal of Medical Internet Research) · 22 July 2026

Also mentions Meta · Shared topic: Healthcare

Guiding Language Models to Be More Empathetic: Culturally Sensitive Mental Health Advice Generation Through Human-LLM Collaboration

arXiv cs.CL (ethics-relevant NLP) · 26 July 2026

Also mentions Meta · Shared topic: Healthcare

Closed-Loop Validation-Repair for Healthcare Interoperability: A Multi-Model Study of Schema Compliance in Clinical LLMs

arXiv cs.AI · 27 July 2026

How to cite this record

ethics.ai (10 May 2026), “MedMeta: A Benchmark for LLMs in Synthesizing Meta-Analysis Conclusion from Medical Studies,” evidence record 4611, https://ethics.ai/record/4611 (originally published by arXiv).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.