A Scoping Review of LLM-as-a-Judge in Healthcare and the MedJUDGE Framework
As large language models (LLMs) increasingly generate and process clinical text, scalable evaluation has become critical. LLM-as-a-Judge (LaaJ), which uses LLMs to evaluate model outputs, offers a scalable alternative to costly expert review, but its healthcare adoption raises safety and bias concerns. We conducted a PRISMA-ScR scoping review of six databases (January 2020-January 2026), screening 11,727 studies and including 49. The landscape was dominated by evaluation and benchmarking applica
Record details
Published: 3 April 2026
Source: arXiv
Category: Research
Topics: Bias & fairness · Healthcare
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Fairboard: a quantitative framework for equity assessment of healthcare models
arXiv · 30 March 2026
Evaluating Intersectional Fairness across Clinical Machine Learning Use Cases using Fairlogue and the All of Us Research Program
arXiv · 7 April 2026
CAFP: A Post-Processing Framework for Group Fairness via Counterfactual Model Averaging
arXiv · 8 April 2026
PriHA: A RAG-Enhanced LLM Framework for Primary Healthcare Assistant in Hong Kong
arXiv · 10 April 2026
FairLLaVA: Fairness-Aware Parameter-Efficient Fine-Tuning for Large Vision-Language Assistants
arXiv · 27 March 2026
Explainable Speech Emotion Recognition: Weighted Attribute Fairness to Model Demographic Contributions to Social Bias
arXiv · 26 March 2026
How to cite this record
ethics.ai (3 April 2026), “A Scoping Review of LLM-as-a-Judge in Healthcare and the MedJUDGE Framework,” evidence record 6391, https://ethics.ai/record/6391 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.