AI ethics evidence index Search
Source-linked daily record
Evidence record 3641 · automatically gathered

A Policy-Driven Runtime Layer for Agentic LLM Serving

Multi-agent LLM systems have become the dominant production workload, but the serving stack was not built for them. The agent framework above knows agent identities, role, schemas, and dispatch structure but never sees an engine-level event; the serving engine below sees every event but knows nothing about agents. A surprising number of cross-cutting policies depend on both: prefix caching, batch shaping, speculative execution, fairness, tool-result memoization, safety enforcement, and more. Eac

Record details

Published: 26 May 2026
Source: arXiv
Category: Research
Topics: Bias & fairness · Regulation · Agents & autonomy
Retrieved: 14 July 2026

source-onlyevidence status

These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.

Shared topic: Bias & fairness · Shared topic: Regulation

AGORA: Can Deliberation and Governance Gates Absorb Participation Bias in Transit Planning?

arXiv · 31 May 2026

Shared topic: Bias & fairness · Shared topic: Regulation

AgentFairBench: Do LLM Agents Discriminate When They Act?

arXiv · 15 June 2026

Shared topic: Bias & fairness · Shared topic: Regulation

Deterministic Decisions for High-Stakes AI. A Zero-Egress Pipeline with the Deployability of RAG and the Accuracy of Machine Learning

arXiv · 28 June 2026

Shared topic: Bias & fairness · Shared topic: Regulation

First, Do No Harm (With LLMs): Mitigating Racial Bias via Agentic Workflows

arXiv · 20 April 2026

Shared topic: Bias & fairness · Shared topic: Regulation

A pragmatic approach to regulating AI agents

arXiv · 16 April 2026

Shared topic: Bias & fairness · Shared topic: Regulation

AgentFAIR: A Multi-Agent Collaborative Framework for FAIRness Evaluation of Geospatial Datasets

arXiv · 17 July 2026

How to cite this record

ethics.ai (26 May 2026), “A Policy-Driven Runtime Layer for Agentic LLM Serving,” evidence record 3641, https://ethics.ai/record/3641 (originally published by arXiv).

JSON

Use and limitations

This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.