BiasGRPO: Stabilizing Bias Mitigation in High-Variance Reward Landscapes via Group-Relative Policy Optimization
Mitigating social bias in Large Language Models (LLMs) presents a distinct alignment challenge: unlike verifiable tasks, bias lacks a single ground truth, creating a high-variance, subjective reward landscape. Previous preference-based fine-tuning methods have major trade-offs: Direct Preference Optimization (DPO) is limited by the lack of exploration inherent in offline training, while Proximal Policy Optimization (PPO) can lead to training instability due to potentially unreliable critic estim
Record details
Published: 3 June 2026
Source: arXiv
Category: Research
Topics: Bias & fairness · Regulation · Safety & alignment
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Silent Failures in Federated Personalization of Foundation Models
arXiv · 31 May 2026
LC-ERD: Mining Latent Logic for Self-Evolving Reasoning via Consistency-Regulated Reward Decomposition
arXiv · 19 May 2026
Revisiting Reinforcement Learning with Verifiable Rewards from a Contrastive Perspective
arXiv · 13 May 2026
OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models
arXiv · 25 April 2026
Inference-Time Policy Alignment for Fair Reinforcement Learning
arXiv fairness query · 31 July 2026
Prompt Programming for Cultural Bias and Alignment of Large Language Models
arXiv · 17 March 2026
How to cite this record
ethics.ai (3 June 2026), “BiasGRPO: Stabilizing Bias Mitigation in High-Variance Reward Landscapes via Group-Relative Policy Optimization,” evidence record 1496, https://ethics.ai/record/1496 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.