23:21 UTC
Topic · updated daily · RSS feed for this topic

Bias & fairness

Daily tracker of AI bias and algorithmic fairness: documented discrimination cases, new fairness research, audits and the law catching up.

Identifying Implicit Bias in LLM-based Chat AI Toward People with Intellectual Disabilities

arXiv:2607.26062v1 Announce Type: new Abstract: Background: This work investigates the presence of implicit bias in Large Language Model (LLM)-based chat AI models directed toward people with intellectual disabilities (ID). Objective: The study aims to identify and measure representational differences related to people with ID and examine them to identify implicit biases inherent in AI chat generation technologies. Methods: Utilizing the GPT-4-Turbo model, we requested story-generation based on
arXiv cs.CY 19h ago Research Bias & fairnessFinance, VC & PE

Optimal Causal Annotations: An Application to Casenotes in Social Services

arXiv:2502.10605v4 Announce Type: replace-cross Abstract: Problem definition: Estimating causal effects of interventions is central to policy and operations, but outcome data are often missing or costly to obtain. LLMs can provide text annotation at scale but may be subject to unknown bias. When ground-truth outcomes require expensive expert labeling or follow-up, budget limits typically allow only a fraction of the data to be labeled. Motivated by collaboration with a nonprofit conducting stree
arXiv cs.CY 19h ago Research Bias & fairnessRegulation

The CXMT shock: how China’s viable alternatives punch Nvidia, Micron, SK Hynix shares

China’s increasing clout in the global semiconductor supply chain is accelerating the unravelling of the artificial-intelligence trade, as expectations grow that the Asian nation will challenge foreign tech juggernauts by supplying the world with cheaper alternative products. The US$9.8 billion stock offering of ChangXin Memory Technologies (CXMT) in Shanghai provided the Chinese maker of dynamic random access memory (DRAM) chips with equity funding to finance its expansion of market share home.
SCMP Tech (HK/CN) yesterday News Bias & fairness

Confirmed: Providence Equity taking full control of THE•TEAM, buying out founder Casey Wasserman

The private equity firm, already THE•TEAM's majority investor, will make an additional investment to fund the buyout. Source
Music Business Worldwide (AI) yesterday News Bias & fairnessFinance, VC & PE

ServerlessT2I: Efficient Text-to-Image Workflow Serving on a Serverless Platform

Text-to-image (T2I) workflows are increasingly deployed on serverless platforms because users often compose customized workflows and invoke them intermittently. Existing platforms typically deploy each workflow as an opaque GPU function, provisioning, placing, and scaling all constituent models in the workflow together. This monolithic design obscures workflow structure, inflates scaling overhead, forces users to manage low-level GPU coordination, and limits fine-grained fairness in multi-tenant
arXiv yesterday Research Bias & fairness

Parameterized Fair Resource Allocation under Diversity Constraints

Resource allocation across multiple agent groups arises in many applications including e-commerce recommendation systems, housing assignment, and course allocation, and is commonly formulated as an optimization problem with diversity constraints to ensure group fairness. Existing approaches typically enforce these constraints as hard conditions, which overly restrict the feasible solution space and often lead to suboptimal allocations. In this paper, we propose PRA, a parameterized framework for
arXiv fairness query yesterday Research Bias & fairnessAgents & autonomy

Navigating the DEIverse: A comprehensive review and research agenda on diversity, equity, and inclusion in the metaverse

Publication date: September 2026 Source: Technology in Society, Volume 88 Author(s): Paloma Almodóvar, Alberto Ferraris
Technology in Society yesterday Research Bias & fairness

AI tool will lead to more child refugees being treated as adults, charity warns

‘Racist bias’ overestimating ages in Home Office’s facial-recognition software will lead to solo children being housed with adults, says Human Rights Network Flawed and racialised models that underpin the AI-powered age-detection systems to be introduced by the British government will endanger children, rights groups and children’s charities have warned. Urging ministers to reverse plans to introduce facial age-estimation technology to screen migrants, critics have warned that black children arr
The Guardian yesterday News Bias & fairnessChildren & education

The Disruptive Impact of Large Language Models on Capture the Flag Competitions and the Path Toward Fair Play

arXiv:2607.25425v1 Announce Type: cross Abstract: Capture the Flag (CTF) competitions are among cybersecurity's most effective training grounds, developing practical skill across cryptography, web exploitation, and binary exploitation. Large language models (LLMs) can now solve a growing share of challenges with minimal human input, raising urgent questions about fairness, the validity of rankings, and whether participation still delivers the learning that justifies the effort. This paper report
arXiv cs.CY yesterday Research Bias & fairness

Fairness Is Not Enough: Auditing Competence and Intersectional Bias in AI-powered Resume Screening

arXiv:2507.11548v3 Announce Type: replace Abstract: The use of publicly available generative AI systems for resume evaluation is often justified by the assumption that these tools reduce bias relative to human judgment. However, this framing leaves a prior question unresolved: whether these systems are capable of performing the evaluative task at all. This study presents a two-part audit of eight widely used AI platforms used for resume screening. Drawing on the concept of the Illusion of Neutra
arXiv cs.CY yesterday Research Bias & fairnessTransparency

Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLM

arXiv:2508.05775v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have revolutionized content creation across digital platforms, offering unprecedented capabilities in natural language generation and understanding. Meanwhile, they pose risks by inadvertently producing toxic, offensive, or biased content. This dual role of LLMs, both as powerful tools for text generation and as potential sources of harmful language, presents a pressing sociotechnical challenge. In this survey
arXiv cs.CY yesterday Research Bias & fairness

Casey Wasserman Says “I Leave With Pride” as He Sells Stake In The Team to Providence Equity

The mogul had kickstarted an auction for his namesake company after facing an artist rebellion.
Hollywood Reporter (AI/entertainment) yesterday News Bias & fairness

Learning faults in time: sequential behavioural modelling for complex fault detection in multi-robot systems

Reliable fault detection in multi-robot systems requires models capable of capturing complex, time-dependent fault signatures that manifest over extended temporal horizons rather than instantaneous observations alone. Existing data-driven approaches operate reactively on behavioural snapshots, failing to capture fault modes whose discriminative signature depends on temporally ordered precursors. This work formalises a theoretical impossibility result demonstrating that memoryless classifiers are
Frontiers in Robotics and AI yesterday Research Bias & fairnessAgents & autonomy

Quotient Dynamics, Effective Curvature, and Implicit Bias in Positive Quadratic Networks

Positive quadratic networks admit the low-rank representation f_U(x)=x^top UU^top x, where Uinmathbb{R}^{dtimes r} is identifiable only up to right orthogonal multiplication, representing a rank-r PSD matrix Q=UU^top. We study how this quotient structure governs training dynamics, curvature, recovery, and interpolation bias. On the full-column-rank stratum, we identify mathbb{R}^{dtimes r}_*/O(r) with the rank-r PSD manifold. For smooth objectives L(U)=ell(UU^top), the Euclidean factor gradient
arXiv 2d ago Research Bias & fairness

The Disruptive Impact of Large Language Models on Capture the Flag Competitions and the Path Toward Fair Play

Capture the Flag (CTF) competitions are among cybersecurity's most effective training grounds, developing practical skill across cryptography, web exploitation, and binary exploitation. Large language models (LLMs) can now solve a growing share of challenges with minimal human input, raising urgent questions about fairness, the validity of rankings, and whether participation still delivers the learning that justifies the effort. This paper reports a mixed-methods study of LLM impact on modern CT
arXiv 2d ago Research Bias & fairness

Inspect India Evals: An Open Benchmarking Framework for Evaluating Large Language Models in the Indian Linguistic and Cultural Context

India is a vast nation of over 1.4 billion people, varied by hundreds of diverse and locally specific traditions and cultures and 22 officially recognized languages. Large language models (LLMs) are now being deployed on a massive scale throughout the mainland as well as in remote villages. However, the common benchmarks - MMLU, BIG-Bench, and TruthfulQA are almost exclusively English- and Western-centric. They do not identify those safety, fairness, and accuracy failures unique to the Indian co
arXiv red teaming query 2d ago Research Bias & fairness

Is a private equity megadeal brewing?

One of the premier private lenders on Wall Street has held talks to acquire one of the oldest and most profitable private equity firms
Financial Times Technology (headlines) 2d ago News Bias & fairnessFinance, VC & PE

Private Again: AI Agents Restore Anonymity---Foreclosing Discrimination and Its Proof

arXiv:2607.23539v1 Announce Type: new Abstract: AI agents can transact online on behalf of a human principal---browsing, paying, receiving, and reviewing---without linking a transaction to a principal. That architecture starves algorithmic discrimination of its inputs---identity, purchase history, location history, behavioral traces, and demographic proxies---but also forecloses its proof. Disparate-treatment needs comparators; disparate-impact needs protected-class baselines; and Iqbal-era plea
arXiv cs.CY 2d ago Research Bias & fairnessAgents & autonomy

A Computational Ethical Framework for Financial Digital Phenotyping for Mental Health

arXiv:2607.24275v1 Announce Type: cross Abstract: Ethical governance of AI-driven systems is often expressed through high-level principles and static documentation, creating a gap between regulatory requirements and system-level verification. This challenge is particularly acute in digital phenotyping, where continuous behavioural data raises concerns around consent, privacy, and fairness. In this paper, we propose a computational ethical framework for AI-driven digital phenotyping system in whi
arXiv cs.CY 2d ago Research Bias & fairnessRegulation

Fairness Interventions in Classification: A Study on AI Explainability

arXiv:2407.14766v4 Announce Type: replace-cross Abstract: This paper presents a philosophical and experimental study of fairness interventions in AI classification, centered on the explainability and transparency of corrective methods, and on the opposition between two fairness criteria, namely Demographic Parity and Equalized Odds. Our main argument is that even as a gap in Demographic Parity is used to diagnose inequality between groups, Equalized Odds constitutes a more reliable fairness crit
arXiv cs.CY 2d ago Research Bias & fairnessHealthcare

Decision-Level Hijacking: Injecting Cognitive Bias into Large Language Models via Bit-Flip Attacks

Large Language Models (LLMs) have been widely applied in high-stakes decision-making scenarios such as corporate strategy, and users are increasingly relying on their outputs. However, the deep integration of open-source model sharing ecosystems with LLM-powered critical decision-making applications also introduces critical risks: if an attacker can manipulate the model's cognitive stance, they can indirectly influence the judgments and actions of downstream decision-makers. This paper defines s
arXiv cs.LG 2d ago Research Bias & fairness

Moralizing metrics: Discourses of data and equity in California's public health response to COVID-19

Big Data & Society, Volume 13, Issue 3, July-September 2026. The COVID-19 pandemic witnessed the transformation of data from a public health resource into a measure of morality. Disadvantage indices such as the Healthy Places Index and other metrics became central to promoting equity in the pandemic response, ...
Big Data & Society 2d ago Research Bias & fairnessHealthcare

Beyond the Post Hoc User Study: Modeling Visual Decision-Making with Active Inference

Empirical user studies are essential for evaluating visual encodings and can reveal perceptual and cognitive mechanisms, but they do not by themselves provide causal, predictive accounts of interpretation errors. Evaluations are therefore often post hoc: they measure performance after a design has been specified rather than predicting how attention, uncertainty, memory, and bias may produce accurate or erroneous judgments. To address this mechanistic gap, we translate a cognitive theory of visua
arXiv cs.HC 3d ago Research Bias & fairness

Leading AI models (even Grok) are all a bunch of leftist punks

AI seems to have a liberal bias
The Register 3d ago News Bias & fairness

Orange is building a €3bn French data centre business, funded from New Zealand

Orange and Morrison announced an exclusivity agreement on Monday to create a jointly controlled data centre company in France, backed by a €3 billion investment programme combining Orange assets, Morrison equity, and debt. The venture targets 400 megawatts of capacity, close to ten times what Orange operates today. Orange would contribute five French data centres […] This story continues at The Next Web
The Next Web AI 3d ago News Bias & fairnessFinance, VC & PE

Human-in-the-Loop Signature Bootstrapping for UAV Hyperspectral PFM-1 Mine Detection

Hyperspectral imaging (HSI) is useful for material discrimination, but operational mine screening also depends on how many false alarms must be inspected before targets are found. This paper studies PFM-1 landmine detection in unmanned aerial vehicle (UAV) visible and near-infrared (VNIR) HSI using spectral angle mapper (SAM), matched filter (MF), adaptive coherence estimator (ACE), and constrained energy minimization (CEM). We compare a ground-measured SVC signature, a fully informed in-scene c
HuggingFace Daily Papers 3d ago Research Bias & fairnessEnvironment

Shape-Based Inductive Bias for Glioma Grading from Tumor Contours

Glioma grading from tumor contours is often treated as a pixel problem even when the signal of interest is shape. We align closed contours with a functional shape-alignment framework, separate global deformation from residual Fourier shape, and organize these quantities as frequency-ordered tokens. In five-fold patient-disjoint cross-validation on BraTS~2020 tumor contours, with model selection performed using grouped inner validation, a compact multilayer perceptron (MLP) achieves the highest m
arXiv cs.LG 3d ago Research Bias & fairnessSafety & alignment

Social Choice for Fair Recommendations

Recommender systems influence nearly every aspect of our digital lives—but what does it mean for those systems to be fair? Robin Burke joins Data Skeptic to discuss the history of recommender systems, the limitations of optimizing purely for accuracy, and how ideas from social choice theory can help balance the needs of users, creators, and society. The conversation explores the future of recommendation algorithms and why fairness is a far more complex challenge than it first appears.
Data Skeptic 3d ago Field notes Bias & fairness

Unsupervised Graph Representation Learning with Complementary View Alignment

Unsupervised graph representation learning aims to derive meaningful node embeddings by capturing both structural and attribute information without relying on labeled data. Existing methods, such as GAEs, have demonstrated effectiveness but typically rely on message-passing mechanisms that assume homophily, leading to performance degradation on heterophilous graphs, where connected nodes exhibit dissimilar features. This homophily bias results in the loss of critical high-frequency components th
arXiv cs.LG 3d ago Research Bias & fairnessSafety & alignment

TeamSystem’s private equity owners look at stake sale at €8bn valuation

Process could test investors’ willingness to back business software groups with market roiled by AI disruption
Financial Times Technology (headlines) 3d ago News Bias & fairnessFinance, VC & PE

WHBench: Evaluating Frontier LLMs with Expert-in-the-Loop Validation on Women's Health Topics

arXiv:2604.00024v2 Announce Type: replace-cross Abstract: Large language models are increasingly used for medical guidance, but women's health remains under-evaluated in benchmark design. We present the Women's Health Benchmark (WHBench), a targeted evaluation suite of 47 expert-crafted scenarios across 10 women's health topics, designed to expose clinically meaningful failure modes including outdated guidelines, unsafe omissions, dosing errors, and equity-related blind spots. We evaluate 22 mod
arXiv cs.CY 3d ago Research Bias & fairnessHealthcare

Making sense of the panic over Chinese AI

On the latest episode of Equity, we discussed why Moonshot AI's Kimi seemed to panic Silicon Valley and Wall Street.
TechCrunch 4d ago News Bias & fairness

The U.S. government invested $27 billion in corporate stakes. Good luck finding them

The Trump administration’s equity stakes—from Intel to quantum startups—appear in no budget document and are subject to no watchdog.
Fortune AI 4d ago News Bias & fairnessFinance, VC & PE

Directional Influence Function: Estimating Training Data Influence in Constrained Learning

As constrained learning becomes increasingly common, models are trained under explicit feasibility requirements to enforce fairness, safety, robustness, regulariza- tion, and physics or logic constraints. Understanding how training samples in- fluence the model solution (e.g., learned parameters) is crucial for interpretability and robustness. The classical influence function (IF) estimates sample contribu- tions via local sensitivity analysis, measuring how the solution changes when a specific
arXiv fairness query 5d ago Research Bias & fairnessSafety & alignment

Directional Influence Function: Estimating Training Data Influence in Constrained Learning

As constrained learning becomes increasingly common, models are trained under explicit feasibility requirements to enforce fairness, safety, robustness, regulariza- tion, and physics or logic constraints. Understanding how training samples in- fluence the model solution (e.g., learned parameters) is crucial for interpretability and robustness. The classical influence function (IF) estimates sample contribu- tions via local sensitivity analysis, measuring how the solution changes when a specific
arXiv fairness query 5d ago Research Bias & fairnessSafety & alignment

Online Fair Division with Budget Constraints

We study an online variant of discrete fair division under generalized assignment budget constraints. Goods arrive one at a time and must be assigned irrevocably to a feasible agent or to charity, which holds all unallocated goods, while fairness is evaluated only against budget-feasible subsets of every recipient's bundle. We first show that, without additional structure, no deterministic online algorithm can guarantee any fixed approximation to feasible envy-freeness, even in highly symmetric
arXiv fairness query 5d ago Research Bias & fairnessAgents & autonomy

Nvidia is pouring $1 billion into South Korea’s AI infrastructure through Naver and SK Group

Nvidia will invest $1 billion in South Korean internet company Naver to help finance an AI data center under construction in South Korea, the chipmaker announced late Friday. The funding will allow Naver to more than triple the size of the facility from 55 megawatts to 200 megawatts, with US private equity firm Brookfield agreeing […] This story continues at The Next Web
The Next Web AI 5d ago News Bias & fairnessEnvironment

Equity crowdfunding exemptions, industrial structure, and new venture creation

Publication date: October 2026 Source: Research Policy, Volume 55, Issue 8 Author(s): Wanxiang Cai, Haneul Choi, Tianshu Zhao, Max Munday
Research Policy 5d ago Research Bias & fairnessRegulation

Bias in the Machine? A Solution to the Isolationist Problem Through a Sociotechnical Understanding of Bias in AI Ethics

Dominant approaches to bias in artificial intelligence (AI) are structured by what I identify as the isolationist problem: the tendency to treat bias as a discrete, technically addressable flaw within the AI development pipeline, rather than as a relational phenomenon embedded in social, institutional, and political arrangements. This problem is sustained by two mutually reinforcing orientations: technocentrism, which reframes ethical challenges as engineering problems amenable to computational
Science and Engineering Ethics 5d ago Research Bias & fairness

Remote worker with anxiety wins discrimination case after employer refused to let her turn off her camera

A UK employment tribunal has ruled that forcing a remote worker with anxiety, ADHD, and autism to turn on her camera during a video training session amounted to disability discrimination. Laura Tait, a home-based travel consultant at Holiday Extras, was awarded compensation after the Croydon tribunal found the company failed to make reasonable adjustments for […] This story continues at The Next Web
The Next Web AI 6d ago News Bias & fairnessJobs & economy
Older →