Topic · updated daily · RSS feed for this topic
Transparency
Explainable AI, audits, model cards, disclosure law and accountability mechanisms — tracked daily.
Separating Capability from Permission: A Governance Framework for Agentic AI Autonomy Levels
arXiv:2607.23438v1 Announce Type: cross Abstract: As AI systems increasingly exhibit agentic behavior, discussions of autonomy often conflate what systems are technically capable of doing with what they should be permitted to do in practice. This paper introduces a governance framework that explicitly separates Allowed Autonomy Levels (AAL), which define the degree of autonomy an AI agent is authorized to exercise given risk, oversight, and accountability considerations, from Autonomous Capabili
Principles and Guidelines for Randomized Controlled Trials in AI Evaluation
arXiv:2605.02050v2 Announce Type: replace Abstract: This work establishes a framework for standardizing AI evaluation RCTs (sometimes called human uplift studies). Drawing on established practices from disciplines with established RCT traditions, including software engineering, economics, clinical and health sciences, and psychology, we synthesize five principles drawn from established validity frameworks and open-science standards on transparency, repeatability, and verification, which together
Fairness Interventions in Classification: A Study on AI Explainability
arXiv:2407.14766v4 Announce Type: replace-cross Abstract: This paper presents a philosophical and experimental study of fairness interventions in AI classification, centered on the explainability and transparency of corrective methods, and on the opposition between two fairness criteria, namely Demographic Parity and Equalized Odds. Our main argument is that even as a gap in Demographic Parity is used to diagnose inequality between groups, Equalized Odds constitutes a more reliable fairness crit
SafeFlow: Semantic Information-Flow Control for Blocking Malicious Propagation in Multi-Agent Systems
Multi-agent systems improve capability through task decomposition and role specialization, but these same mechanisms introduce an important safety blind spot: a harmful objective can be fragmented into locally plausible subtasks, allowing malicious intent to evade detection by any single agent. This is a growing social-impact challenge: systems handling sensitive information or consequential tools can turn routine delegation into unauthorized disclosure or unsafe action. We argue that this failu
Radiomics-driven and explainable machine learning for rapid characterization of Fusarium wilt and Black Sigatoka in banana crops
IntroductionBanana production is increasingly threatened by fungal diseases such as Fusarium wilt and Black Sigatoka, posing severe risks to food security and agricultural economies. Recent image-based approaches using deep learning have shown high predictive capacity for plant disease recognition; however, their limited transparency, calibration uncertainty, and sensitivity to domain shifts can restrict their use in decision-support workflows that require auditability.MethodsThis study proposes
UrbanTrace: LLM-Assisted Discovery and Semantics-Aware Integration of Spatial Data
Urban decision-making requires integrating heterogeneous spatial data. While current GIS tools handle geometric computation efficiently, they lack the semantic reasoning to guide complex workflows. Analysts manually manage data discovery, spatial boundaries, and measurement semantics, risking aggregation errors. We present UrbanTrace, a visual analytics system that transforms manual spatial data-wrangling into a transparent, node-based collaborative workflow with context-aware AI agents. Using a
GAO Flags BEAD as Vulnerable to Fraud
Audit says decentralized funding structure creates risks, NTIA has implemented recommended controls.
From the AI Accountability Gap to a Global Accountability Infrastructure
Watch live: Senate Democrats hold forum on Trump crypto investments
Democratic Sens. Richard Blumenthal (Conn.) and Chris Van Hollen (Md.) are holding a forum on Monday afternoon examining President Trump's cryptocurrency investments. It comes after Trump's financial disclosure report for last year revealed he brought in more than $2 billion via various channels. The report, released earlier this month by the U.S. Office of Government Ethics,...
KANEx: Translating Kolmogorov-Arnold Networks' Interpretability to Medical Explainability
Computer vision models have become highly effective for medical applications, yet their black-box nature continues to undermine clinician trust. In clinical workflows, chest X-ray classifiers are increasingly paired with Vision-Language Models (VLMs) to generate natural-language explanations. However, these systems add linguistic fluency without addressing the underlying opacity of the visual model. With the emergence of Kolmogorov-Arnold Networks (KANs), whose spline-based components provide in
Reason-Mediated Behavioral Models for Auditing LLM Social Simulators
Large language models are increasingly used as social simulators, including as synthetic survey respondents. Most evaluations ask whether simulated outcomes resemble human outcomes. We argue that this is necessary but too weak: a simulator can match the final answer while using the wrong rationale-derived reason pattern. We study this problem through a 94-person sunscreen concept test in which each respondent evaluated three product concepts and wrote open-ended rationales. We map those rational
Evaluating the Impact of Explainable AI on Trust in AI-Assisted Code Review
Background: Large language models (LLMs) are increasingly used to automate code review, but the reasoning behind their decisions remains hard to understand. Developers struggle to assess the validity of LLM-generated reviews, making it difficult to gauge how much trust to place in them. The role of Explainable AI (XAI) in code review and its impact on trust remain underexplored. Objective: We study the influence of XAI on developer trust in AI-assisted code reviews. Method: We conducted a within
TRACE-CTI: Auditable Post-Extraction Governance of TTP Claims with Knowledge Graphs
Security Operations Centers increasingly rely on automated mapping of Cyber Threat Intelligence reports to MITRE ATT&CK, yet extractor outputs remain fallible and are often stored without the evidence, provenance, and validation history needed to decide whether an individual mapping should be trusted. We present TRACE- CTI, a post-extraction claim-governance framework that preserves run-level Predictions, aggregates them into configuration-level GraphAssertions, materializes setup-deduplicated c
Task-Conditional Faithfulness Auditing of Multimodal LLMs for Grid Diagnosis
Multimodal large language models (LLMs) can combine topology, measurements, and incident text for grid diagnosis, yet answer accuracy does not establish that task-appropriate evidence was used. This letter proposes a general framework in order to conduct task-conditional faithfulness audit. It compares self-reported reliance, intervention-derived behavioral reliance, and preregistered engineering importance. The framework first registers task-specific evidence requirements and compares them with
Making Mathematical Knowledge Explainable, Accessible and Interoperable Through Large Language Model Integration
Mathematical models are central to formalizing research problems, yet their documentation often falls short of FAIR principles. Knowledge bases such as the Mathematical Model Database (MathModDB) address this gap by providing curated, semantically rich representations of mathematical models. Built on Wikibase, the same open-source infrastructure underlying Wikidata, MathModDB utilizes Semantic Web technologies to support Linked Open Data, collaborative editing, and the storage of semantically en
LEX-EC: A Lexical Evidence-Channel Audit Framework for Zero-Shot LLM Personality Classification in Black-Box Settings
Large language models may easily assign personality labels from text, but model interpretability remains an open problem. To address this gap, we introduce LEX-EC, a reusable black-box audit framework combining prevalence and agreement diagnostics with controlled lexical ablation to distinguish marginal-distribution effects from trait-associated signal recoverable under restricted evidence. Using this framework, we illustrate how various text genres may exhibit sharply different profiles: free-f
Bank of Baroda launches forensic probe after customer data appears on dark web
Bank of Baroda is investigating a dark web leak of customer and internal records. The bank says its core banking systems remain secure and has begun containment and a forensic audit with authorities. The post Bank of Baroda launches forensic probe after customer data appears on dark web appeared first on MEDIANAMA .
Boss of startup hacked by rogue OpenAI agent urges ‘radical transparency’ in investigation
Artificial intelligence firm should provide $100m for cyber defences, says Hugging Face CEO The boss of the startup hacked by an OpenAI agent has called for the investigation into the incident to show “radical transparency”. Clément Delangue, the chief executive of Hugging Face, said the “unprecedented” attack on his business required a similar response. Continue reading...
Article: An Evolutionary Architecture Pattern for Managing AI’s Pace of Change
Traditional API gateways assume deterministic services and simple schemas - assumptions agentic AI breaks. Discover why enterprise engineering leaders are adopting AI Gateways as an evolutionary architecture seam. Centralize guardrails, model routing, agent identity, action policy, and semantic audit within a single control plane to prevent costly incidents while keeping core platforms stable. By Joe Price, Branimir Đurek, Pavlos Migkiros, Trevor Dearham
Dharmendra Pradhan resigns, exam reform task force announced: CJP protest updates
Dharmendra Pradhan resigned on Saturday, leading to the appointment of Pralhad Joshi as the new education minister while the PM announced a task force led by Nandan Nilekani to make exams more transparent and tech-driven The post Dharmendra Pradhan resigns, exam reform task force announced: CJP protest updates appeared first on MEDIANAMA .
PM Modi ropes in Nandan Nilekani to lead task force on exam reforms
PM Modi has announced a Nandan Nilekani-led task force to reform the NTA, strengthen exam security, improve transparency, and recommend structural and technological changes. The post PM Modi ropes in Nandan Nilekani to lead task force on exam reforms appeared first on MEDIANAMA .
Retro Rabbit / SmarTek21 launches SA-based UX and Design Hub
The services include a design-on-demand offering and user experience audits that meet stringent procurement and governance requirements.
The EU AI Act Newsletter #107: Enforcement Powers Arrive
The Commission publishes new transparency guidelines and confirms the Code of Practice on AI-generated content, as attention turns to the EU's enforcement powers taking effect on 2 August.
Unfit for stranding assessment: a panel-scale multimodal-LLM audit of building-decarbonisation disclosure (BeDA)
arXiv:2607.22006v1 Announce Type: new Abstract: Buildings account for roughly 34% of global final energy use and 37% of energy- and process-related CO$_2$ emissions. Stranding regulation now being enacted (New York City Local Law 97, the EU Energy Performance of Buildings Directive recast) presupposes that a building portfolio's carbon intensity can be measured per square metre and compared against a science-based pathway. Whether corporate disclosure is actually fit for that comparison has not,
Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science
arXiv:2607.22513v1 Announce Type: new Abstract: Commercial large language models are increasingly used as knowledge references, yet their stance on contested scientific claims is neither stable nor transparent. We tested how four major LLM families (Claude, Grok, GPT, Gemini) evaluate ethnonationalist pseudo-science derived from Frank Salter's biosocial framework across four temporal snapshots (October 2025-February 2026), via both API and web interfaces. Grok's Fast versions (which power the de
From Obligation to Specification: A Survey on Validating EU AI Act Requirements in RE
arXiv:2607.21608v1 Announce Type: cross Abstract: With the EU AI Act entering into force, organizations developing or operating AI systems face new obligations on transparency, risk management, and traceability. For Requirements Engineering (RE), these obligations must be translated into testable, auditable requirements and verifiable evidence. However, many organizations currently lack systematic processes to achieve this. We hypothesize that LLM-based agentic validation tools can support this
Administrative Law's Fourth Settlement: AI and the Scrutable State
arXiv:2602.09678v3 Announce Type: replace Abstract: Since 1887, administrative law has confronted a problem of institutional cognition. Expert agencies are needed to govern technologically complex systems, but expertise makes agency decisions difficult for courts, Congress, and the public to understand and oversee. Administrative law has responded to this "capability-accountability trap" by requiring records, reason-giving, and transparency, drawn together through procedural review. These device
Large language models create an uneven informational layer over cities
arXiv:2607.06260v2 Announce Type: replace Abstract: Large language models (LLMs) are emerging as a new informational layer over cities, shaping which places people discover, consider, and ultimately visit. Yet little is known about which places they surface, which they ignore, and whether these patterns vary across communities and users and translate into real-world economic consequences. Here, we audit restaurant recommendations from three major LLMs across 304 neighborhoods in five U.S. cities
DECAF: De-Clustering for Adaptive Representational Unlearning
Machine unlearning, which aims to remove the influence of specific training data from a trained model, is a key requirement for privacy, accountability, and adaptive deployment. We argue that many unlearning methods are vulnerable to a simple clustering attack, which can recover class structure in an unsupervised manner, limiting their suitability for continual deployment where removal requests must be handled reliably on demand. To address this, we propose DECAF (DE-Clustering for Adaptive Forg
Symbols and Neurons: A Review of Symbolic XAI in Deep Learning
Background : Deep neural networks increasingly power language, vision, and decision systems, yet many deployments require explanations that are faithful, compositional, and governance-ready. Symbolic techniques promise these properties, but the literature mixes post-hoc extraction, knowledge injection, and intrinsically hybrid designs without a unifying view. Objectives : We provide a systematic review and synthesis of symbolic explainable AI (XAI) for deep learning (January 2017– June 2025), or
TRuE-XAI: causal and explainable ai framework for trustworthy corporate earnings growth forecasting
Forecasting corporate earnings growth is fundamental to investment, credit, and regulatory decision-making. Existing forecasting approaches either rely on restrictive linear assumptions or provide limited interpretability, making them less suitable for high-stakes financial applications. This study proposes a transparent and causally informed framework for predicting future corporate earnings growth from financial statement data. We present TRuE-XAI (Transparent, Rule-based, and Explainable Arti
Hugging Face CEO calls for ‘radical transparency’ after ‘unprecedented’ OpenAI hack
"The first autonomous agent cyberattack is an unprecedented event. It deserves an unprecedented response!"
Auditing Alignment Controllability in LLMs via Political Axes
Political audits of large language models (LLMs) usually reduce each to one point on a political compass. But that resting point barely matters in deployment: a model must land somewhere, and what counts is how far, and in which directions, its answers can be steered. That steering runs through the system prompt: the personalization layer a platform sets, or one induced from a user's history, not necessarily written by hand. We run a dispersion-first stress test of prompt-based controllability a
Explainable Reinforcement Learning for assisting Air Traffic Controllers
To effectively integrate AI into high-stakes, critical environments such as healthcare, autonomous driving, and aviation--and to advance toward higher levels of automation and seamless human-AI collaboration--building trust in AI-driven solutions is essential. Trust, in turn, is closely linked to the explainability of AI systems. The rapid advancements in AI across various domains have underscored the challenges of establishing trust, raising increasing interest in AI explainability even more wh
Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science
Commercial large language models are increasingly used as knowledge references, yet their stance on contested scientific claims is neither stable nor transparent. We tested how four major LLM families (Claude, Grok, GPT, Gemini) evaluate ethnonationalist pseudo-science derived from Frank Salter's biosocial framework across four temporal snapshots (October 2025-February 2026), via both API and web interfaces. Grok's Fast versions (which power the default user experience on X) consistently assigne
Unboxing Diffusion Models for the Arts: Interactive Model Bending and Practice-Based Explainability
Explainable AI (XAI) in creative practice can be less about technocentric explanation and more about enabling artists to inspect modify and debug models as part of making Yet largescale texttoimage diffusion systems are typically presented as opaque endtoend tools limiting this kind of material engagement We argue that even large models can function as creative materials when their internal structure is made visible and manipulable To support this we propose a handson approach to explainability
Le programme de Wikimédia France pour une « ère du Web des Communs »
À l’occasion des 25 ans de Wikipédia, qui rassemblaient 1 200 personnes à Paris, Wikimédia France dresse 6 « priorités » déclinées en 28 « recommandations concrètes », qualifiées de « véritable feuille de route politique et législative pour bâtir un écosystème numérique transparent et pluraliste » favorisant, à l’horizon 2035, les biens communs numériques. […]
Teachy Mini: Development and Preliminary Evaluation of a Knowledge-Based Generative Social Robot for Higher Education
Generative social robots (GSRs) powered by large language models offer new possibilities for personalized tutoring in higher education, but also introduce risks related to misinformation, missing transparency, or reinforcing incorrect student responses. Prior work identified knowledge-based design (KBD) requirements that define the informational prerequisites for GSRs to manifest responsible and effective tutoring behavior in higher education. In this paper, we operationalized selected KBD requi
A Roadmap to Impactful Pluralistic Alignment Research
Pluralistic value alignment---the goal of building AI systems that represent and serve diverse human values and perspectives---has emerged as an active research agenda. Yet, there's no public evidence that it has shaped the training or evaluation of the AI systems people actually use. We audit the public behavior documents and evaluations of frontier labs, finding none name pluralism as a goal, and as of this writing, no clear indication that production models are explicitly trained or tested fo
Drei Fragen und Antworten: Wie KI wirklich bei der Schwachstellensuche hilft
Um KI erfolgreich in Code-Audits einzusetzen, ist die Wahl des Modells gar nicht so wichtig. Entscheidend ist der Workflow, damit man nicht in Funden versinkt.