Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations
Large language models (LLMs) have demonstrated impressive capabilities in utilizing external tools. In practice, however, LLMs are often exposed to tools that are irrelevant to the user's query, in which case the desired behavior is to refrain from invocations. In this work, we identify a widespread yet overlooked mechanistic flaw in tool refusal, which we term structural alignment bias: Even when a tool fails to serve the user's goal, LLMs still tend to invoke it whenever query attributes can b
Record details
Published: 13 April 2026
Source: arXiv
Category: Research
Topics: Bias & fairness · Safety & alignment
Retrieved: 14 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety
arXiv · 13 April 2026
Retrieval-Augmented Generation Must Move Beyond Factual Grounding to Represent Diverse Opinions
arXiv · 13 April 2026
Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance
arXiv · 12 April 2026
SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models
arXiv · 14 April 2026
Can Persona-Prompted LLMs Emulate Subgroup Values? An Empirical Analysis of Generalisability and Fairness in Cultural Alignment
arXiv · 14 April 2026
A Multi-Domain Red Teaming Framework for Safety, Robustness, and Fairness Evaluation of Medical Large Language Models
arXiv · 15 April 2026
How to cite this record
ethics.ai (13 April 2026), “Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations,” evidence record 5947, https://ethics.ai/record/5947 (originally published by arXiv).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.