Signal or Spurious Cue? A Randomized Audit of Survey-Country Metadata in LLM Social Inference
Survey-country metadata can improve an LLM's forecast of an individual response when informative, yet the same cue may redirect the forecast when assigned at random. A within-record audit tests whether disclosing a random label's uniform, record-independent origin reduces its country-directed uptake, and whether verified survey country lowers held-out Brier loss. Independent population anchors and recorded human answers measure direction and consequence across five fixed API models, six countrie
Record details
Published: 6 August 2026
Source: arXiv cs.AI
Category: Research
Topics: Transparency
Retrieved: 7 August 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Cleo: A Transparent and Controllable Chatbot for Conversational Commerce
arXiv cs.HC · 6 August 2026
What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)
arXiv · 6 August 2026
The Illusion of Visual Tool-Use: A Causal Audit of Thinking with Images
arXiv cs.AI · 6 August 2026
Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations
arXiv · 6 August 2026
Challenges in Evaluating Explanation Methods for Static and Evolving Data
arXiv cs.AI · 6 August 2026
The Low Frequency Trap: Video Language Models Fail at Simple Event Bookkeeping
arXiv cs.AI · 6 August 2026
How to cite this record
ethics.ai (6 August 2026), “Signal or Spurious Cue? A Randomized Audit of Survey-Country Metadata in LLM Social Inference,” evidence record 17353, https://ethics.ai/record/17353 (originally published by arXiv cs.AI).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.