When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses
arXiv:2607.26348v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as synthetic users, stand-ins for human respondents whose simulated answers feed product, policy, and market decisions. We ask when this substitution is valid and when it fails, and package the answer as an evaluation framework for intelligent synthetic-user systems. A single protocol, run across four models spanning two families and an 8B-to-frontier capability range, is applied to two independe
Record details
Published: 30 July 2026
Source: arXiv cs.CY
Category: Research
Topics: Regulation
Retrieved: 30 July 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses
arXiv cs.HC · 28 July 2026
Statistical laws and linguistics differ in naturalistic video and fictional conversations
arXiv cs.CY · 30 July 2026
Optimal Causal Annotations: An Application to Casenotes in Social Services
arXiv cs.CY · 30 July 2026
On Exercising Governance Power in Decentralized Autonomous Organizations
arXiv cs.CY · 30 July 2026
The Human Utility Factor: A Computable Welfare Metric That Reframes AI Governance as a Constrained Optimisation Problem
arXiv cs.CY · 30 July 2026
Anticipatory Data Governance in the Age of AI: Emerging Signals in Data Access, Reuse, and Sovereignty
arXiv cs.CY · 30 July 2026
How to cite this record
ethics.ai (30 July 2026), “When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses,” evidence record 14521, https://ethics.ai/record/14521 (originally published by arXiv cs.CY).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.