What out-of-the-box LLMs can(t) do in law? A Turing test in Italian exams for lawyers, judges and notaries
arXiv:2608.06166v1 Announce Type: new Abstract: The article reports on a blind Turing Test experiment, assessing the performance of out-of-the-box leading LLMs on three Italian legal professional exams: the Bar, Judges and Notary exams. Leading LLMs were asked to generate full written exam papers, which were made indistinguishable from human submissions and anonymously evaluated by expert examiners, using the same criteria applied in real examinations. Results reveal marked differences across bo
Record details
Published: 7 August 2026
Source: arXiv cs.CY
Category: Research
Topics: Regulation
Retrieved: 7 August 2026
Related evidence
These records share source-supplied organisations, an exact publisher byline, automatic topics or regions. The reason is shown on every link; related does not mean supporting, agreeing with or verifying this record.
Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI
arXiv cs.CY · 7 August 2026
Validity, Reliability, and Transparency in Artificial Intelligence Regulation
arXiv cs.CY · 7 August 2026
A Vision for the Future of an AI-Integrated Research Ecosystem
arXiv cs.CY · 7 August 2026
The Nuclear Decision-Making Benchmark: Evaluating Frontier LLMs on Nuclear Tendencies
arXiv cs.CY · 7 August 2026
Teaching Intro AI When the Tools Can Do the Homework: A Course Redesign and a Student Bill of Rights
arXiv cs.CY · 7 August 2026
Progressive Alignment of Recommender Foundation Model through Multi-Phase Post-Training
arXiv · 7 August 2026
How to cite this record
ethics.ai (7 August 2026), “What out-of-the-box LLMs can(t) do in law? A Turing test in Italian exams for lawyers, judges and notaries,” evidence record 17015, https://ethics.ai/record/17015 (originally published by arXiv cs.CY).
Use and limitations
This page is a stable index and citation surface for a source record. ethics.ai did not author the underlying report and has not independently verified every claim. Automatic topics may be imperfect. For consequential use, quote and cite the original publisher.