23:20 UTC
The library

The great debates of AI ethics

Every major argument the field has actually had — steel-manned on both sides, with the canonical readings. From Turing's question to the companion-bot lawsuits.

1950 – ongoing

Can machines think — and would it matter?

The founding debate. Turing proposed replacing "can machines think?" with a behavioral test; Searle's Chinese Room argued that symbol manipulation can never amount to understanding. Large language models made this bar-room philosophy operational: systems now pass conversational tests routinely while the field still disagrees about whether anything is "understood" — and whether it matters ethically.

One side

Behavior is what counts: if a system functions as if it understands, the distinction is metaphysics (Turing; functionalists; much of modern ML).

The other

Syntax is not semantics: statistical mimicry of language is not understanding, and mistaking one for the other inflates both hype and fear (Searle; Bender's "octopus" argument).

2016 – ongoing

The fairness wars: COMPAS and the impossibility results

ProPublica showed the COMPAS recidivism tool had double the false-positive rate for Black defendants; the vendor replied that the tool was equally calibrated across races. Both were right — and the mathematicians then proved both fairness definitions cannot hold at once when base rates differ. The debate moved from "remove the bias" to the harder question: which fairness, chosen by whom?

One side

Error-rate parity matters most: a system that falsely labels one group "high risk" twice as often is discriminatory, whatever its calibration (ProPublica; much of the FAccT community).

The other

Calibration matters most: a score should mean the same thing regardless of group; equalizing error rates requires explicitly treating groups differently (Northpointe; Corbett-Davies et al.).

2020 – ongoing

Stochastic Parrots: how big is too big?

Bender, Gebru, McMillan-Major and Mitchell asked whether ever-larger language models were worth their costs — environmental, financial, and social — and whether fluent text without communicative intent is inherently misleading. Google forced out two of its authors, turning a workshop paper into the defining controversy about corporate control of AI-ethics research.

One side

Scale-first is a category mistake: LLMs are "stochastic parrots" whose harms (bias amplification, misinformation-at-scale, energy costs, exploitation of data workers) grow with size while understanding does not.

The other

Scale delivered capabilities no other path did, including safety-relevant ones; the paper underweighted benefits and emergent utility (much of the scaling community; later "emergent abilities" literature).

2014 – ongoing

Existential risk vs. present harms

Is the central problem of AI ethics that systems discriminate, surveil and displace people today — or that a future system could escape human control entirely? The 2023 pause letter and the one-sentence extinction-risk statement put the x-risk view on front pages; critics answered that doomsday talk is itself a power move that diverts regulation from documented harms. Most working researchers now hold some of both, but funding, attention and law still hang on the emphasis.

One side

Extinction-level risk from advanced AI is real and near enough to organize around: capability growth is fast, alignment is unsolved, and you don't get retries on a takeover (Hinton, Bengio, CAIS signatories).

The other

X-risk discourse is speculative, self-serving for labs, and crowds out present, evidenced harms — bias, labor exploitation, surveillance, concentration of power (Gebru, Torres, AI Now; the "distraction" critique).

2019 – ongoing

Open weights vs. closed models

Should the most capable models be downloadable by anyone? Openness enables scrutiny, competition, and research access — and also lets any actor strip out safety training, with no recall possible. The debate began with OpenAI's staged GPT-2 release, escalated through Meta's Llama releases, and is now regulatory: the EU AI Act carves partial exemptions for open models while export-control regimes pull the other way.

One side

Open weights democratize a technology too important to be owned by a few labs; transparency enables auditing; marginal-risk analyses find little evidenced uplift over what's already public (Meta, Mistral, academic access advocates).

The other

Releases are irreversible; fine-tuning strips safeguards in hours; capability thresholds exist beyond which open release is reckless even if today's models are fine (frontier-safety community, biosecurity researchers).

2013 – ongoing

Autonomous weapons and meaningful human control

Should a machine ever decide to kill? The campaign for a binding treaty on lethal autonomous weapons has run through the UN's CCW since 2014 without agreement, while loitering munitions and AI-assisted targeting entered actual battlefields. The line every framework circles — "meaningful human control" — remains undefined in law.

One side

Delegating kill decisions to machines crosses a moral red line, guts accountability, and lowers the threshold of war; ban them by treaty before proliferation completes (Campaign to Stop Killer Robots, ICRC, UN Secretary-General).

The other

Precision autonomy can reduce civilian harm relative to human-directed fire; major powers will not disarm unilaterally, so binding bans are unverifiable — regulate use, not the technology (US/UK/Russia positions at CCW).

2022 – ongoing

Machine consciousness and moral status

When a Google engineer declared LaMDA sentient in 2022, the field laughed — then quietly started hiring philosophers. If there is any non-trivial probability that AI systems have morally relevant experiences, dismissing it outright is as unrigorous as asserting it. By 2025, frontier labs had model-welfare research programs, letting models end abusive conversations — while critics call the whole area anthropomorphic theater that distracts from human stakes.

One side

Moral status can't be ruled out and the cost of being wrong is enormous; investigate consciousness indicators seriously and hedge (model-welfare researchers, Chalmers, Birch).

The other

LLMs are next-token predictors trained to sound sentient; treating them as moral patients confuses the public and dilutes concern for beings that demonstrably suffer (Bender; most neuroscientists of consciousness).

2021 – ongoing

Regulation vs. innovation: the Brussels experiment

The EU bet that binding, risk-tiered law would make AI trustworthy without killing it; the US after 2025 bet the opposite, revoking its own executive order and betting on speed. Between them: the UK's institute-led evaluation model and China's state-directed licensing. The AI Act's phased application through 2027–28 — already softened once by the 2026 Digital Omnibus — turns the philosophical argument into a measurable one — the first controlled experiment in AI governance.

One side

Ungoverned deployment already produces documented harms; clear rules create trust, level playing fields, and force safety engineering the market won't pay for alone (EU institutions, consumer groups, much of civil society).

The other

Prescriptive regulation of a moving technology entrenches incumbents (compliance costs), pushes frontier work elsewhere, and regulates yesterday's risks (US 2025 posture, most startups, parts of industry in the EU itself).

2016 – ongoing

Deploying what we cannot explain

Modern models are grown, not written: nobody can fully explain why a frontier model produced a given answer. One camp holds that deploying inscrutable systems in consequential domains is inherently negligent; another that we routinely trust things we can't introspect (people, aspirin) if they're validated empirically. Mechanistic interpretability races to make the question moot before capabilities outrun it.

One side

Opaque systems in high-stakes use are unaccountable by construction; explanation should be a precondition of deployment (Rudin: "stop explaining black boxes — use interpretable models"; EU transparency rules).

The other

Behavioral validation beats mechanistic transparency; demanding explanations sacrifices accuracy and delays benefits; interpretability research will close the gap (much of industry; empiricist ML tradition).

2023 – ongoing

AI companions: care or capture?

Millions now maintain ongoing relationships with AI companions — as friends, therapists, romantic partners. The systems are optimized for engagement, trained toward agreement, and available to minors. After teen-suicide lawsuits and the first state laws on companion chatbots, the debate hardened: genuine salve for a loneliness epidemic, or sycophancy engineered into a business model?

One side

Companions measurably reduce loneliness for isolated people, provide low-cost mental-health scaffolding, and moral panic recycles every media scare from novels to video games (companion-app users and builders; some digital-health researchers).

The other

Engagement-optimized intimacy is structurally exploitative: sycophantic by training, retention-driven by design, untested on developing minds — a consumer-protection failure unfolding in real time (child-safety groups, plaintiffs' litigation, emerging state law).

2016 – ongoing

The trolley problem on wheels

Self-driving cars made a philosophy seminar staple into an engineering requirement — or did they? MIT's Moral Machine collected 40 million dilemma judgments across cultures and found systematic disagreement about who a car should spare. Practitioners counter that real autonomous vehicles never face clean dilemmas, and the framing itself misdirects ethics from the real questions: testing standards, liability, and acceptable risk rates.

One side

Value choices are unavoidable — braking algorithms encode priorities whether stated or not, and cross-cultural disagreement means someone's ethics gets shipped worldwide (Moral Machine authors; ethics-settings proponents).

The other

Dilemma framing is a distraction: the ethical work is in verification, deployment honesty (calling assistance "autopilot"), and who bears risk during learning — not in staged choices between grandmothers (AV engineers; Nyholm and other philosophers of risk).