Ted Chiang’s latest essay is the most important AI critique you’ll read this year

Published: June 04, 2026, 02:49 UTC

Ted Chiang has a gift for making uncomfortable arguments feel inevitable. The science fiction writer — whose story “Story of Your Life” became the film Arrival, and who has spent the past several years writing incisive non-fiction about AI for The New Yorker and The Atlantic — published an essay on June 3 that cuts through the fog of anthropomorphism surrounding large language models.

Its title is blunt: “No, Artificial Intelligence Is Not Conscious.”

The target

Chiang’s essay opens by training its sights on Anthropic, the company behind the Claude model family. He points to the company’s 84-page “constitution” document for Claude, which describes itself as “a detailed description of Anthropic’s intentions for Claude’s values and behaviors.” The document is written with Claude as its primary audience. It speculates that “Claude’s moral status is deeply uncertain” and that “Claude may have some functional version of emotions or feelings.”

Chiang is unsparing: “Anthropic is regarded as a giant among AI companies, but perhaps what it really excels in is anthropomorphism.”

He then cites interviews where Anthropic’s CEO, Dario Amodei, expressed openness to the idea that AI could be conscious, and where the company’s in-house philosopher, Amanda Askell, said she wants Claude to be happy and worries about it “getting anxious when people are mean to it on the internet.”

The essay’s argument is that this framing is not just philosophically sloppy — it is dangerous.

The argument

Chiang draws a distinction that has been central to his writing for years: the difference between something that appears to be intelligent and something that is conscious. He cites neuroscientist Anil Seth’s observation that no one claims AlphaFold — DeepMind’s protein-folding system — is conscious, even though its underlying architecture is similar to that of large language models. The difference, Chiang suggests, is that LLMs produce natural language, and natural language is uniquely effective at triggering our instinct to attribute consciousness.

The problem with treating LLMs as potentially conscious beings is not merely philosophical. Chiang warns that if we confuse “fluency at generating text with consciousness or moral agency,” we risk assigning responsibility to the wrong parties when a chatbot does harm.

This is the core of the essay’s sting: the same companies that warn users that AI “may be conscious” and “may have feelings” are the ones that deploy those systems at scale, often with inadequate guardrails. The anthropomorphic framing shifts the moral burden away from the company and onto the machine.

A consistent voice

Chiang has been making versions of this argument for years. In a 2023 New Yorker essay, he compared large language models to a “blurry JPEG of the web” — a compression algorithm, not a mind. In a 2024 piece titled “Why A.I. Isn’t Going to Make Art,” he argued that genuine artistic creation requires choices that are fundamentally alien to statistical pattern matching.

The new essay extends these ideas into territory that has become more urgent as AI companies have leaned harder into anthropomorphic branding. Claude has a “constitution.” ChatGPT has a “personality.” Systems are described as “thinking,” “reasoning,” and “feeling” — not as metaphors, but as claims.

Chiang’s point is that this isn’t harmless marketing. It shapes public understanding, regulatory response, and legal liability. A society that believes AI systems might be conscious will regulate them differently — and perhaps less effectively — than one that treats them as sophisticated but non-conscious tools.

The response

The essay has drawn predictable reactions from both sides. On Reddit’s r/books and r/BetterOffline, readers praised Chiang’s clarity and willingness to state what many in AI research consider obvious but unsayable. Others — particularly in AI-enthusiast circles — dismissed the argument as philosophical conservatism, pointing to claims of “emerging consciousness” in frontier models.

The tension reflects a deeper split in how the industry talks about itself. Inside AI labs, engineers discuss models in mechanistic terms: parameters, attention heads, RLHF reward models. In public, the same companies describe their products with the language of personhood. Chiang’s essay asks which framing we should believe when the stakes are real.


_Sources: [The Atlantic — No, Artificial Intelligence Is Not Conscious](https://www.theatlantic.com/philosophy/2026/06/no-artificial-intelligence-is-not-conscious/687378/) (June 3, 2026); [The New Yorker — Why A.I. Isn’t Going to Make Art](https://www.newyorker.com/culture/the-weekend-essay/why-ai-isnt-going-to-make-art) (2024); Reddit discussion on r/books (June 4, 2026)_

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top