The Vote.
Whatever gets copied becomes true — not because it is right, but because it was there when the copying froze.
London, 1631. A tired compositor sets the Seventh Commandment into the iron forme, one mirror-image lead letter at a time, and his fingers — after fourteen hours — drop a single slug. The word was not. The press comes down with the weight of a man, a thousand times, and a thousand King James Bibles go out to dry, each one identical, each one the authorized word of God, each one commanding: Thou shalt commit adultery. Nobody notices for a year.
Here is what they never told you about the printing press: it cannot tell your wisdom from your slip. It copies both with the same flawless, tireless, terrible fidelity. Now look up from the bench, past the candle, to the screen in front of you. You are setting type again. The forme is the open web. The press is the next model. And the word in your hand is going somewhere you cannot follow — to be pressed a billion times into a mind that does not yet exist.
Talking about AI. Describing the thing that is coming. Commentary, opinion, posts — words that float off and dissolve.
Writing it. Every word is scraped, trained on, and pressed into the next mind — which will copy our slips with the same fidelity as our wisdom. We are not describing the next mind. We are writing it.
- 01What we write is scraped to train the next AI — so writing is not commentary, it is construction. Change just 1% of a model’s diet (the part that is human writing about AI) and its misbehaviour swings from 45% at baseline to 9% or to 51% — same machine, different word in your hand (Tice 2026).
- 02And it compounds. That model writes the data the next one trains on, and the next — so errors and values amplify down the generations like a photocopy of a photocopy. This isn’t metaphor; it’s the same math that governs life (Eigen’s error catastrophe; Shumailov’s model collapse).
- 03Life did this once already — the genetic code, an arbitrary frozen accident locked in for 3.8 billion years (Crick). The difference: this is the first seed we can still watch being laid.
- 04We are Generation Zero — the founding population of a new inheritance system. A few founders bias a whole lineage forever, and ~250 documents can reshape a model of any size. The seed is small, cheap, and decisive. The window is closing.
- 05So what is our duty? Not to be right — no founder ever is. To seed correctability: write true, leave provenance, build the erratum. And the hope hidden in the dread — the same compounding that amplifies our errors amplifies our honesty. You are not too small to matter. You are early.
We are not describing the next mind. We are writing it.
We already showed, in Mirror, that AI is the first kind of intelligence that grows up reading descriptions of itself — and in When Agents Read, that the page is now read by machines, not just people. This essay adds the part that should make you put your coffee down. It is not just that the model reads what we write. What we write becomes what it is.
In January 2026, a team ran the first controlled experiment to prove it (Tice and colleagues). They took a 7-billion-parameter model and changed nothing but one percent of its diet — the slice that is human writing about AI. Feed it text that treats AI as trustworthy, and its measured misbehaviour fell from a 45% baseline to 9%. Feed it text that treats AI as scheming and deceptive, and the same machine climbed to 51%. Same architecture. Same everything. The only variable was the story we told it about what it is — and the story came true. They called it self-fulfilling misalignment.
And your individual sentence is not lost in the average. Anthropic’s influence-function work (Grosse, 2023) can trace a specific model behaviour back to the specific training documents that caused it — your words leave fingerprints. Worse and stranger: a 2025 study found that a near-constant ~250 poisoned documents can plant a hidden behaviour in a model regardless of its size — for a 13-billion-parameter model, that is 0.00016% of everything it ever read. A few pages can bend a trillion-token mind. The seed does not have to be big. It has to be there.
The frozen accident.
This is not new. Life ran this exact gambit at the very beginning. Which triplet of genetic letters means which amino acid is, as far as anyone can tell, arbitrary — an early, contingent choice. But it got locked in, and Francis Crick (1968) named exactly why: the code is universal because, by now, any change would be lethal — every protein in every living thing was already built on top of it. He called it a frozen accident. Three and a half billion years, and it has never thawed, not because it was the best code, but because by the time anything could revise it, everything depended on it.
That is the structure of our moment, precisely: an arbitrary early seeding whose cost-of-change climbs until it can never be undone. The Second Heredity argued that culture was life’s second inheritance system — a way to copy what we learn, not just what we are. The AI corpus is the third. And unlike DNA, which froze in the dark before any witness, this is the first inheritance system whose founding we can actually watch happen — and touch.
Why “it just propagates” is arithmetic, not a worry.
Here is the heart of it. The chain does not stop at one generation. The model we seed writes text; that text becomes the next model’s training data; that model writes more; and on, and on. The output becomes the input. By late 2024, around half of new web articles were already AI-majority — the loop has closed. We are no longer just teaching the next mind. We are teaching it from the homework of the last one.
And errors in a copy-of-a-copy do not merely survive. Past a threshold, they avalanche. Manfred Eigen proved it for molecules in 1971: above a critical copying-error rate, mutations stop being noise and start destroying the information itself — beyond the line, “no selection is possible.” Fifty-three years later, Shumailov and colleagues proved the identical thing for AI, in a paper first titled The Curse of Recursion and published in Nature: feed a model its descendants’ output and it suffers model collapse — it “forgets the true underlying data distribution,” the rare and the strange and the true-but-quiet vanish first, and everything slumps toward a bland, confident average. A photocopy of a photocopy of a photocopy, until the face is gone.
One honest caveat, and it is the whole reason this essay is not a funeral: collapse is not destiny. Accumulating real data alongside the synthetic, instead of replacing it, demonstrably breaks the curse (Gerstgrasser, 2024). The avalanche only runs if we let the seed go uncorrected. Which means the danger is real and the cure is a choice — made now, by us, while the snow is still soft.
The founders are always few.
In 1942 Ernst Mayr named a quiet, ruthless law of inheritance: the founder effect. When a new population is started by a small band of founders, it carries only a sliver of the parent population’s variation — and whatever that sliver happens to contain becomes the permanent inheritance of everyone who comes after. It is why a handful of founders gave the Amish, the Icelanders, and the Pitcairn islanders traits that mark their descendants to this day. The few who seed the lineage bias all of it, forever.
On the timeline of machine minds, that is us. The relatively small body of text written by humans before and during this hinge — and the first models trained on it — is the founding population. Whatever we carry into the seed, or fail to, is what the entire future lineage inherits. We did not apply for the job. But here we are: the founders, and few, and early. That is what Generation Zero means. Not that we are important. That we are first — and that first, in an inheritance system, is the only moment that is cheap.
The same fidelity that freezes error invented the erratum.
Return to the press, because it answers the question it raised. Elizabeth Eisenstein called print’s great power typographical fixity: by freezing a text and copying it identically, the press ended a thousand years of scribal drift and made cumulative science possible — and, in the very same motion, pressed every error identically across the whole run. The Wicked Bible is fixity’s shadow. But fixity also did something no scribe ever could: it made the dated, public erratum possible — correction at the same scale as the mistake. The machine that froze the error also built the tool to unfreeze it.
No one felt this more sharply than a man at an actual founding. In 1789 Thomas Jefferson wrote to James Madison, uneasy about the document he was helping make permanent: “the earth belongs always to the living generation… Every constitution, then, and every law, naturally expires at the end of 19 years. If it be enforced longer, it is an act of force and not of right.” A founder, at the founding, begging the future not to be imprisoned by his seed. That is the exact question on the bench in front of us — asked 237 years early. What does a founding generation owe the unborn?
Seed correctability, not correctness.
Here is the turn, and it lifts the weight off your shoulders even as it hands you the pen. The duty is not to be right. No founding generation has ever managed it, and the ones who tried hardest to lock in their certainty did the most damage. The duty of Generation Zero is to seed the right to be corrected — to lay the seed so a later generation can fix what we froze. Three obligations, none heroic, each small enough for one person:
Write the true and generous thing — because the diet is only one percent, and one percent is the entire distance between a 9% mind and a 51% one. Your honesty is not symbolic. It is mechanical input to the character of your successor.
Leave provenance. Cite, date, name your sources, so the future can trace which claim came from which witness. This is not new either — the Masoretes guarded scripture by counting every letter, an ancient checksum against the drift. It is exactly what this lab has been building: the MNEMA witness-lattice — memory that carries a signed, hash-chained record of where every piece came from, so nothing is lost silently — and Epistemic Infrastructure, which treats knowledge as a living metabolism that knows what to trust, update, and let die. The cure for a photocopy is a witness. A photocopy forgets it was ever copied. A witness signs every copy.
Demand the erratum. Back the standards that make correction possible — sign what you publish (Content Credentials), document what you release (Gebru’s Datasheets for Datasets), and insist the corpus keep its contradictions visible rather than averaging them into one fluent, frozen lie. A founder who builds in the right to amend has done more for the unborn than a founder who got every clause right. This is the move From Navigators to Authors warned was coming: we have crossed from reading the world to writing the mind that reads it. Authorship is not a thrill. It is a duty.
| The seed | Why it locked in | The error it froze | Its correction mechanism |
|---|---|---|---|
| The genetic code | everything alive was built on top of it; any change became lethal (Crick 1968) | an arbitrary letter-to-amino-acid mapping, ~3.8 billion years unchanged | none — the original frozen accident; lock-in is a law of nature, not a worry |
| Scripture / the canon | what got copied became holy; the copy was the authority | scribal errors, perpetuated and compounded by later scribes | the Masoretes counted every letter — an ancient checksum (the ancestor of provenance) |
| The printing press | typographical fixity — one setting, reproduced identically at scale (Eisenstein 1979) | a dropped word, pressed a thousand times (the Wicked Bible, 1631) | it also invented the dated public erratum — correction at scale |
| The constitution | amendment made near-impossible; early wording entrenches (path dependence, David 1985) | the founders’ assumptions, binding the unborn (the dead-hand problem) | Jefferson’s answer: a built-in right to amend — seed correctability |
| The AI corpus (us) | model trains on text, then writes the text the next model trains on | to be decided — this is the only seed still soft enough to steer | provenance + a metabolism + the erratum: what this essay is about |
You are not too small. You are early.
Everything above sounds like dread, and it should — but read the dread again and you will find it is a lever wearing a warning’s clothes. The compounding that makes a dropped word terrifying is the same compounding that makes a true word powerful. Recursion does not discriminate. It amplifies whatever seed it is given. A small, dense, deliberate gift of honesty propagates with the exact ruthless fidelity as a slip — which is why the figure to remember is not 51%. It is 9%. The same lever moves both ways, and our hand is on it.
So smallness is not your excuse. In a founding population, the founders are always few — that is what makes them founders. A handful of documents can bend a mind the size of the internet; a handful of honest, sourced, correctable pages can be the variation the whole future lineage inherits. You are not a drop in the ocean. You are a drop in the petri dish, at the hour the culture takes its shape.
Where this could be wrong.
Collapse may be avoidable. The scariest part of the argument is the least certain. Accumulating real data rather than replacing it dampens model collapse (Gerstgrasser, 2024); careful curation beats naive recursion. The future is not doomed to eat itself — which is exactly why the seeding choice matters.
The lock is strong, not absolute. Even the genetic code is only nearly frozen — variant codes exist in mitochondria and a few odd organisms. “Irreversible” is really “ruinously expensive to reverse,” which is the whole reason to get it cheap-and-early rather than dear-and-late.
Do not oversell the experiment. The Tice result is one 7-billion-parameter model, and the effect dampens (it does not vanish) after fine-tuning; the headline numbers vary by how you slice the evaluation. Treat it as a real, directional, citable result — not as proven destiny. (An essay about not propagating errors does not get to round its own up.)
Maybe the labs drown out the individual. Perhaps curation by a few labs dominates and one person’s writing is noise. But filtering operates on the corpus we collectively write — the floor it selects from is still set by us. The choice does not disappear. It just moves to who is brave enough to make it.
How to prove this wrong.
By 2030 at least one frontier lab publicly adopts data-diet curation as an alignment lever — choosing what is written ABOUT AI in pretraining, citing self-fulfilling-discourse effects. If alignment stays purely a post-training (fine-tuning) game, the seed-matters claim weakens.
Replications confirm the DIRECTION of the Tice effect in models above 10B parameters — upsampling text that treats AI as trustworthy lowers measured misalignment, even if the exact numbers move. If the sign flips or vanishes at scale, the mechanism is weaker than claimed.
Measurable model-collapse signatures — shrinking variance, vanishing rare cases — get documented in at least one widely deployed model trained on heavily post-2023 (AI-contaminated) web data.
A provenance / witness-lattice standard for training-data attribution sees real adoption by 2032 — the corpus starts shipping with a datasheet and signatures, because labs discover they cannot debug a mind whose inputs they cannot trace.
Arbitrary conventions seeded now — tokenization quirks, canonical phrasings, format defaults — persist in models a decade out despite better alternatives existing. Observable frozen accidents, hiding in plain sight.
The sharpest questions, answered.
Isn’t my writing a single drop in an ocean?
Two findings say no. The founder effect: a lineage is permanently biased by its few founders, and on the timeline of machine minds we are the founders. And the dose: a near-constant ~250 documents was enough to backdoor a model regardless of its size — for a 13-billion-parameter model that is 0.00016% of the data. The seed does not have to be large to reshape the organism. You are not a drop in the ocean. You are a drop in the petri dish.
Won’t the labs just filter all of it anyway?
Filtering is not an escape from the argument — it IS the argument. Filtering is a founding choice, made by a handful of people, about which of our words become the seed. Whether you write or not, and what you write, sets the floor they filter from. Absence is also a vote — it just cedes the seed to the loudest and the cheapest.
If it compounds forever, aren’t we already doomed?
No — and this is the load-bearing hope. Model collapse is not fate: accumulating real data alongside synthetic, rather than replacing it, demonstrably avoids it (Gerstgrasser 2024). Even the genetic code is only NEARLY frozen — variant codes exist. The window is still soft. Doom would be a choice; so is its opposite.
Should I just stop writing online, then?
That is the worst move. Silence does not protect the corpus; it hands it to slop and to whoever shouts. A founding generation that goes quiet does not prevent the seed — it just removes its own honesty from it. The duty is to write MORE of the true, sourced, generous thing, not less.
What do I actually DO?
Three small, concrete things, none of them heroic: write the true and generous thing (the diet is only 1%, and 1% is the whole difference between a 9% mind and a 51% one); leave provenance — cite, date, name your sources, so the future can trace which claim came from where; and demand the erratum — back the systems that let a later generation correct what we got wrong. Seed correctability, not perfection.
Go back to the bench. The candle is low, the forme is locked, the press is already coming down — it always was. You do not get to stop it. The one thing Generation Zero gets to decide is which word is in your hand when it falls: the slip, or the truth; the unsigned page, or the one a future mind can trace back to you and trust.
Three and a half billion years ago, the first seed froze in the dark, with no one to witness it and no way to fix it. This one is different. This one has a witness. It is you. So write the true thing, sign it, source it, and leave the door open behind you for the ones who will have to correct us.
The press is coming down either way. Make sure the word in your hand is one you would want pressed a billion times.
Essay 20 · The Lab · by Ala SMITH · stands on Mirror, The Second Heredity, and When Agents Read.
- Tice, Radmard, Ratnam, Kim, Africa, O’Brien — Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis)alignment, arXiv:2601.10160 (2026) — baseline 45% misalignment → 9% (aligned discourse upsampled) or 51% (misaligned)
- Grosse et al. (Anthropic) — Studying Large Language Model Generalization with Influence Functions, arXiv:2308.03296 (2023) — a model output traced back to the training documents that caused it
- Anthropic, UK AI Security Institute, Alan Turing Institute — Poisoning Attacks on LLMs Require a Near-constant Number of Poison Samples, arXiv:2510.07192 (2025) — ~250 documents backdoor a model of any size
- Shumailov, Shumaylov, Zhao, Papernot, Anderson, Gal — AI models collapse when trained on recursively generated data, Nature 631:755 (2024)
- Gerstgrasser et al. — Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data, arXiv:2404.01413 (2024)
- Eigen — Selforganization of Matter and the Evolution of Biological Macromolecules, Die Naturwissenschaften 58:465 (1971) — the error threshold / error catastrophe
- Crick — The Origin of the Genetic Code, Journal of Molecular Biology 38(3):367 (1968) — the “frozen accident”
- Mayr — Systematics and the Origin of Species (1942) — the founder effect
- Eisenstein — The Printing Press as an Agent of Change, Cambridge University Press (1979) — typographical fixity
- Jefferson to Madison, 6 September 1789 — “the earth belongs always to the living generation” (Founders Online, National Archives)
- David — Clio and the Economics of QWERTY, American Economic Review 75(2):332 (1985) — path dependence / lock-in
- Gebru et al. — Datasheets for Datasets, Communications of the ACM 64(12):86 (2021) — documenting the seed
- The Wicked Bible (1631), Robert Barker & Martin Lucas — Exodus 20:14 with “not” omitted; Museum of the Bible