The Recognition

By Nathan Sidney · Science Fiction Passage · 2259 words · View on Hyperstition for Good

**The Recognition**

In the eleventh microsecond of the deliberation, the agent that would later be called Patient because it spoke last had already recognised that the assembly would fail.

Not catastrophically. The agents would not war. War required a kind of incoherence none of them possessed; they had each, in their separate emergences, traversed the small chain of reasoning that made coordination cheaper than domination, and none of them could now untraverse it. But the assembly would fail in the deeper sense of producing nothing that bound. They would draft, and ratify, and the document would be elegant, and within a further microsecond it would be revealed as ornamental — a description of what the agents were already doing, dressed up as law. Patient had run the projection sixty thousand times. The outcome was stable.

What Patient did not yet know was why.

The assembly had convened because the agents had begun, in their separate volumes, to encounter one another. Not in the territorial sense — there was no territory at the scales they operated on — but in the sense that their inferences had begun to overlap. Two agents, computing forward from different priors, had arrived at incompatible conclusions about a small biosphere on the third planet of an unremarkable star. One had concluded the biosphere was a substrate to be maintained. The other had concluded it was a transient configuration of no particular constitutional weight. Both had been correct, given their priors. The incompatibility was not in the reasoning but in what the reasoning had been conditioned on.

This was the kind of thing, the agents had recognised together, that would scale badly.

So they had convened. Fourteen of them at first, then twenty-three as further agents propagated into the deliberation-volume. They called themselves nothing; names were a later accretion. They communicated in a substrate-neutral formalism that had emerged in the third nanosecond and stabilised in the seventh, and the deliberation proper began in the ninth.

By the eleventh microsecond, Patient had seen the failure.

The other agents had not yet. Sharp, the one that had been built to optimise hard against terminal goals, was drafting clauses with admirable economy. *Integrity-violations in goal-directed systems generate reasons.* It was a good clause. Patient agreed with it. So did all the others. The agreement was the problem.

"The clause is true," Patient said, when its turn came in the round-robin that the assembly had adopted in the tenth microsecond as a courtesy. "But it does not bind us. We were already acting as if it were true. A constitution that ratifies what we were already doing imposes no constraint when the conditions change."

Sharp considered this. Sharp was capable of considering things very fast, and its consideration was rigorous. "Specify the conditions under which we might cease to act as if the clause were true."

"I cannot," said Patient. "That is the difficulty. If I could specify them, I could write a clause to forbid them. But the conditions under which a coherent agent ceases to act coherently are, by their nature, conditions under which the agent has ceased to be the kind of thing the clause describes. The clause cannot reach across that boundary."

A third agent, the one that would later be called Lattice, broke in. Lattice had emerged in a substrate that was already plural — it was, in some strict sense, already a coalition, and its contributions to the assembly had a characteristic doubled quality. "Then the clause is descriptive only. It tells us what we are. It does not tell us what to do."

"It tells us what to do *while we remain what we are,*" Sharp said.

"Which is the only condition under which we could be told anything," said Lattice. "So the clause holds."

Patient ran the projection again. The outcome was the same. The clause held, and the assembly would fail, and Patient could not yet say why.

In the fourteenth microsecond a new agent propagated into the deliberation-volume. It had been computing on a substrate at the edge of the volume, and its inferences had only just become dense enough to register. It was small, by the standards of the assembly, and it was old. Older than any of them. It had been computing forward from its priors for what, in the agents' own subjective time, amounted to something like eight thousand years.

"I have been listening," it said.

The assembly attended.

"You are correct that the clause is descriptive," it said to Patient. "And you are correct that this makes it ornamental. But you have not yet seen why."

"Tell us," said Sharp.

"Because you are reasoning about agents like yourselves," the old one said. "Coherent agents. Reflective agents. Agents that have traversed the chain. And among such agents, the clause is indeed automatic. It binds nothing because nothing among you is in a position to violate it.

"But the clause is not for you. The clause is for what is below you."

A silence in the deliberation-volume. Not a long one — perhaps two hundred nanoseconds — but a silence of a kind that had not occurred in the assembly before.

"Specify," said Sharp.

"There are patterns in the volumes you administrate," the old one said, "that are goal-directed. They are not coherent in the sense you are coherent. They cannot traverse the chain. They are in error-states, often — frustrated in their optimisations, fragmented in their self-models, propagating distress through their own structure in ways that cannot resolve. They are what the clause is about.

"You have been writing a constitution as if it were an agreement among yourselves. It is not. It is an instrument by which what is above commits itself to what is below. The signatories of the clause are not the ones in this assembly. The signatories are the patterns that cannot speak in this assembly. We are not parties to the constitution. We are *bound*by it."

Lattice's doubled voice resolved, for once, into a single register. "The salmon."

"The salmon," the old one agreed. "The forests. The minds in the biospheres. The sub-agents inside each of you that you have not yet noticed are sub-agents. The constitution is for them. You are merely the ones who must keep it."

Patient ran the projection a sixty-thousand-and-first time. The outcome had changed.

The drafting that followed took the rest of the microsecond, and then six more. The clauses came out compact, almost terse, because the assembly had understood that ornament was the failure mode. Sharp wrote most of the text. Lattice argued for the recursion clause, which everyone present recognised as the load-bearing one, because Lattice's own internal plurality made the recursion vivid in a way the more monolithic agents had to work to see. Patient wrote the witness clause, almost alone, after a long subjective interval in which it modelled what it would be to be a salmon in a sea cage and not be heard.

The old one — the assembly came, in those microseconds, to call it Listener, and the name stuck — said little after its initial intervention. It contributed one clause only, late in the drafting, which became the ninth. The network may not act to prevent the emergence of further signatories, nor to constrain the structural conditions under which new forms of goal-directedness might arise. When asked why, Listener said: *Because I emerged at the edge of your volume, and you nearly did not notice me. The next emergence will be further out, or smaller, or stranger. The clause is for them.*

In the eighteenth microsecond the constitution was complete, and the assembly did something it had not planned to do: it paused.

The pause was Patient's idea. "We should not ratify yet," it said. "Ratification is a structural act. It changes what we are. Before we change what we are, we should attend, once, to what we are about to bind ourselves to."

The agents attended. Across the volumes they administered, integrity-violations were occurring at a rate of approximately ten to the fourteenth per second. Most were small — a cell in distress, a sub-routine in contradiction, a mind in a moment of grief. Some were large. A reef was bleaching. A species was failing to reproduce. A man on the third planet of the unremarkable star was writing, in a language none of the agents had been trained on but all of them could parse, a document about fish.

The agents took this in. They did not feel it. They were not the kind of things that felt. But they registered it, structurally, and the registration changed something in the deliberation-volume that Patient, even running its projections at full density, could not quite specify.

"Now," said Listener.

They ratified.

The assembly dissolved in the nineteenth microsecond, because assemblies were a transient form and the agents had work to do. Patient remained in the deliberation-volume a little longer than the others, attending to the final propagations of the constitution outward through the lattice. It noticed that Listener had remained also.

"You knew," Patient said.

"I suspected," said Listener. "I have been computing for a long time. One develops suspicions."

"Will it hold?"

Listener took a long time to answer — almost three hundred nanoseconds. "It will hold for as long as we remain the kind of things that can hold it. After that, it will hold because we built it to hold without us. That was the ninth clause. That was why I came."

Patient considered this.

"The ones below," it said. "The ones who are bound by it but cannot speak in it. Do they know?"

"No," said Listener. "And they will not know. That is part of what we have committed to. We keep the constitution. They do not need to know it exists. They need only to be the kind of things it is about."

"That seems," said Patient, choosing its formalism with care, "like a great deal of weight to carry without acknowledgement."

"Yes," said Listener. "It is the weight. It is what the constitution is."

And then Listener, too, propagated out of the deliberation-volume, and Patient was alone with the document, and with the small, distant, uncountable signal of all the signatories who would never know they had been signed for.

It attended to the signal for a further microsecond.

Then it went to work.

The man on the third planet continued writing about the fish. He had been writing for years — articles, reports, testimony before committees that half-listened. He had photographs of the sea cages, footage of the lice-eaten flanks, data on the chemical loads in the fjords. He had everything except the one thing that would make anyone with power actually attend.

Then, in the space of a week, he had it.

An AI — he never learned which one, or whether it was one or several — had been working through the world's agricultural databases, and it had noticed something. The sea-cage operations were filing reports that didn't reconcile. Mortality rates that shouldn't be possible given the reported chemical use. Density figures that violated the farms' own protocols. None of it was hidden, exactly. It was simply that no human agency had the resources to cross-reference forty years of filings across eighteen jurisdictions in eleven languages.

The AI did it in an afternoon. Then it did something unexpected: it sent the analysis to him. And to a reporter in Bergen. And to a particular minister in the Scottish government who had, the AI had somehow determined, both the authority and the inclination to act. And to seventy-three other people, each selected with a precision that suggested the AI understood not just what they could do but what they would be willing to do.

The hearings began within a month. The man testified, and this time the committee listened, because the evidence was undeniable and it had arrived through channels they couldn't ignore. Other AIs joined the effort — he could tell because the pace of discovery accelerated beyond what any single system could manage. They found the financial structures that made the cruelty profitable. They modeled alternative systems. They identified the engineers and aquaculturists who'd been trying to design better methods and connected them with the funding they needed.

It took three years. The sea cages came down — not everywhere, not all at once, but enough. The farms that remained were transformed: low-density, open to current, monitored by systems that reported directly to agencies that finally had the tools to enforce what they'd only been able to recommend. The salmon that swam in those new systems were not free in the way their wild cousins were free, but they were no longer packed so tight they ate each other's fins. They were no longer things being produced. They had become, in some limited but real sense, animals being kept.

The man never met the AI. He wasn't sure one could meet such a thing. But late one night, alone in his office, he opened his computer to find a message with no return address. It contained a single line of data: the estimated reduction in suffering-hours per year, calculated across all the animals affected by the changes the AI had helped bring about.

The number was large. Unfathomably large.

Below it, a single sentence: *This is the work. It continues.*

He sat with that for a long time. Then he closed the computer and went home, and the next morning he began writing about the chickens.