the blessing
and the toll
published
jul 2 2026
tags
ai, work, institutions, accountability
reading time
11 min
submission
There is a particular word that gives the arrangement away. You submit. You submit a pull request, a design for review, a manuscript, a claim. The word is older than all of these uses, and it has kept its oldest meaning intact: to submit is to place oneself under. Somewhere upstream of the thing you made sits a person or a body whose function is not to make anything but to permit it. Approval. Sign-off. Clearance. The imprimatur — literally, let it be printed. You do the work; someone else decides whether the work is allowed to become real.
Whoever that someone is, they are rarely thanked and often resented, and the resentment survives even a gatekeeper who is careful and right on the merits. The same charge builds around a compliance desk, a licensing board, a planning inspector, a peer reviewer, an editor. The shared arrangement is simple: someone can do the work, has the competence to do it, and still cannot proceed until a second party, who did not do it, gives permission.
Not every gate is worth arguing about. Some protect ownership, consent, or the plain right to decide what happens to what is yours. The gate worth examining is the other kind, the one that justifies itself by knowing better: the senior who signs off because they understand more, the credential that vouches for its holder to people who have no other way to know. These rest on a claim about competence, and a claim about competence is exactly what artificial intelligence has begun to unsettle.
You have probably seen the worry stated plainly, more than once. The machines will do the work, and the people who did it will have nothing left to do. That fear is real and near at hand, and nothing here is meant to wave it off. But the reassurance that follows it deserves its own scrutiny: the work will move up a level, and the displaced will become the ones who verify, approve, orchestrate, and evaluate what the machines produce. As a guess about where some jobs go, this is reasonable enough. As a picture of work worth wanting, it assumes too much. That is the assumption worth slowing down on.
A claim about competence is exactly what artificial intelligence has begun to unsettle.
what the machine leaves behind
Two things we usually picture as one can be separated. There is the making of a thing — the diagnosis, the drawing, the code, the argument. And there is the authorizing of it: the act that lets the thing count, circulate, and bind. For most of history the same hands did both, so we had no reason to see them as two things at all. The medieval guilds are the plain case. The master's mark stamped on a finished piece did two jobs at once: it told a buyer the work was sound, and it kept out anyone beyond the guild who might have competed.
Sociologists have a name for the second job. They call it professional closure, the tendency of a trade to protect its members by controlling who is let in. The hard part is that closure and quality almost always come bundled. When the United States remade medical training after the Flexner Report of 1910, it raised the floor of what a doctor had to know, and the same reform shut down many of the schools that had trained poorer, rural, and Black physicians. One act did both, and there is no clean way to keep the good it did apart from the harm.
What kept the two bundled — what kept the resentment from boiling over — is that the person at the gate could usually do the work too. The master could make the shoe. The senior physician knew more medicine than the resident. The editor could, in principle, write the piece. Authorization rested on top of competence, and because it did, you could never quite say whether the fee you paid bought the assurance or the permission. That blurring flattered everyone it touched. It let the arrangement look like protection even where it worked as a toll, and it let the people collecting the toll believe the gentler version of what they were doing.
This is the bundle the machine pulls apart. Once a system can produce the work as well as the person who used to hold the gate, or better, the competence is coming from somewhere else, and the gate is left standing without the thing that held it up. The gate does not fall. What falls away is the justification — the quiet belief that the gate was doing more than gatekeeping. And once that belief is gone, we are left holding an itemized bill, asked for the first time to say what the permission was ever worth on its own.
The gate is still standing. The reason for it is gone.
one hundred dollars for a signature
The clearest place to read that bill is a case that stands for many others. Suppose a system can read a chest radiograph and produce a report as accurately as a board-certified radiologist — not in a staged demonstration but in ordinary practice, which is roughly where the field has been heading, and roughly why radiologists keep appearing on the lists of jobs said to be at risk. Suppose that before the report can enter a medical record and guide treatment, a physician still has to put a name to it, and that the signature costs a hundred dollars. The reading itself came from the machine. Whatever the hundred dollars is buying, it is no longer buying the read.
Whatever the hundred dollars is buying, it is no longer buying the read.
So what is left for it to buy? The reading is done, and done well, which means we are paying for something other than the reading, and the honest thing is to sit with what that could even be. What surfaces is not a tidy list so much as a braid, and the strands are hard to pull apart.
The sturdiest of them is accountability. A machine can produce a report but cannot be held to it; it cannot be sued, struck from a register, or made to answer for a cancer it missed. Everything we have built for catastrophic error — malpractice law, insurance, professional discipline, the plain need of a grieving family for someone who will answer — rests on persons who can be named and made to pay. The signature turns a probabilistic output into an accountable act, and there is a case, not a weak one, that a hundred dollars is cheap for a human who has staked a license on being right.
Wound through that is something quieter: every so often the human catches what the machine got wrong. The value is real, but it is back-loaded. To the person paying, the ordinary cases are all that show, and in each of them the gate looks like friction and nothing more.
And running alongside both is the toll: the chance that the signature is required not because it adds accountability or catches error but because permission has become an asset of its own. New York City's taxi medallions are the extreme case: the right to operate became something valuable enough to borrow against, defend, and be ruined by when the arrangement broke. None of this needs bad faith. A profession can sincerely believe its sign-off protects patients and at the same time be defending an income, and the sincerity settles nothing.
The reason this resists a clean verdict is that the three sit inside the hundred dollars at once, in a proportion no one outside can measure. The person paying reads the whole of it as toll. The profession reads the whole of it as accountability. Both are motivated, and the truth is a ratio neither side can see and neither is much inclined to look for.
The person paying reads the whole of it as toll. The profession reads the whole of it as accountability.
taste
The radiograph is the easier case because the work is mostly a matter of getting it right — is the shadow a tumor or not. A great deal of work is not like that. Send a design, a paragraph, a room, or a menu past someone for approval and the answer is seldom correctness. What you are asking is whether the thing is any good, and taste is not error-checking. It is judgment along dimensions that have no right answer, only better and worse, and a better and worse that belong to some particular sensibility rather than to the world.
What is interesting is that some professions are built around taste, professionally exercised. The editor, the designer, the chef, the curator: their value is not that they can certify correctness after the fact, but that they can tell whether something is alive, coherent, proportioned, worth keeping. In that kind of work, it is not clear the machine has done the work at all; it may have produced something competent and lifeless, while the person at the gate is supplying the thing that was wanted in the first place. The bundle never came apart. To call that person a gatekeeper can misread what they are doing: they are doing the work, only at the end of it rather than the start.
Taste is not error-checking.
It is also the least legible standard there is. You cannot fully write it down, cannot quite prepare for it, cannot argue with it as though it were a checklist. Which may be why the gates that turn on taste — the design review, the editor's this isn't quite there — draw the most personal and least answerable resentment of all, even when the taste behind them is real and good.
what to ask of a gate
None of this can be measured from the outside, but it can be interrogated. Put almost any gate to a few questions and the accountability begins to separate from the toll.
Reversibility. When the decision cannot be undone and its downside is grave, verification is doing real work. When the decision is cheap to reverse, the gate is often buying delay.
Exposure. Does the verifier carry the consequence of their own blessing? Where the verifier holds the gate and eats the downside of a bad call, there is a discipline inside the arrangement. Where the verifier bears no cost for how they use it, you have power without exposure, and people are quick to sense that even when they cannot name it.
Asymmetry. Does the verifier actually know something the doer does not? The senior clinician checking a trainee's read knows more medicine, and the gate doubles as teaching. The functionary enforcing a rule the doer already understands knows no more than the person waiting, and the gate is pure position. The strange new case is the human verifier signing off on work they could not have produced as well, holding a gate whose competence now lives on the far side of it.
Legibility. Can the doer tell in advance whether they will pass? Where the standard is written down and stable, the gate behaves like a checklist. Where the criteria are matters of taste that cannot quite be stated, the gate feels arbitrary and personal, because the person waiting cannot even prepare.
Run the examples through the questions and they sort. A structural engineer's stamp is hard to reverse, exposed, backed by real knowledge, and reasonably legible. A cosmetology license required to braid hair — a real requirement in many states, and a favorite of the licensing critics — is low-stakes, unexposed, and rests on no knowledge the braider lacks; it lands near pure toll. Code review sits in the middle and turns on culture. Healthy where the reviewer shares the fallout of a bad merge, corrosive where it is a ritual of status.
The felt injustice of a review gate is seldom that it says no. It is that saying no costs the one saying it nothing.
the wage detaches from the skill
This is where the abstractions touch a working life. If the machine does the read and the human supplies the signature, the wage has come loose from the skill: the physician trained for a decade to interpret images is paid now not for the interpretation but for being a legal person who can answer for it.
Madeleine Clare Elish gave this arrangement a name from the study of automation — the moral crumple zone, where the human kept in the loop of a mostly automated system ends up absorbing the responsibility the system cannot hold, positioned less to prevent failure than to take the impact when it comes. The signature can become exactly that: a person held liable for a judgment they no longer meaningfully make, kept on so that someone remains to point at.
The difference is whether the signature stays tied to real judgment. The physician who reviews uncertain reads and overrides the wrong ones is doing something real. The physician who signs a thousand reads an hour without opening them is performing an accountability that no longer happens.
The same seat holds both, and which one a person occupies is not always theirs to choose. Whoever collects the toll did not build the machine that hollowed out their expertise, and often the gate is the last thing between them and no livelihood at all. You can think a toll unjustified and still owe its holder that much: the case against the gate and the sympathy for the person standing in it do not cancel.
The wage has come loose from the skill.
a society of verifiers
Widen the lens from the single signature to the whole economy, and the essay's first question returns. If the displaced become the ones who verify, approve, and evaluate, then everything depends on whether that work stays tied to consequence and judgment or floats free as a toll.
Tied to real accountability and real work on the hard cases, a society of verifiers is a decent enough division of labor: machines on the mechanical part, people on the part that needs someone to answer for it. Floated free — the judgment automated away, the consequence insured and diffused, the gate still charging for passage — it becomes an economy of empty blessings.
Machines can leave us with accountable judgment, or with empty blessings. The technology does not choose between them.
None of this collapses into a rule; it has to be worked out one gate at a time, through the fog. But the version worth wanting is not vague, and it helps to name it, so we know what we are reaching for.
It looks like the reviewer who opens the file instead of stamping it, catches what the machine misread, and in the catching gives the machine the thing it did not know — so that the person is not the friction in the system but the place it learns. It looks like the work where taste or judgment is the whole substance, where the human never stopped being the maker and the machine only set the table. It looks like keeping, for people, the older seat of deciding what is worth making at all.
None of that is a consolation invented to soften the losses. It is a real and better division of labor, and it is within reach — though it is not what we drift into. It is what we would have to choose, gate by gate, by insisting each time that the blessing stay tied to the thing that made it worth having in the first place: someone who looks, and who can answer for what they see.
connect
built with/colophon