Never surrender judgment
Name the decisions that stay with a person, before anything is running.
By the end of this lesson
- Identify which decisions in your design carry real consequences
- Name the person accountable for each, not the role
- See why this has to be settled in advance
Watch
Episode B06
The video for this lesson has not been produced yet. The narration below is the same script, and it plays now.
Transcript
AI can recommend what to buy. What to read. Where to go. And increasingly—what decision might be most efficient. But efficiency is not conscience.
The final step of the BEACON Framework is: Never Surrender Human Judgment. Some decisions require more than intelligence.
AI can analyze evidence. Generate scenarios. Compare alternatives. Surface risks. And help us consider possibilities we might otherwise miss. Use all of that.
But never outsource: conscience, compassion, moral responsibility, dignity, or the recognition of another person’s human worth.
If a consequential decision harms someone, we cannot say: “The algorithm decided.” A tool can inform a decision. A human must remain responsible for making and defending it.
Before delegating an important decision to AI, ask: Who is accountable? Who could be harmed? What human value might the data fail to capture? And who has the authority to say no?
The goal is not human judgment without intelligence. Or intelligence without humanity. It is better human judgment—supported by extraordinary tools.
Technology can expand our power. Virtue must govern what we do with it.
The lesson
Some decisions can be handed over and most of the interesting ones cannot. Anything touching conscience, due process, or somebody's standing in the eyes of an institution stays with a person, and the reason is not that the tool would necessarily decide badly. It is that consequences land on people, and accountability has to land somewhere too.
The requirement is a name. 'A human reviews it' is not an answer, because when something goes wrong the review turns out to have been everybody's job and therefore nobody's. Write down who. If you cannot say who, the decision is currently unowned, and that is worth knowing now rather than later.
Doing this in advance matters more than it appears. Under pressure — a deadline, a backlog, a bad week — a decision that was never explicitly reserved will quietly get automated, because automating it is the path of least resistance and nobody agreed not to. Naming it beforehand is what makes that a visible choice rather than a drift.
This is also the step that most often improves a design rather than constraining it, because working out which decisions are consequential usually reveals that most of them are not, and those can be automated with a clear conscience.
Straight from the framework
N — step 6 of 6
Never surrender judgment
Which decisions here stay with a named, accountable human?
Conscience, due process, and dignity are not delegable.
Do this in the app
Put the lesson down somewhere real
Answer the sixth worksheet field, naming the decisions that stay with a person and who that person is.
Done when — All six steps are answered and the worksheet shows six of six.
/dashboard
Go further
Check yourself