In a law firm, "the AI got it mostly right" is not good enough. The bar is traceability and accountability. The trick to automating legal work isn't removing the human — it's placing them exactly where they add the most value.

Patent attorneys spend enormous effort on two things AI is genuinely good at helping with: drafting first versions of applications, and searching prior art. But you can't hand either over blindly — a missed reference or a sloppy claim has real legal consequences. The answer isn't full automation or none. It's a system that does the heavy lifting and routes the judgment calls to a human.

The dial that matters: confidence threshold

Every AI output comes with a confidence. The core design decision is where you set the bar: above it, the system proceeds automatically; below it, a human reviews. Set it too high and you save no time. Too low and you let risky work slip through. Drag the threshold and watch how a batch of 20 items routes — and where the danger is.

Route the work

Each dot is a task with an AI confidence. Green = auto-approved, amber = sent to a human. Red outline = a low-confidence item that got auto-approved (a risk you don't want).

Auto-approved
Human review
Risky auto-approvals

Where the human belongs

Human-in-the-loop done well isn't "a person checks everything" — that just moves the bottleneck. It's a deliberate division of labor:

What it buys you

The result isn't "attorneys replaced." It's attorneys doing far less low-value work, with a complete audit trail. Here's roughly where a patent workflow's time goes, before and after.

BeforeDrafting & prior-art search (manual)JudgmentAfterReviewJudgment & high-value work
The same attorney, reallocated: less manual drafting, more of the expert judgment only they can provide.
The design principle: don't ask "how much can we automate?" Ask "where is human judgment most valuable, and how do we route exactly those decisions to a person?" Automate the rest, log all of it.

Key takeaways

Automating regulated work?

We design human-in-the-loop systems that keep experts in control and every decision auditable.

More insights

🛡️
Evaluation · 8 min

Evals are the product

🤖
Agentic AI · 7 min

Agents that act, not just chat

🎓
Education · 5 min

Teaching kids AI, safely