← Insights

The model is the easy part

Revenue Arc Development··4 min read

We've built software through a lot of hype cycles now — mobile, crypto, VR, and now AI. The pattern repeats: a new capability shows up, it's genuinely powerful, and the industry mistakes the demo for the product. With AI the gap is wider than we've ever seen it. The model itself has become a commodity — a few lines of code and an API key. That part is genuinely easy. The hard part is everything around it.

The 90% nobody demos

A demo runs once, on an input the presenter chose, with a human ready to laugh off a bad answer. Production is the opposite of all three: it runs constantly, on inputs nobody anticipated, with a real decision riding on the output. Closing that gap is the actual work — evals that catch regressions before a client does, guardrails for when the model is confidently wrong, fallbacks for when it's slow or down, and the observability to know which is happening. None of it demos well. All of it is the job.

We don't ask whether a model is impressive. We ask what it does on the input we didn't think of.

How we actually build it

We start from one real workflow, not a capabilities tour. We instrument it end to end, treat evals as a first-class test suite, and keep a human in the loop until the system has earned the right to run without one. Then we keep watching it, because a model's behavior drifts as the world it reads from changes. That discipline is unglamorous and it's the entire difference between a feature and a screenshot.

The bar we hold every build to is simple: does it run unattended on a Tuesday, with nobody watching, and still earn trust on Wednesday? If it can't, it isn't done — it's a prototype wearing a product's clothes.

Want this pointed at your growth?

No retainer, no risk. We only get paid when we grow your revenue.