Five Steps to Governed AI

Chapter Two

Where the ROI Disappeared


Three ways firms invest in AI without changing the cost of operations. Every one of them stops one step short of return.

Most AI investments stop delivering return after the first demo.

Rarely because the technology is wrong. Usually because nothing governs how an output gets proven, which means nothing reaches production. Here is what each pattern looks like from inside the firm.

PATTERN 01Spent on tools, not operations

The CFO approved six AI tools this year. Operating cost per account has not moved. Each tool does one narrow thing well, and the operations that actually cost money are untouched: billing, onboarding, reconciliation.

PATTERN 02Spent on building, not proving

The CTO’s team has been building for eighteen months. The board still asks how anyone knows the output is right. Years of development and tens of millions invested, with no agreed method for answering that question.

PATTERN 03Spent on demos, not production

The COO saw it work in March. It is August and nothing runs on live accounts. Someone asked how they would know an output was right, nobody could answer, and no production date was ever set.

Figure 2.1

Three routes, and where each one stops.

AI ADOPTEDSOMETHING WORKSTRUSTWORTHYIN PRODUCTION
Spent on tools, not operations
Narrow wins at the edges. Billing, onboarding and reconciliation, the work that sets the cost base, runs exactly as before.
Spent on building, not proving
Years and tens of millions in, with everything built except the last piece: an agreed way to show an output is right.
Spent on demos, not production
The demo convinced everyone except compliance, whose one question never got an answer, so a production date never got set.
WHERE IT SITS
AI handles tasks nobody was measured on. The operations that drive cost are unchanged.
THE RESULT
Budget spent, demos presented, and no change to operating cost or capacity.
THE GAP
Nothing between a system that works and one that returns anything. The missing step is proof.
The gap, in all three
Between a system that works and one that delivers return there is one missing piece: the discipline for proving the output is right. Without it every investment stops at the demo.
What is missing

A standard for proving the output, so the investment can reach production

The cost

Every quarter run manually is a quarter the investment returns nothing

Why the investment stalled

The AI was capable. It did not know the business, and nothing was built to prove it had followed the firm’s rules. Not a technology failure. A proof failure.


WHAT WAS BUILT
Something that worked in a demo, on data someone chose.
WHAT WAS NEEDED
Proof it would be right on the accounts nobody chose: the exceptions, the edge cases, the ones that cost money when wrong.

The return · 1 of 2

What it costs to run without the discipline.

Five places the gap between “it works” and “we can prove it works” shows up on the operating line. Every figure here is carried every quarter, not once.

Fee accuracy$50K–$150KIn errors a year, found at the annual review after the client has already paid.
Answering “how do you know?”40 hrsOf senior time per request, reconstructing six months out of email and memory.
A key person leaves6 monthsFor a new hire to reach the same judgment. The process rebuilds from zero and errors compound in the gap.
The board asks for proofDaysSenior people pulled off revenue work to assemble records nobody kept as they went.
Capacity1 : 1Every new account adds headcount. Growth costs in proportion to the work won.

CARRIED TOGETHER  A firm running these five operations by hand carries all five costs at once, every quarter, and none of them appears as a line item anyone owns.

The return · 2 of 2

What replaces it when the output is provable.

Same five operations, same order. The discipline does not make the work faster. It makes the answer hold, which is what removes the cost.

Fee accuracyZeroErrors caught before invoicing. The client never sees them, so there is nothing to refund.
Answering “how do you know?”SecondsAn export. Produced in the time it takes to ask for it, by whoever was asked.
A key person leavesNo rebuildThe process survives the person. Written, signed and still running.
The board asks for proofImmediateShare the record. It assembled itself while the work was happening.
CapacityFlatGrow without proportional hiring. The discipline scales.
How to measure the return
Most firms measure AI by activity: hours saved, tools adopted, demos shipped. Activity is not return. The return is four numbers: cost per unit of work, errors reaching clients, time to answer an audit, volume per head. Worksheet 04 turns them into your firm’s numbers.

The number every board has seen

95%

of AI pilots never reach production. The technology was never the reason.

MIT NANDA, The GenAI Divide, 2025