The LeagueOf Extraordinary PeopleSchedule a call

Meanwhile, in pilot purgatory…

Why AI pilots stall (and what electrified factories teach us)

AI pilots stall because the people who know where the hours go don't have time to learn AI, and the people who know AI don't know where the hours go. Factories hit the same wall with electricity. It took them about four decades to get past it.

The villain

Why do AI pilots stall?

AI pilots stall because nobody in the room understands both the work and the tools. Your leadership team knows where the hours go: the report that eats every Thursday, the approval that waits in someone's inbox, the customer emails answered by copy and paste. They don't have time to learn AI. Vendors and consultants know AI, but they don't know where your hours go, and nobody pays them to stay until it ships.

So companies do the reasonable-looking thing. They buy licenses, run a pilot, applaud a great demo, and very little reaches production. We call it pilot purgatory.

In a report dated July 2025, MIT's NANDA initiative found that only about 5% of enterprise generative AI pilots were producing fast revenue gains. The rest delivered little to no measurable impact on the P&L. (The preliminary study drew on 52 interviews, 153 survey responses from senior leaders and a review of more than 300 public AI initiatives.)

Previously, in 1882…

What happened when factories got electricity?

Factories got electricity decades before they got the productivity, because they plugged the new motor into the old floor plan. The economist Paul David told this story in 1990, in a paper called "The Dynamo and the Computer." His line: in 1900, you could have seen dynamos everywhere but in the productivity statistics.

  1. 1882

    Pearl Street Station

    Edison's Pearl Street Station in Manhattan starts generating on September 4, lighting 400 lamps for 82 customers.

  2. 1899

    Under 5%

    Electric motors supply less than 5% of the mechanical drive in US factories.

  3. 1890s–1910s

    Group drive

    Factories add electric motors but keep the line shafts and belts, and justify the retrofit on power savings. Almost nothing else changes.

  4. 1920s

    Unit drive

    A motor on every machine, single-story plants laid out around the work. Total factor productivity in US manufacturing grows about 5 percentage points a year faster than in the decade before.

A steam-era factory was built around one engine turning long shafts, with belts running down to every machine. Long shafts waste power, so factories went up, not out: multistory buildings, machines placed where the shaft was rather than where the work flowed. The first electric factories replaced the engine and kept everything else.

The gains came when people redesigned the building around the motor. Lighter construction, one floor, machines arranged in the order the product moved, a line you could rearrange without shutting the whole plant down.

A motor bolted to a line shaft is still a line shaft. A chatbot bolted to a 2015 workflow is still a 2015 workflow.

Rival teams

Who is paid to get your AI pilot into production?

In most companies, nobody. Follow the money actor by actor and every one of them is behaving rationally, which is exactly why the pilot stays a pilot.

Paid per seat

The vendor

Success is more seats. The answer to every question is their product, and whether your process changes is your problem.

Paid per hour

The consultancy

A long discovery phase and a strategy deck are revenue. Slow is profitable, and junior associates do most of the work.

Paid for uptime

Internal IT

Their job is to keep systems running and secure. A new automation touching finance or customer data is risk with their name on it.

Paid for the quarter

Leadership

They know where the hours go, but learning the tools is a second job nobody gave them time for. The pilot gets a sponsor, never an owner.

Nothing about this is new. In 1901, F. B. Crocker, whose Crocker-Wheeler Electric Company sold the motors, wrote: "There were many factories which introduced electric power because we engaged to save from 20 to 60 percent of their coal bill." The bigger payoff was what he called "indirect savings" (David lists them: less labor oiling belts, smoother work flow, better machine control). Vendors sold the coal bill; the prize was the floor plan.

Today's version of the coal bill is the license pitch: every seat does the same old work a little faster. It's real. It's also the small number. The big number sits in work nobody would design the same way if they started this year.

Its weakness

How do you get AI pilots into production?

You put one person who understands both the work and the tools inside leadership, and you give them a deadline. Factories hit the same bottleneck. David points out that the 1920s gains depended on building up a cadre of factory architects and electrical engineers who knew the new approach, and that took years: factory builders were small, scattered firms with high turnover, so the know-how spread slowly.

  1. Inside leadership. In the meetings where the hours get spent, with enough standing to change the floor plan.
  2. Understands both. Someone who can map where the hours go and then build a working prototype on your real data the next month, with no loyalty to any vendor's product.
  3. A deadline. A hard end date forces the question every pilot avoids: does this go to production or not?

That's the job we built the 90-Day Placement to do. One senior AI operator joins your leadership team. Days 1–30, they shadow leadership and map what to automate, ranked, each with an estimate of hours saved. Days 31–60, they turn the top opportunities into working prototypes on your real data, and you decide what goes to production. Days 61–90, they ship, document, and train the people who will own it.

We're paid for a fixed 90-day engagement, so the only way for us to look good is to ship. (More on that in why not a consulting firm.) Not every company needs 90 days. If you only need a ranked roadmap or a second opinion on a vendor contract, AI consulting is shorter.

Plot holes

Where does the electricity analogy break?

Rewiring a workflow doesn't require pouring a new building, so I expect AI to move much faster than four decades. David himself found that the growth in factory electric motors accounts for only about half of the 1920s productivity jump. Vendors aren't villains either: the same MIT study found that tools bought from specialized vendors succeeded about two-thirds of the time, far more often than internal builds. And one operator can't fix a leadership team that refuses to change anything; they can only make the cost of not changing visible.

Mission briefing

Questions for your leadership team

I don't have the answers for your company. These are the questions I'd want answered before buying one more license.

  • Which process would you design completely differently if it had been invented this year?
  • Who on your leadership team can explain both that process and what today's models can do with it?
  • How many AI licenses do you pay for, and how many people would notice if you canceled them tomorrow?
  • What was the last pilot that reached production, and who owned it the day after the demo?
  • What is your line shaft: a system, an approval chain, or a report everyone works around?

If you have answers, or better questions, I'd like to hear them.

Mission briefing

Frequently asked questions

What is AI pilot purgatory?

It's the stage where a company has bought AI licenses and run pilots, but very little reaches production. It happens when the people who know the work and the people who know the tools never sit in the same seat.

What percentage of AI pilots fail?

In MIT NANDA's 2025 study, only about 5% of enterprise generative AI pilots were producing rapid revenue gains. The rest had little to no measurable impact on the P&L.

What does factory electrification have to do with AI?

Both are general purpose technologies whose payoff depends on redesigning the work around them. Factories that swapped steam engines for electric motors and kept the old layout saw little gain until the 1920s.

How long did it take factories to get a productivity gain from electricity?

About four decades. Edison's Pearl Street Station opened in 1882, and US manufacturing productivity didn't jump until the 1920s, when factories moved to a motor on every machine and redesigned plants around it.

How do you get an AI pilot into production?

Give one person who understands both your operations and AI a seat in leadership and a hard deadline. That's how the 90-Day Placement works.

Sources

Where these facts come from

  1. Paul A. David, "The Dynamo and the Computer: An Historical Perspective on the Modern Productivity Paradox," American Economic Review 80(2), Papers and Proceedings, May 1990, pp. 355–361: dynamos "everywhere but in the productivity statistics," under 5% of factory mechanical drive electrified in 1899, four decades from the first central station to the productivity impact, group drive from the mid-1890s to the eve of the 1920s, unit drive and single-story plants, the roughly 5 percentage point acceleration in manufacturing productivity growth in 1919–29 with about half of it accounted for by growth in factory electric motor capacity, and the need for a cadre of factory architects and electrical engineers. American Economic Review, 1990 (PDF)
  2. Warren D. Devine Jr., "From Shafts to Wires: Historical Perspective on Electrification," Journal of Economic History 43(2), June 1983, pp. 347–372: source of the 1901 F. B. Crocker quote on 20 to 60 percent coal savings and "indirect savings" (p. 364, quoting the Journal of the Franklin Institute, January 1901). Journal of Economic History, 1983
  3. Paul A. David, "Computer and Dynamo: The Modern Productivity Paradox in a Not-Too-Distant Mirror," 1989 working paper: the Crocker quote as cited from Devine (1983), and the list of indirect gains from electric drive (less labor oiling and maintaining belts, better work flow, better machine control). David, 1989 working paper (PDF)
  4. Pearl Street Station began generating on September 4, 1882, with 400 lamps for 82 customers. Wikipedia
  5. MIT NANDA, "The GenAI Divide: State of AI in Business 2025": about 5% of AI pilots achieve rapid revenue acceleration, the rest little to no measurable P&L impact; tools bought from specialized vendors succeed about 67% of the time, internal builds one-third as often. Fortune
  6. The same report is dated July 2025 and draws on 52 structured interviews, 153 survey responses from senior leaders and a review of more than 300 publicly disclosed AI initiatives. Virtualization Review
Next issue

Keep reading

90-Day Placement

The 90-Day Placement

One senior AI operator joins your leadership team for 90 days to find, prove, and ship AI automations on your real data. Built for US companies.

Read it

Why not a consulting firm

Why not a consulting firm? Or the vendor?

AI consulting firm, AI vendor, or a senior operator inside your team? Compare who does the work, how each gets paid, and when each one is the right call.

Read it

AI Consulting

AI consulting, without the 90 days

AI consulting for US companies: an AI roadmap ranked by return, model and vendor selection, and build sprints where a senior team ships one automation.

Read it

Answer the call

Find your line shaft.

Bring one process that eats your team's week. Let's look at whether it needs a new motor or a new floor plan.

Schedule a call