Jesse Lee Coggan - AI Adoption Strategist
A pilot might save time. It might produce good work. It might impress the team. But before a firm invests more money, connects more systems, trains more people, or rolls AI out more widely, leadership needs to answer a few basic questions.
What business problem is this solving?
Which workflow is changing? Who owns the result? What can the AI access? Where does a person still need to review the work? How will we know if it’s actually creating value? And what would make us decide not to move forward?
A good pilot helps answer those questions.
A pilot can be very useful. It can show that AI can perform a task under certain conditions. It can help a team see where AI saves time, where it struggles, and where the workflow may need to change. It can also expose problems that were not obvious at the beginning.
But a pilot can’t prove everything. A strong result in a small test doesn’t automatically mean the same process will work across the firm.
The pilot may have worked because:
None of these things mean AI should be avoided. They simply mean that testing a tool is different from building a reliable business process.
There’s usually not one single reason. Pilots often stall because important decisions were never made before the test began.
Those missing decisions become harder to ignore when the firm tries to move from a small experiment to everyday use.
A new AI tool gets attention. Someone sees a demo. A team wants to try it. That’s understandable, but it isn’t a strong reason to change how the business works.
What problem are we trying to improve?
Maybe the firm wants to reduce turnaround time. Maybe too much staff time is being spent on repetitive work. Maybe quality is inconsistent. Maybe there’s too much rework. Maybe clients are waiting too long for answers.
Once the problem is clear, AI can be tested as one possible solution. Without a clear business problem, it becomes difficult to tell whether the pilot was actually successful.
Statements like these are too broad:
We want to use AI for research.
We want to use AI to improve productivity.
We want everyone using Copilot.
Those are goals or ideas. They aren’t workflows.
A workflow is more specific. It has a starting point, an end point, inputs, decisions, handoffs, outputs, and people who are responsible for the work.
For example:
Use AI to create a first draft of a summary from approved source material. A qualified employee reviews the summary before it’s used in client work.
That can be tested properly. The firm can measure how much time it saves, how much review is needed, where mistakes appear, and whether the process is worth keeping.
The more clearly the workflow is defined, the easier it becomes to decide whether AI belongs in it.
Pilots often have someone who is excited about them. That person may test the tool, encourage others to use it, and help solve problems. But that isn’t the same as having a clear owner.
Someone needs to be responsible for the business result. That person should be able to answer questions such as:
This becomes especially important when several parts of the firm are involved. Technology may manage the system. Operations may manage the workflow. Security may manage access. Professionals may review the work. Leadership may approve the investment.
If everybody is involved but nobody owns the outcome, the pilot can keep going without anyone making a clear decision.
This is one of the biggest problems. An AI system can produce a good answer and still be a bad business investment.
For example, the AI might save ten minutes on a task but create fifteen minutes of extra review. It might make work faster but less consistent. Employees may enjoy using it even though there’s no clear improvement in the business.
That’s why success needs to be measured in business terms.
Depending on the workflow, a firm might look at:
Not every pilot needs a complicated ROI calculation. But leadership should be able to explain what improvement it expects and how it will know whether that improvement happened.
Simply keeping a person somewhere in the process doesn’t define meaningful oversight. Leaders still need to decide what that person reviews, what information they receive, what authority they have, and what standard they’re expected to apply.
For example:
Does someone check every output? Do they only review unusual cases? Do they verify facts and sources? Do they approve the final work? Are they responsible for professional judgment?
The answer depends on the workflow and the consequences of getting it wrong.
This matters for business value too. If every AI-generated result needs to be completely redone by a person before it can be trusted, the pilot may not be saving very much. On the other hand, too little review can create serious problems.
The right level of human review should be designed into the workflow. For practical guidance on approval points, review responsibilities, and escalation, see Human Oversight in AI Workflows.
A small pilot can sometimes avoid difficult questions about access. Scaling can’t.
As AI becomes part of real work, leaders need to decide:
These are practical operating decisions. They shouldn’t be left until after the technology has already spread across the business.
Some pilots work because one person knows how to make everything work. They know the right prompts. They fix the inputs. They catch mistakes. They understand the exceptions. They clean up the final result.
If that person disappears, the workflow may stop working. That isn’t a repeatable business process.
A process that’s ready to scale should work under normal conditions. Other people should be able to understand it. The steps should be clear. The controls should be clear. And the result shouldn’t depend on one enthusiastic employee rescuing the process every time something goes wrong.
Before expanding an AI pilot, leadership should be able to answer ten questions.
A pilot has done its job when leadership has enough evidence to make a deliberate next decision. That decision doesn’t always need to be “scale.”
there’re several reasonable outcomes.
The workflow is creating useful value. The process works. Ownership is clear. The risks are understood. The evidence supports broader use.
The idea is good, but something needs to change.
Maybe the workflow is too broad. Maybe the review process is too heavy. Maybe the wrong tool was chosen. Maybe the measurements are unclear.
Fix the weak point and test again.
The original idea may not be the best use of AI. The firm may discover that a different workflow, smaller scope, or different business problem creates more value.
That’s useful learning.
The idea may still be worthwhile, but the firm isn’t ready. There may be problems with data, systems, ownership, security, skills, or leadership alignment.
Waiting can be the right decision.
Sometimes the pilot simply doesn’t justify more investment. That isn’t necessarily a failure.
A pilot can save the firm from spending much more money on an idea that was never going to create enough value.
Professional services firms sell expertise, judgment, and trust. That makes AI adoption different from simply automating a production task.
Speed matters. But speed isn’t enough.
A faster process may create very little value if it also creates more review work, more uncertainty, or more risk.
A law firm, accounting firm, consultancy, or advisory business may need to ask:
These are harder questions than choosing a new AI tool. They’re also much more important.
Pilot volume is a poor measure of AI adoption maturity. What matters is whether a firm can turn a tested use case into a repeatable, accountable, and measurable way of working.
That means using the pilot to learn.
What happened to the workflow? Did it create value? Where did people struggle? What needed human review? What information did the AI need? What boundaries became necessary? Did the results justify more investment?
When those questions are answered, the next step becomes much clearer. The firm is no longer trying to solve the strategy, workflow, technology, measurement, and risk questions all at the same time.
There’s a direction. Then implementation can follow.
If your firm already has AI pilots underway, don’t ask only:
How do we scale this?
What have we learned, and is the evidence strong enough to justify doing more?
A structured AI Adoption Framework can help leadership work through the business objective, workflow, ownership, boundaries, measurement, and sequencing before implementation expands. If the next priority is still unclear, see how to prioritize AI opportunities in a professional services firm.
If you’re still unsure whether your current AI activity should move forward, pause, or be reframed, start with the AI Adoption Clarity Diagnostic.
It’s a no-cost, 10-question diagnostic designed to help you understand your current position. You receive a written Clarity Brief with a recommended posture and a clearer sense of what should happen next.
The goal isn’t to use more AI.
It’s to know where AI belongs, what deserves further investment, and what should happen next.
Before you scale, pause, or invest further, the AI Adoption Clarity Diagnostic can help you step back and see what the evidence is really telling you — and what deserves to happen next.