Why is choosing the right AI automation consultant harder than it looks?

Every week there's a new agency claiming they'll "10x your business with AI." Most of them are selling hype, not engineering. The gap between a consultant who builds something that runs quietly in production for two years and one who ships a demo that breaks the first time an API changes is enormous — and it's almost invisible until you've already paid for it.

I run Dyvab, an independent AI integration and automation practice, and before that I spent years working as a consultant on complex, high-stakes projects where the bar for quality was non-negotiable. That background taught me one thing that applies directly here: most "AI problems" are actually process problems wearing an AI costume. The consultant's job is to find the real bottleneck before writing a single line of code — not to sell you the shiniest tool.

Here are seven concrete signs that separate a consultant who knows what they're doing from one who's improvising.

1. Do they investigate before they pitch?

A consultant who proposes a solution on the first call, before understanding how your team actually works today, is guessing. The good ones do the opposite: they analyse what you've told them — often with their own AI systems processing your initial message before the call even happens — so that the conversation starts from real information, not a generic pitch deck.

If the first call is 90% them talking about what they can build and 10% asking questions about your actual workflow, that's backwards. It should be the other way round.

2. Will they tell you when there's no fit?

This is the single clearest signal. A consultant who is honest about fit will tell you, sometimes in the first call, that what you're describing isn't a good automation candidate — or that the real problem is somewhere else entirely. Most people describing a problem in a first message aren't describing the actual problem; a good consultant digs until they find it, even if that means the project looks different (or smaller, or nonexistent) than what you originally asked for.

If every conversation ends in "yes, we can build that," regardless of what "that" is, be sceptical. Nobody has the right solution for every problem, and pretending otherwise is a sales tactic, not expertise.

3. Do they quote a fixed price, or an open-ended hourly rate?

Hourly billing creates a perverse incentive: the slower the work, the more the consultant earns. A fixed price per project forces the opposite — the consultant has to actually scope the problem, understand the edge cases, and commit to an outcome before they start charging you. It's a small detail that tells you a lot about how rigorously they think through a project before touching a keyboard.

Watch out for vague scopes paired with hourly rates and no clear deliverable. That combination almost always ends in cost creep.

4. Can they show you something running in production, not a demo?

Demos are easy. A chatbot that answers three scripted questions, or a workflow that works once on clean test data, proves almost nothing. What matters is whether the consultant has built systems that keep running when the input is messy, when an API times out, when a human needs to step in for one edge case out of a thousand.

Ask directly: what happens when this fails? A consultant with real production experience will have a concrete answer — error handling, retries, escalation to a human where it matters — instead of a shrug.

5. Do they actually use the tools they're selling you?

There's a difference between someone who read about Claude, ChatGPT, or n8n in a newsletter and someone who uses them daily to build and ship real systems. The second group notices things the first group doesn't: which model handles a specific task better, where an automation platform's limits actually bite, what breaks in practice versus in theory.

A good test: ask what they'd change about the tool they recommend most. If they only have praise, they're probably not using it hard enough to have found its edges.

6. Do they scale with the project, or force you into a fixed package?

Some projects need one person for two weeks. Others need a small team with specialised skills for three months. A consultant locked into rigid, pre-built packages will try to fit your project into whatever box they sell, whether it fits or not. A better sign is a consultant who brings in specialists on demand when a project genuinely needs them, and stays lean when it doesn't.

This matters more than it sounds: it's the difference between a solution designed for your problem and your problem being reshaped to fit someone else's template.

7. Do they talk about quality even when nobody's forcing them to?

Anyone can promise speed. Fewer people hold the line on quality when a deadline is tight or a client isn't paying close attention. Ask how they handle a rushed timeline, or what they'd refuse to cut corners on even under pressure. The answer tells you whether "quality" is a value they actually enforce on themselves, or a word on a website.

How do you put these signs together in a first conversation?

You don't need seven separate meetings to check all of this. In one honest first call, you can usually tell: are they asking real questions about your process, or reciting a pitch? Are they willing to say "this isn't the right fit" if it's true? Are they quoting a scoped, fixed price, or an open-ended hourly rate with a vague deliverable? That's most of the signal, in about thirty minutes.

The rest — production track record, tool fluency, how they scale — you can verify by asking directly and listening for specifics instead of generalities. Consultants who've actually done the work have specifics. The ones who haven't, don't.