Questions to ask before buying voice AI
Voice AI demos are easy to make impressive and hard to evaluate. The demo call is scripted, the questions are the ones the agent handles well, and nobody interrupts. Here is what to ask instead.
About what happens when it fails
- What does the agent do when it does not understand? You want a specific behaviour — hand over, take a message, ask once more then escalate. Vagueness here is the single biggest warning sign.
- How does a handover to a human actually work? Ask whether the caller repeats themselves. If the person picking up gets no context, you have added a step rather than removed one.
- What happens if your service goes down mid-call? There should be an answer involving falling back to your existing line, not a shrug.
About the calls themselves
- Can I hear unedited recordings of real calls, including ones that went badly? A vendor confident in their system will have these. A vendor who only shows highlights is showing you a highlight reel.
- How does it handle being interrupted? Real callers talk over the agent constantly. This separates working systems from demos.
- What is the delay before it responds? Anything much beyond a natural pause and callers start talking again, which compounds.
Ask to hear the calls that went wrong. What a vendor is willing to show you is itself the answer.
About your data
- Where are recordings and transcripts stored, and for how long? Relevant to your obligations, not just theirs.
- Is my call data used to train shared models? A perfectly reasonable yes or no, but you should know which.
- What happens to the data if I leave? Export format and deletion policy, ideally in writing.
About the commercial terms
- What exactly is billable? Ringing time, hold time, calls the agent could not complete, calls under ten seconds. These add up differently than the headline rate suggests.
- Who changes what the agent says, and how quickly? If every wording tweak is a support ticket with a lead time, you will stop improving it.
The question that tells you most
Ask which of your calls they would not recommend automating. Everyone selling voice AI has an answer, because everyone building it has watched an agent handle the wrong call badly.
A vendor who says it will handle everything is either inexperienced or willing to let you find the boundary yourself, in production, with a real customer. Neither is what you want.
Before you sign
Agree what success looks like in numbers, before launch. Calls handled without escalation, appointments booked, missed calls recovered — whichever matches why you are buying. Agree how it gets reported and how often.
Without that, you are left judging by impression, and impressions about automated systems drift badly. One memorable bad call outweighs two hundred routine good ones in everybody's memory, including yours.