What an AI voice agent actually does on a call
Most explanations of AI voice agents skip the part people actually want to know: what happens, second by second, once someone calls. This is that walkthrough — no metaphors about the future of work.
The four steps, in order
Every call an agent handles runs through the same loop, and it runs continuously rather than in neat turns. The caller speaks, the audio is transcribed, a language model decides what to say, and speech is generated back. The whole cycle has to complete fast enough that the caller does not notice a gap.
That timing constraint is the whole engineering problem. A person on a phone expects a reply within roughly the length of a natural pause. Miss that window and the caller starts talking again, which means the agent now has to work out whether it was interrupted or whether the caller simply finished a thought.
What it handles well
- Calls that follow a shape — booking, rescheduling, qualifying a lead, taking an order update. The path varies but the destination is known.
- Questions answered from a fixed body of knowledge: opening hours, pricing tiers, what is in stock, whether you cover a postcode.
- Volume that arrives all at once. Ten simultaneous callers is the same problem as one.
- The hours nobody is staffed for. A missed call at 2am is the cheapest call to answer well.
What it does not handle well
Anyone selling you a voice agent that never needs a human is selling you something that will eventually embarrass you. The honest boundary sits at three places.
- Emotionally loaded calls. A complaint escalating in real time needs a person, and needs one quickly.
- Anything irreversible — a refund, a cancellation with a penalty, a commitment that costs money to unwind.
- Genuine ambiguity. When the caller wants something the agent has no path for, the right behaviour is a fast handover, not an improvised answer.
The measure of a voice agent is not how many calls it completes. It is how quickly it recognises the ones it should not.
Why missed calls are the usual starting point
Most businesses do not begin with automation because they want fewer staff. They begin because calls are going unanswered and each one is a customer who phoned a competitor next. Missed call recovery is the easiest place to start: there is no existing process to disrupt, and the comparison is not against a person, it is against nobody picking up at all.
That framing also makes the results legible. You already know how many calls you missed last month. You will know whether that number moved.