How does an AI phone agent work?

Everyone has dealt with a phone robot: “for our opening hours, press 1”. An AI phone agent is something else. No menu: the caller simply speaks, and the AI agent answers.

That raises fair questions. How is what the caller says understood? Where do the answers come from? And what happens to what your callers say?

Here is how it works, step by step, without jargon.

What happens during a call

For the caller, it is an ordinary call. Behind the scenes, five things happen.

1. The call comes in

   During the hours you set, the AI agent answers. Outside them, the caller hears a short message and can leave a voicemail, which is emailed to you.

2. The AI agent listens

   Speech recognition turns spoken words into text as they come. You can provide a short list of words to recognise reliably: your products, the name of your street.

3. The agent finds the answer

   A language model reads this text together with your business information and decides what to do: answer, ask a question, book an appointment or take a message.

4. The AI agent answers out loud

   A natural voice, which you choose, speaks the answer. The tone follows the conversation: calm with a worried caller, direct for a quick question.

5. You receive a summary

   At the end of the call, an email tells you who called, why, and what to do next, with the caller's number ready for a callback. An SMS is also possible.

Steps two to four repeat with every sentence, fast enough for the conversation to stay natural. The caller can change their mind or ask another question: the AI agent keeps up.

Where the answers come from

An AI agent does not know your business by magic. The AI agent knows exactly what you provide, nothing more:

• Your website. During setup, the AI agent reads your website and writes a short profile: what you do, your services, how to reach you.
• Your own notes. Prices, parking, documents to bring to the first appointment, questions to pass on to you. In your own words, as if you were briefing a new hire.
• Your opening hours and closures. Public holidays included, so the agent never says you are open on a day you are closed.
• Your calendar. Once your calendar is connected, the agent sees your real free slots and books straight into them.

When a question falls outside that scope, the AI agent does what a good new hire would: say the answer is missing and offer to pass the question on. Never an invented price, opening time or address.

What the AI agent actually does

Most of an SMB's calls come down to a handful of situations. The AI agent handles them all:

• Everyday questions. Opening hours, address, parking, the price of a service if you have given it.
• Appointments. Booking, moving, cancelling. Only free slots in your calendar are offered, and confirmation comes only once the booking has really been made.
• A real message. Name, number and reason, with the number read back to be sure.
• An urgent call. Transferred to the number of your choice, in the cases you have defined: a water leak, for example, or someone who needs you right away.
• The caller's language. French, German, English, Italian, Spanish or Portuguese, switching language as soon as the caller does. Swiss German is available as a beta.

For a fuller picture of what an agent can handle, and what is better left in human hands, read what voice AI can do for your business.

What the AI agent will never do

An agent that answers your phone speaks in your name, so the work follows fixed rules. You set most of them. These three cannot be switched off by any of your instructions:

• No professional advice. Never medical, legal, tax or financial advice, and never an opinion on what an insurance policy covers. The AI agent takes a message for the right person.
• No invented answers. Anything not in your information is not said.
• No pretending. To the question “am I talking to a person?”, the answer is clear: this is an artificial intelligence.

And if someone describes a life-threatening emergency, the AI agent tells them to call 144 immediately.

Privacy, built in from the start

A call carries personal information: a name, a number, sometimes the reason someone needs to see a doctor. What happens to it matters as much as the answers. At Voko, these choices are made for you from the start:

• Audio is not recorded by default. The conversation is processed as it happens, and no recording of the call exists afterwards. If you switch recording on, the agent tells the caller at the start of the call.
• Details do not linger. The caller's number and the summary are deleted after 30 days by default, or after the period you choose. Only what billing requires remains: the date, the duration and the minutes.
• Your calls train no AI. Our terms say so in black and white: your callers' data is used to provide the service, never to train models.
• Every provider is named. Our privacy policy lists each company involved and its country, American ones included, rather than a vague mention of “partners”.
• Your data stays yours. From your account, you can export everything to a file, or delete everything.

Under Swiss data protection law, you remain responsible for the data of the people who call you, and Voko acts on your instructions. Our article on data protection and voice AI explains what this means for you.

Setup: a conversation, not a project

You do not need to understand any of this to use it. Creating an agent means answering a few questions: your website, the language, the voice and the address the summaries go to. The questions take about two minutes.

You keep your current number and simply forward calls to the AI agent: all of them, or only the ones you cannot answer. After that, you change everything yourself, in your own words: the greeting, your hours, what the AI agent knows, where the summaries go.

What is it, really?

Not a robot reading a script. An AI phone agent listens, reads your information, answers within the rules you set, then tells you what happened.

The easiest way to understand is to listen. Enter your website: in under a minute, an agent that knows your services and opening hours answers you. Ask the questions your customers ask you.