What really irritates people
A wrong answer from a system is annoying but forgivable; people give wrong answers too. What stays with people is something else: the feeling that there is no way out. Rephrasing the same question three times, no button to reach a person anywhere, and the uneasy suspicion that the route to an employee was deliberately tucked away to cut costs.
That suspicion is often correct. That is precisely why keeping the human route visible is not a courtesy but the core of the design.
Four design rules
1. The way out is always there, from the first message
Not only after three failed attempts, not hidden in a footer. The option to speak to a person is visible from the start, with an honest indication of when that is possible. Curiously, fewer people use that route when it is clearly visible: knowing it exists removes the tension.
2. Uncertainty is an outcome, not an error
A workflow must be able to say “I do not know,” and that must lead somewhere. If the model cannot answer the question confidently from the sources, the conversation goes to a person — with the context, so the customer does not have to start over. That last part is half the job.
3. Sources alongside the answer
An answer about a delivery time, warranty period or condition refers to where it is stated. That gives the customer something to check and gives you a signal: if the source is outdated, that becomes visible instead of the model confidently repeating something obsolete.
4. Outgoing messages with approval, initially
The workflow may read and prepare replies. Sending is a separate decision. Start with human approval for everything going out, and change that only when the log shows which types of questions are consistently answered correctly. Not the other way around.
What is never automatic
- An emotionally charged complaint. The model sees the words, not the fact that this customer already called last week.
- Anything creating an obligation: a goodwill arrangement, a credit, a commitment about a deadline.
- A question about which the customer explicitly says they want to speak to a person. That is not an objection to overcome.
What to measure
Do not only measure the share of questions handled without a person — that figure rises by itself if you hide the way out, and then means nothing. Also measure how often a customer contacts you again after the automatic answer, and how many transferred conversations an employee could resolve without further questions. Together, those two show whether automation works or only postpones the work.