The cost of getting it wrong shows up in two places. Live chat alone means questions after hours sit unanswered until morning, and staff spend the day typing the same shipping and return answers. A chatbot alone means the customer with a real problem gets a polite loop instead of a decision, and the sale or the relationship walks away.
Benian builds the chatbot side and the handoff into your existing chat or help desk tool. We do not staff live chat. If you need people answering chats, you need your own team or a staffing provider, and this page will help you decide how much of their time a chatbot can give back.
Where each option fails on its own
Live chat goes dark after hours
A staffed chat window is only as good as its schedule. Questions that arrive at night or on weekends become an offline form, and a visitor with a buying question may go to another store before anyone replies.
Staff time goes to repeat questions
Where is my order, do you ship to my state, what is the return window. Agents answer these all day, which leaves less attention for the conversations that actually need a person.
Old bots trap customers in menus
Decision tree bots only follow the buttons someone scripted. A question outside the script gets a fallback message, and customers learn to type 'agent' until something changes.
AI bots can be confidently wrong
A model without access to your real policies fills gaps with plausible text. One invented return rule or shipping promise creates a commitment you then have to honor or walk back.
Chatbot vs live chat: the short answer
Put a grounded chatbot first and a person behind it. The chatbot handles questions whose correct answer is written down somewhere you control: product details, shipping rules, return policy, hours, order status when it can look the order up. The person handles anything that needs a decision, an exception, empathy or a negotiation.
Live chat alone still makes sense in two cases. If you get only a handful of chats a day and someone already watches the window, a chatbot adds setup and upkeep for little return. And if nearly every conversation is a custom quote or a sensitive matter, a bot will mostly route people, which a simple form can do. Start smaller in those cases: write down your top questions and see how often they repeat before you build anything.
What a modern AI chatbot is, and how it differs from decision tree bots
A decision tree bot is a scripted menu. Every path is written by hand, so it never says anything you did not approve, but it cannot handle a question phrased differently from the script.
An AI chatbot uses a language model to read the customer's own words and write an answer. The useful kind is grounded: before answering, it retrieves passages from your own documents, such as the return policy page, product data or shipping table, and answers from those. Good builds show which source an answer came from, so mistakes are easy to trace and fix. For how a chatbot differs from an agent that takes actions, see our AI assistant vs AI agent comparison.
AI can still make mistakes. Grounding reduces them, it does not remove them, so important decisions such as refunds outside policy, medical or legal questions and account changes stay with a person.
Questions a chatbot should never answer alone
Write this list before you choose a platform. It decides your handoff rules, your staffing and how you measure the bot.
- Refunds, credits or exceptions outside the written policy.
- Complaints, threats to cancel, or any customer who is clearly upset.
- Large or custom orders, wholesale terms and anything that is really a sales conversation.
- Questions where a wrong answer has legal, safety or health consequences.
- Anything about a specific account the bot cannot verify, such as changing an address on an order.
- Questions your documents do not answer. The right response is 'I will get a person', not a guess.
Designing the handoff: context, hours and what the customer sees
The handoff is where a hybrid setup succeeds or fails. When the bot escalates, the agent should receive the full transcript, the reason for escalation, and whatever the bot already collected, such as name, email and order number, inside the tool they already use.
Hours matter as much as context. During staffed hours, the customer should see that a person is joining and roughly how long it will take. After hours, the bot should say plainly that nobody is available now, collect contact details and the question, and create a ticket that is first in line in the morning. Saying a person is coming when nobody is on shift breaks trust and creates an angrier second conversation.
Keep a visible way to reach a person at any point. A bot that says 'let me get someone' serves customers better than one that will not let them leave.
How to compare chatbot platforms
A useful chatbot platform comparison tests your own content and your own questions, not the vendor demo. Take twenty real questions from your chat or email history, including a few awkward ones, and run each candidate against them. Check these points:
- Grounding: can it answer only from sources you supply, and refuse when they are silent?
- Source references: can you see which document produced each answer?
- Channels: does it work where your customers already write, such as the website, email or messaging apps?
- Handoff: does it pass the transcript and collected details into your existing help desk or live chat tool?
- Data access: can it look up order status or account details through a connection you control?
- Reporting: can you read transcripts, see unanswered questions and export the data?
- Ownership: if you leave, can you take your content, transcripts and configuration with you?
A storefront example from production
VOT Distribution, a multi-brand e-commerce distributor, runs two AI storefront assistants that Benian built. One is the assistant at shopfreezo.com, which answers product, compliance and shipping questions around the clock. Those are exactly the repeat questions that would otherwise wait for a staffed chat window or land in an inbox.
The assistants are one part of a wider engagement that also includes outbound campaigns and content automation, so read the linked client-reported results as the result of the whole system, not the chat assistant alone.
What drives the cost of each option
Live chat cost is mostly staff hours: how many hours a day the window is covered, how many agents you need for peak volume, and whether you cover weekends or more than one language. Software seats for the chat tool sit on top.
Chatbot cost is driven by conversation volume, since AI platforms usually charge by usage or by conversation, plus the number of channels and languages, the systems the bot must read from, and the ongoing work of keeping source documents current. A chatbot does not remove staff cost. It moves agent time from repeat answers to the conversations that need them, and someone still has to own the source content. Benian scopes each build to these drivers rather than publishing a price.
What to measure after launch
Measure from transcripts, not only the vendor dashboard. Read a sample weekly for the first month.
- Containment: the share of conversations resolved without a person, checked against whether the answer was correct.
- Wrong answers found in transcript review, and which source caused each one.
- Escalation rate and the reasons, which tell you what to add to the documents.
- Time from escalation to a person replying, during and outside staffed hours.
- After-hours conversations that ended with captured contact details or a completed purchase.
- Repeat contacts: customers who came back with the same question within a few days.