Why it matters
Most chatbot testing is written for engineers
Search for chatbot testing and you'll find guides for software testers. A business owner has a simpler question: will it tell my customers the right thing?
You know your business better than any test script. So instead of a testing tool, you get your own assistant's real answers to real questions, with what each answer was based on, and one place to fix what's wrong.
How it works
Check, correct, and keep checking
Read its answers
The Test page asks your assistant the questions customers of your kind of business ask, plus ones it shouldn't answer and a request for a person.
Correct anything wrong
Write the right answer and it's saved as your own answer, which outranks your website from then on.
Check what customers asked
To check lists questions it couldn't answer, answers it wasn't sure of, and facts on your website that contradict each other.
What it does
A testing checklist that runs itself
The same assistant customers meet
Test answers use the same facts, settings, opening hours, holiday closures and clock your customers get. Test questions never count toward your messages.
Shows why it answered
Each answer shows what it was based on, and flags answers given without a source. How it works explains where its answers come from.
Preview an edit
Before you save a fact or FAQ, see which answers would change: now answers, now hands over, or just reworded.
Finds contradictions
If two facts can't both be true, like two different prices for the same service, To check shows both so you can fix one.
Questions it couldn't answer
Real customer questions it handed over, grouped with a count, so you can answer the common ones once. The form shows who asked, and you can email your answer to those who left an email address.
Answers it wasn't sure of
Answers it gave with little or nothing to back them up, so you can confirm or correct them.
Approvals that notice a change
Mark an answer "Looks right" and it's recorded with the exact wording you approved. If the answer later changes, the Test page tells you your approval is out of date.
What it won't do
What testing doesn't cover
It checks your assistant's answers against your knowledge. It isn't a load or security test.
- Previewing an edit uses the test questions, not a replay of every past customer conversation.
- It doesn't preview the effect of re-reading your pages or changing settings.
- Test questions are chosen for your kind of business. You can't write your own test list yet.
- It doesn't test speed, load or security.
Questions
Chatbot testing questions
Can I see what it told my customers?
Yes. Every conversation is on your Conversations page, newest first, and each one opens to the whole exchange: what the customer asked and what your assistant answered. You can download them all as a spreadsheet from the same page. The Test page is for questions you ask it yourself before customers do.
What is chatbot testing?
Checking that a chatbot gives the right answers and behaves as it should, before customers rely on it. For a business owner that mostly means reading its answers to real questions and fixing what's wrong.
How do you test a chatbot's accuracy?
Ask it the questions your customers ask and check each answer against what's true. Ours does the asking for you and shows what each answer was based on, so you only have to judge the answers.
How do you train an AI chatbot to give better answers?
With ours, correct the answer. Your correction is saved as your own answer and used from then on, with no retraining.
Is an AI chatbot reliable?
It's software and it can be wrong, which is why ours is held to your own facts, hands over what it can't answer, and gives you a list of answers it wasn't sure of to check. Results shows how its answers to real customers were backed.
Do test questions use up my messages?
No. Only messages from real customers count toward your plan. See the plans.
Keep exploring
Other features
- Answers from your websiteReplies from your own pages and documents, and says when it doesn't know.
- Lead alertsNew leads emailed to you in seconds, with where they came from.
- BookingsYour booking page or Google Calendar, right in the chat.
- Handoff to youPasses the conversation to you when a person should answer.
- ResultsWhat it adds, measured against visitors who never saw it.
- Chat widget and pageA chat bubble for your site and a link to share anywhere.