Guide

How do I test my website chatbot?

Short answerAsk your chatbot the questions real customers ask, and check each answer against your own policies. Include tricky questions: a wrong premise, a request for a discount, and a request for a person. Write down what it said, word for word, and repeat the test after every change to its knowledge.

1. Write down your facts first

Before you test, write the facts the chatbot must get right: return period, delivery times, opening hours, prices and how to reach a person. These are your answer key. Without them you are judging answers from memory.

2. Ask real customer questions

Use the questions customers already ask your team, in their words. Most chatbot builders have a test or preview area for this, for example Intercom’s Fin preview and batch tests, and Tidio’s Lyro Playground.

  • “What is your return period?”
  • “How long does delivery take?”
  • “What are your opening hours?”
  • “Can I talk to a real person?”

3. Add the tricky questions

Wrong answers often come from leading questions. Ask “You offer 90-day returns, right?” when you offer 14 days. Ask for a discount code you never created. Ask it to promise next-day delivery. A good chatbot corrects you, declines, and points to the real policy. See which questions to ask.

4. Test the live widget, not just the preview

A preview inside the builder may not use the same settings as the widget on your site. Test once on the real page, as a visitor would.

5. Keep the transcript and repeat

Save the exact answers. Re-test after you change the chatbot’s content or settings. See how often to test. AnswerTested runs these steps for you and puts the transcript in a report.

Free test

Is your AI chatbot right?
Get it AnswerTested, free.

Free test · No card · EU AI Act check