How do I monitor my website chatbot and the site around it?
Why you need both
A site can be online while its chatbot quotes an old refund policy. And a chatbot can answer correctly while the checkout page is broken. An uptime check won’t catch a wrong answer, and a chatbot test won’t catch a broken checkout.
Monitoring the chatbot’s answers
Tidio, for example, recommends reviewing conversations and testing again after you update Lyro’s knowledge, and Intercom lets you save groups of test questions to run again. AnswerTested asks the questions for you and saves every answer in a report.
- Keep an answer key with your current facts.
- Keep a fixed list of customer questions, including a few tricky ones.
- Ask the same list on a schedule and after every change to the chatbot’s content or settings.
- Compare each answer with your facts and with the last run.
- Read a sample of real conversations in your chatbot tool.
Monitoring the site around it
If your site was built with an AI tool such as Lovable, Bolt or Cursor, one option is Heedza. It opens your live site in a real browser, checks that your signup, login and checkout pages load and show their form or Pay button, and emails you a screenshot if one breaks. It never signs in, submits a form or pays.
- The site is up (checked every few minutes).
- Key pages load and show what they should: the signup form, the login form, the checkout’s payment form.
- The https certificate is valid.
- You get an alert, ideally with a screenshot, when something fails.
When something fails
Save the transcript or screenshot. Fix the source: the fact, the setting or the page. Then run the same check again and confirm it passes.
Questions
Is uptime monitoring enough for a chatbot?
No. Uptime monitoring tells you the site responds. It doesn’t read what your chatbot says, so a wrong answer looks the same as a right one.
How often should I check my chatbot?
After every change to its content, settings or your policies, and on a regular schedule in between. See how often to test.