ChatSignals

Testing and Improving Your Bot

Learn how to test, review, and improve your ChatSignals bot using performance data, conversation analytics, and continuous optimisation tools.

Bots are currently only available for HubSpot data sources.

Improving your bot is a continuous cycle: Test, Analyse, Improve.

1. Test Your Bot

You can test your bot in two ways:

Quick Chat (All Users)

  1. Go to the Your Bots page.
  2. Click the chat icon (message square) next to your bot.
  3. Ask your bot questions to see how it responds with the current deployed configuration.

This is perfect for all team members to quickly interact with the bot and see how customers will experience it.

Quick Test Chat (Admins Only)

For more detailed testing with debug information:

  1. Go to the Your Bots page and click the settings icon next to your bot.
  2. Click "Test Your Bot" in the top right corner.
  3. Ask your bot questions and see detailed debug information about its responses.

A screenshot of the 'Test Your Bot' button.

What to Test:

  • Does it answer questions correctly?
  • Does it know when to hand off to a human?
  • Does it offer sales actions at the right time?

2. Analyse Performance

Look at your Dashboard to see how your bot is doing.

  • Human Intervention Rate: How often does a human need to step in?
  • Knowledge Gaps: What questions is your bot unable to answer?

A screenshot of the Knowledge Gaps card on the dashboard.

3. Improve Your Bot

  • Add Knowledge: If you see a knowledge gap, go to Settings → Knowledge Sources to add a new URL or snippet to fill it.
  • Refine Configuration: Adjust your bot's settings from the Your Bots page based on its performance. If it's escalating too much, add more knowledge. If it's not offering a sales action, make the "Offer When" condition more specific.

By repeating this cycle, you can continuously improve your bot's performance.