Regression tests

Use regression tests before you publish a new chatbot version to make sure your content changes don't negatively affect your chatbot's NLP question matching. Regression tests are run against your chatbot's current draft content, so you can see the impact of your content changes before you approve them.

Each regression test can test up to 1000 phrases against your chatbot's global NLP questions for one language. You can create as many regression tests as you need, and run them as often as you need, but your chatbot can only run one regression test at a time.

To run a regression test on your chatbot:

1. Create a regression test with the language you want to test and the threshold of how many phrases the chatbot should match correctly to pass the test.
   By default, regression tests are created in English. Options to select a language are only displayed if the chatbot has multiple languages configured.
   You can create your regression test from a completed Review to pre-populate it with utterances from your users that you have already matched to passages.
2. Add phrases you want to test in the same language as your regression test. You can:
   • Generate test cases from your chatbot content.
   • Download a CSV of test cases from another regression test to use.
   • Create and upload a test file using a template.
   • Manually add phrases and select the passage they should match.
3. Run a regression test.
4. View and download the results.

You can also:

• Update a regression test to change its name, threshold for passing the test, or the phrases used in the test.
• Delete a regression test if you want to delete all history of that test from your chatbot.

Regression test permissions