Generate test cases task

The generate test cases task helps you quickly build regression tests for your chatbot content.

The task can generate different test cases and their variations based on existing test cases or specific passage content. Each test case is an example user utterance matched with a passage response. Test cases are only generated in English. You can customise the prompt used to generate the phrases. The generated phrases will not be visible to your chatbot users.

The generate test case task is in the generate test case usage. You need an administrator or publisher role in your team to create a usage.

By default, new usages you create are set as the primary usage (the usage the chatbot will use). You can create a usage without setting it as primary if you need to.

When editing tasks and usages, check the top of the usage page to see if it is the primary usage and whether your changes must be published to take effect. If there is no message indicating your changes must be published, then the changes are applied immediately and will not appear in versions.

To create usages and configure tasks, you must have:

• Generative AI configurations enabled for your chatbot by inGenious AI support.
• A connector to power the task. 
  You can see the list of connectors that support the task when you create the usage.

To create a generate test cases usage and configure the task:

1. Click Manage in the left navigation, then click LLM Usages.
2. Click the filter icon next to + LLM Usage and make sure Show Platform Usages is selected. 
   
3. Click + LLM Usage.
4. In the Type field, select Generate Test Cases.
5. Optionally, edit the Name for the usage.
6. If you don't want the chatbot to use this task yet, clear the Set As Primary checkbox.
7. Select the Connector to use for the task or select Create compatible Connector to create a new connector.
   Only compatible connectors will be available.
   You must have an administrator role in your team to create connectors.
8. Click Create.
9. By default, the inGenious AI platform waits a maximum of 60 seconds for the model to generate a result. If it doesn't receive a result within that time, it notifies your content creator that the request timed out. 
   If you want to change this period:
   1. Expand the Timeout section.
   2. Update the number of seconds the inGenious AI platform will wait.
10. If you want to edit the default prompt used to generate the summary, type any edits into the Prompt area.
    Make sure you don't delete the prompt variables: ${variation}, ${content}, and ${phrase}.
11. Click Save.