The generate insights task analyses the evaluated output of your other LLM tasks during automated tests, identifies common issues, and suggests refined prompts. The insights are never visible to your chatbot users.
You shouldn't edit this prompt...
If you change this prompt, your automated tests may not work properly. We don't recommend changing this prompt.
You need an administrator or publisher role in your team to change a task prompt.
The task contains one prompt:
-
Generate Insights generates an analysis of evaluated test cases and two refined prompts.
Prompt variables: ${inputColumns}, ${outputColumns}, ${variableFormat}, ${originalPrompt}, ${formatInstructions}, ${additionalRequirements}.
Changes to these prompts are applied immediately and do not appear in versions.
Prompt variables and requirements
The prompt uses the following prompt variables:
- ${inputColumns}: the input that was sent to the LLM task being tested.
- ${outputColumns}: the output generated by the LLM task.
- ${variableFormat}: instructions to format prompt variables in the refined prompts.
- ${originalPrompt}: the original prompt of the LLM task prompt being tested.
- ${formatInstructions}: instructions to format the response so the automated tests feature can use it.
- ${additionalRequirements}: additional context or instructions provided in the automated test configuration.
You don't need to provide a value for these variables: they're automatically supplied when the chatbot uses the task to generate insights cases.