LLM integrations

The inGenious AI platform offers some advanced features to help you maintain your chatbot content, such as generating training phrase suggestions or handover transcript summaries for your live agents. These features use Large Language Models (LLMs) to generate the results.

The generated content is never visible to your chatbot users and won't impact their experience.

To use these features:

1. Create an LLM Connector to connect to an LLM provider.
   You can create multiple connectors to the same LLM model.
2. Create an LLM Usage for the feature you want to use.
   Each LLM Usage is designed for a specific feature or 'scope', such as handover transcript summaries. The LLM Usage allows you to select which LLM Connector to use and customise the prompt used.
3. Set the LLM Usage you want to use as the Primary for that scope.
   You can create many LLM usages for the same scope, but the chatbot will only use one at a time. Setting a usage as the primary designates it as the one the chatbot should use for this scope.