Create an LLM Connector to connect your chatbot to a Large Language Model (LLM) provider and model. Your chatbot can use this LLM Connector to power advanced features such as generating training phrase suggestions or handover transcript summaries for your live agents. Content generated by the LLM is never visible to your chatbot users and won't impact their experience.
Different LLM models are suited to different tasks, such as text generation or summaries. Once you've connected your LLM Connector, the tasks the model can perform are displayed under the model name. You can create multiple connectors to the same LLM model.
- Select your team, and the chatbot you want to edit.
- Open the Manage section of the left navigation and click LLM Connectors.
- Click + LLM Connector.
- Select the LLM model you want to use.
Hover over a LLM model to see more information about the model. - Type a distinctive name for the connector.
You can edit this name from the connector's page. - Click Create.
- In the new LLM Connector page, click Connect.
Once connected, the tasks this model can perform is displayed under the model name.
To start using your new LLM Connector, create an LLM Usage.
Comments
Article is closed for comments.