Advanced settings for Chatbot profiles - Fluid Topics - Latest

Fluid Topics Configuration and Administration Guide

Category: Reference Guides
Audience: public
Version: Latest

It is possible to set the following advanced settings for Chatbot AI profiles:

Setting	Description
Number of results	The number of semantic search results sent to the LLM. The value of this field must be superior to `0`, and inferior to `50`. By default, the value is `50`.
Number of results after reranking	When the Enable reranking option is active, Fluid Topics reranks semantic search results before sending them to the LLM. The value must be smaller or equal to the number of semantic search results. Reranking can help with Chatbot relevance. See What is re-ranking?.
Prompts	When the Overwrite default prompts option is active, configure custom default prompts: RAG prompt: This retrieval-augmented generation (RAG) prompt asks the user question to the LLM. It must have the `{relevant_documents}` variable, and the `{chatbot_instructions}` variable. The `{relevant_documents}` variable dynamically contains the relevant documents (gotten through the Clustered semantic search web service), and the `{chatbot_instructions}` variable is the prompt set before the advanced settings. RAG history prompt: Asks the LLM to transform the user question and the conversation history into a standalone question asked to the LLM. See Chatbot architecture for a better understanding of the use of Chatbot prompts and reranking.