> ## Documentation Index
> Fetch the complete documentation index at: https://koreai.mintlify.app/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom LLM Model in GenAI

The Disposition Summary (end-of-conversation summary) in Agent AI is auto-generated using a GenAI model. By default, the **OOTB Kore Summarization** model is used. You can configure your own model by creating a **Custom LLM** and selecting it for conversation summaries.

***

## Create a Custom LLM

1. Sign in to **AI for Service**.

2. Go to **Agent AI** > **Generative AI Tools** from the left navigation.

3. Select **Models Library** > **New Model** > **Custom Integration**.

   <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=d8948dac6643f15aee08f446d7adbc46" alt="New Model" width="1895" height="383" data-path="ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png" />

4. Select **Configurations** on the Custom Integration page.

   <img src="https://mintcdn.com/koreai/tihOjy93yEv5YdgF/ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png?fit=max&auto=format&n=tihOjy93yEv5YdgF&q=85&s=e7575b3deb8b80d7769bca64ec6bf5b9" alt="Configurations" width="695" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png" />

5. Enter the following details:

   | Field                | Description                                                                   |
   | -------------------- | ----------------------------------------------------------------------------- |
   | **Integration Name** | A name identifying the provider or LLM Models group.                          |
   | **Model Name**       | The LLM name for this integration. Multiple models can use the same endpoint. |
   | **Endpoint (POST)**  | The URL to connect to the LLM via API requests.                               |

6. Select **Headers** and enter the key-value credentials:
   * **Key**: For example, `api-key`.
   * **Value**: For example, `3d4f1cOdxxxxxxxxxxxxxxx`.

7. Select the **LLM and Generative Policy guidelines** checkbox.

8. Select **Next**.

   <img src="https://mintcdn.com/koreai/tihOjy93yEv5YdgF/ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png?fit=max&auto=format&n=tihOjy93yEv5YdgF&q=85&s=bbb5bb8ac4d087c202af4933f3e00cb2" alt="Configuration Details Next" width="710" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png" />

9. Enter a JSON request body (model, prompt, or other parameters) and select **Test**.

   <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=6f49e04f20ab2a2242f3ec37c704274c" alt="Request Prompt Test" width="933" height="697" data-path="ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png" />

10. Select **Save**.

    <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=34708ebbbfef987901038f53a87949ae" alt="Connection Save" width="615" height="604" data-path="ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png" />

11. Select **Create a Custom Prompt**.

    <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=e7bee215f6729520ce7beafcf510b6da" alt="Create a Custom Prompt" width="609" height="389" data-path="ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png" />

12. On the **Conversation Summary** page, fill in the following:

    | Field            | Description                                                                    |
    | ---------------- | ------------------------------------------------------------------------------ |
    | **Name**         | A name for the prompt. For example, *Summary Prompt*.                          |
    | **Feature**      | Select **Conversation Summary**.                                               |
    | **Choose Model** | Select the custom model you created. For example, *Custom test mode - gpt-4o*. |
    | **JSON**         | Enter your JSON content.                                                       |

    <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=d9b14ad8178b0ced20628d4adcfd470a" alt="Conversation Summary Page" width="1851" height="2075" data-path="ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png" />

    1. Select **Test**.
    2. Enter the response path in **Text Response Path**. For example, `choices[0].message.content`.
    3. Select **Lookup Path**. The summary is generated.
    4. Select **Save**.

    <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=d5f0cb34b09b538a008fbfc9cd77cd54" alt="Lookup Path Save" width="995" height="500" data-path="ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png" />

***

## Select the Custom Model

1. Sign in to **AI for Service**.
2. Go to **Agent AI** > **Generative AI Tools** > **GenAI Features**.
3. Search for `conversation summary` in the search box.
4. Select your model and prompt from the **MODEL** and **PROMPT** dropdowns.

   <img src="https://mintcdn.com/koreai/WVamVF5cb5NyLVNj/ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png?fit=max&auto=format&n=WVamVF5cb5NyLVNj&q=85&s=c8d2cee7ba73b3880d6c7a87d21940f2" alt="GenAI Features Model Selection" width="1006" height="227" data-path="ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png" />

***
