Update default generation config

POST /api/v1/llm/update-default-generation-config

Updates the conversation’s default generation configuration for later messages. An active profile supplies the base configuration when selected; populated per-request overrides take precedence. Conversation memory settings fill settings omitted by an active profile.

Use this in a guide: Use remembered preferences in a returning user’s conversation · Configure a support conversation that stays predictable · Profile selection and prompt versions

Request

Responses

Generation config updated

Replace the default generation configuration on an existing conversation.

Section ID: DOC-MA-conversations-api-updateDefaultGenerationConfig#example-conversations-updateDefaultGenerationConfig-request

Request example

{
  "conversationKey": "example_123",
  "defaultGenerationConfig": {
    "languagePreference": "en-US",
    "maxOutputTokens": 512
  }
}

Guide request for Step 1: Set the model and answer length. Replace example resource identifiers with your own authorized values.

Section ID: DOC-MA-conversations-api-updateDefaultGenerationConfig#example-cookbook-managed-agents-conversations-configuration-01-request

Request example

{
  "conversationKey": "support-chat-001",
  "defaultGenerationConfig": {
    "model": "anthropic/claude-sonnet-5",
    "temperature": 0.7,
    "maxOutputTokens": 2048,
    "topP": 0.9
  }
}

Guide request for Step 4: Include relevant memory in later replies. Replace example resource identifiers with your own authorized values.

Section ID: DOC-MA-conversations-api-updateDefaultGenerationConfig#example-cookbook-managed-agents-memory-knowledge-index-json-02-request

Request example

{
  "conversationKey": "conv_abc",
  "defaultGenerationConfig": {
    "mem0": {
      "enabled": true,
      "searchTopK": 5,
      "searchThreshold": 0.3,
      "injectAsSystemContext": true,
      "injectMemoryTimestamps": true
    }
  }
}

Illustrative response shape; omitted default fields and actual outcomes depend on the operation.

Section ID: DOC-MA-conversations-api-updateDefaultGenerationConfig#example-conversations-updateDefaultGenerationConfig-response

Response example

{
  "defaultGenerationConfig": {
    "model": "example",
    "models": [
      "example"
    ],
    "systemPrompt": "Example text",
    "modelRoutingFilter": {
      "minContextLength": "1",
      "minMaxCompletionTokens": "1",
      "requiredInputModalities": [
        "example"
      ],
      "requiredOutputModalities": [
        "example"
      ],
      "maxPromptCost": 1,
      "maxCompletionCost": 1,
      "excludeModerated": true,
      "requiredParameters": [
        "example"
      ]
    },
    "provider": {
      "order": [
        "example"
      ],
      "allowFallbacks": true,
      "requireParameters": true,
      "dataCollection": "DATA_COLLECTION_MODE_ALLOW",
      "zdr": true,
      "only": [
        "example"
      ],
      "ignore": [
        "example"
      ],
      "quantizations": [
        "example"
      ],
      "sort": "PROVIDER_SORT_PRICE",
      "enforceDistillableText": true
    },
    "reasoning": {
      "effort": "EFFORT_HIGH",
      "maxTokens": 1,
      "exclude": true,
      "includeReasoningHistory": true
    },
    "usage": {
      "include": true
    },
    "transforms": [
      "example"
    ],
    "tools": [
      {
        "name": "example",
        "description": "example",
        "serverId": "example_123",
        "tags": [
          "example"
        ],
        "documentationUrl": "https://example.com/resource"
      }
    ],
    "toolChoice": {
      "kind": "TOOL_CHOICE_KIND_AUTO",
      "specificToolName": "example"
    },
    "clientTools": [
      {
        "name": "example",
        "description": "example",
        "serverId": "example_123",
        "tags": [
          "example"
        ],
        "documentationUrl": "https://example.com/resource"
      }
    ],
    "toolPolicy": {
      "requireApprovalToolNamePatterns": [
        "example"
      ],
      "requireApprovalServerIds": [
        "example_123"
      ],
      "autoApproveToolNamePatterns": [
        "example"
      ],
      "autoApproveServerIds": [
        "example_123"
      ],
      "approvalMode": "APPROVAL_MODE_MIXED",
      "clientToolMode": "CLIENT_TOOL_MODE_MIXED",
      "approvalTimeoutMs": 1,
      "failOnApprovalTimeoutToolNamePatterns": [
        "example"
      ],
      "stableSortByCallIndexOnTie": true,
      "maxParallelToolCalls": 1,
      "maxToolCallsPerLoop": 1,
      "maxTotalToolCalls": 1,
      "retriableToolNamePatterns": [
        "example"
      ],
      "maxRetries": 1,
      "retryableErrorSubstrings": [
        "example"
      ],
      "nonRetryableErrorSubstrings": [
        "example"
      ],
      "clientToolTimeoutMs": 1,
      "failureMode": "FAILURE_MODE_CONTINUE"
    },
    "temperature": 1,
    "topP": 1,
    "maxOutputTokens": 1,
    "frequencyPenalty": 1,
    "presencePenalty": 1,
    "stopSequences": [
      "example"
    ],
    "seed": "1",
    "responseFormat": {
      "jsonObject": true,
      "schemaName": "example",
      "validate": true,
      "maxValidationRetries": 1,
      "responseHealing": true
    },
    "allowParallelToolCalls": true,
    "topK": 1,
    "repetitionPenalty": 1,
    "logitBias": {},
    "topLogprobs": 1,
    "minP": 1,
    "topA": 1,
    "user": "example",
    "modalities": [
      "MODALITY_TEXT"
    ],
    "plugins": [
      {
        "id": "example_123"
      }
    ],
    "languagePreference": "en-US",
    "timeAware": {
      "includeCurrentTime": true,
      "includeMessageTimestamps": true,
      "includeFileTimestamps": true,
      "timezone": "example",
      "timestampFormat": ""
    },
    "turnContext": {
      "enabled": true,
      "includeToolGuidance": true,
      "format": "minimal"
    },
    "mem0": {
      "enabled": true,
      "searchTopK": 1,
      "searchThreshold": 1,
      "injectAsSystemContext": true,
      "searchQueryOverride": "Example text",
      "enableRerank": true,
      "addMemoriesAsync": true,
      "customExtractionPrompt": "Example text",
      "enableGraph": true,
      "agentIdOverride": "example_123",
      "exposeAsMcpTool": true,
      "includeAssistantMessages": true,
      "injectMemoryTimestamps": true
    },
    "requestTimeoutSeconds": 1,
    "fileResolution": {
      "failureMode": "FILE_RESOLUTION_FAILURE_MODE_FAIL_GENERATION"
    },
    "clearTools": true
  }
}

Document ID: DOC-MA-conversations-api-updateDefaultGenerationConfig. Section identities and revisions.

Section	Stable reference
Update default generation config	`DOC-MA-conversations-api-updateDefaultGenerationConfig#overview`
Request	`DOC-MA-conversations-api-updateDefaultGenerationConfig#request`
Responses	`DOC-MA-conversations-api-updateDefaultGenerationConfig#responses`

Update default generation config

/api/v1/llm/update-default-generation-config

Request​

Responses​

Replace the default generation configuration on an existing conversation.​

Guide request for Step 1: Set the model and answer length. Replace example resource identifiers with your own authorized values.​

Guide request for Step 4: Include relevant memory in later replies. Replace example resource identifiers with your own authorized values.​

Illustrative response shape; omitted default fields and actual outcomes depend on the operation.​

Request

Responses

Replace the default generation configuration on an existing conversation.

Guide request for Step 1: Set the model and answer length. Replace example resource identifiers with your own authorized values.

Guide request for Step 4: Include relevant memory in later replies. Replace example resource identifiers with your own authorized values.

Illustrative response shape; omitted default fields and actual outcomes depend on the operation.