Skip to main content

PromptTokensDetails

Breakdown of prompt token usage by category (input-side cache accounting)

Usage profiles​

UsageFields and validation
In requestsView fields
In responsesView fields
In webhook payloadsView fields

In requests​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
cachedTokensinteger (int32)OptionalPrompt tokens served from cache (cache READ). Minimum: -2147483648. Maximum: 2147483647.
cacheWriteTokensinteger (int32)OptionalPrompt tokens written to cache this call (cache WRITE). Minimum: -2147483648. Maximum: 2147483647.
audioTokensinteger (int32)OptionalPrompt tokens from audio input (multimodal). Minimum: -2147483648. Maximum: 2147483647.
videoTokensinteger (int32)OptionalPrompt tokens from video input (multimodal). Minimum: -2147483648. Maximum: 2147483647.

In responses​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
cachedTokensinteger (int32)OptionalPrompt tokens served from cache (cache READ). Minimum: -2147483648. Maximum: 2147483647.
cacheWriteTokensinteger (int32)OptionalPrompt tokens written to cache this call (cache WRITE). Minimum: -2147483648. Maximum: 2147483647.
audioTokensinteger (int32)OptionalPrompt tokens from audio input (multimodal). Minimum: -2147483648. Maximum: 2147483647.
videoTokensinteger (int32)OptionalPrompt tokens from video input (multimodal). Minimum: -2147483648. Maximum: 2147483647.

In webhook payloads​

Webhook JSON uses protobuf field names (snake_case).

FieldTypePresenceMeaning
cached_tokensinteger (int32)OptionalPrompt tokens served from cache (cache READ). Minimum: -2147483648. Maximum: 2147483647.
cache_write_tokensinteger (int32)OptionalPrompt tokens written to cache this call (cache WRITE). Minimum: -2147483648. Maximum: 2147483647.
audio_tokensinteger (int32)OptionalPrompt tokens from audio input (multimodal). Minimum: -2147483648. Maximum: 2147483647.
video_tokensinteger (int32)OptionalPrompt tokens from video input (multimodal). Minimum: -2147483648. Maximum: 2147483647.

Where used​

ReferenceRelationship
Append a message without generatingPOST /api/v1/llm/append-message
Send a message to a conversationPOST /api/v1/llm/send-message
Send a message and wait for the resultPOST /api/v1/llm/send-message-sync
Withdraw your rating on a messagePOST /api/v1/llm/delete-message-rating
Get full conversation statePOST /api/v1/llm/conversation-state
Rate an assistant messagePOST /api/v1/llm/rate-message
Submit client-side tool results and wait for the next segmentPOST /api/v1/llm/submit-client-tool-results-sync
llm.generation_completedWebhook JSON uses protobuf field names (snake_case).
llm.message_publishedWebhook JSON uses protobuf field names (snake_case).
UsageNested in model
UsageNested in model
UsageNested in model

Download the public reference contract.

Document: DOC-API-MODEL-prompt-tokens-details.