Score
Evaluation score with its value, source, target identity, and generation attribution.
Usage profiles
| Usage | Fields and validation |
|---|---|
| In responses | View fields |
In responses
API JSON uses JSON field names (camelCase).
| Field | Type | Presence | Meaning |
|---|---|---|---|
scoreId | string | Optional | Identifier of the evaluation score. |
targetType | string (EVAL_TARGET_TYPE_TRACE, EVAL_TARGET_TYPE_OBSERVATION, EVAL_TARGET_TYPE_DATASET_RUN, EVAL_TARGET_TYPE_SESSION) or integer (int32) | Optional | Kind of evaluation object to which the score applies. |
targetId | string | Optional | Identifier of the evaluation object to which the score applies. |
name | string | Optional | Metric name identifying the recorded evaluation score. |
dataType | string (SCORE_DATA_TYPE_NUMERIC, SCORE_DATA_TYPE_CATEGORICAL, SCORE_DATA_TYPE_BOOLEAN, SCORE_DATA_TYPE_TEXT) or integer (int32) | Optional | Score value type used to interpret the numeric, categorical, or boolean value. |
numericValue | number (double) or string (NaN, Infinity, -Infinity) | Optional | Numeric score value reported by the evaluator. |
stringValue | string | Optional | String operand or score value used by the selected evaluation type. |
booleanValue | boolean | Optional | Boolean operand or score value used by the selected evaluation type. |
source | string (SCORE_SOURCE_JUDGE, SCORE_SOURCE_HUMAN, SCORE_SOURCE_USER, SCORE_SOURCE_HARNESS, SCORE_SOURCE_EVAL) or integer (int32) | Optional | Source classification reported for the evaluation score. |
comment | string | Optional | Explanatory text attached to the evaluation score. |
createdAt | string (date-time) | Optional | Time when this record was created. |
textValue | string | Optional | Text value of the evaluation score. |
authorUserId | string | Optional | Identifier recorded for the user who authored the score. |
configId | string | Optional | Identifier of the score configuration defining the score’s value domain. |
queueId | string | Optional | Identifier of the annotation queue. |
traceId | string | Optional | Identifier of the evaluation trace. |
observationId | string | Optional | Identifier of the evaluation observation. |
sessionId | string | Optional | Identifier of the evaluation session grouping related traces. |
datasetRunId | string | Optional | Identifier of the dataset run associated with the score. |
environment | string | Optional | Environment label attached to the evaluation record. |
metadataJson | string | Optional | Additional attributes serialized as a JSON object. |
updatedAt | string (date-time) | Optional | Time when this record was last updated. |
timestamp | string (date-time) | Optional | Timestamp associated with the conversation message or event. |
traceName | string | Optional | Denormalised for the Scores table's Trace Name column, which would otherwise need one trace read per row. |
userId | string | Optional | Identifier of the user associated with the operation. |
sourceLabel | string | Optional | Original evaluation-provider source label, such as API, ANNOTATION or EVAL. Interpret it alongside source and authorship: API alone does not distinguish an end-user rating from a harness, and a source label does not independently prove verified human provenance. |
conversationId | string | Optional | Conversation identifier recorded in the score's own metadata. Scores authored directly in the evaluation store can lack platform attribution; an empty link is not repaired by retrying. |
messageId | string | Optional | Identifier of the conversation message associated with the evaluation record. |
messageSequence | string (int64) | Optional | Sequence number of the evaluated message within its conversation. Pattern: ^-?\d+$. |
profileId | string | Optional | Identifier of the agent profile associated with the generation. |
configHash | string | Optional | Fingerprint of the profile ID, model and resolved prompt hash used to group evaluation results. Other settings are excluded; this is not an immutable profile revision. |
Values of targetType
Kind of evaluation object a score or evaluation configuration addresses.
| Value | No. | Form | Meaning |
|---|---|---|---|
EVAL_TARGET_TYPE_TRACE | 1 | Canonical | A complete trace identified by its trace identifier. |
EVAL_TARGET_TYPE_OBSERVATION | 2 | Canonical | A specific observation within a trace. |
EVAL_TARGET_TYPE_DATASET_RUN | 3 | Canonical | An evaluation run over a dataset. |
EVAL_TARGET_TYPE_SESSION | 4 | Canonical | A session grouping multiple traces; session scores are attached directly by the harness. |
Values of dataType
Data representation of an evaluation score or score configuration.
| Value | No. | Form | Meaning |
|---|---|---|---|
SCORE_DATA_TYPE_NUMERIC | 1 | Canonical | A numeric measurement or rating. |
SCORE_DATA_TYPE_CATEGORICAL | 2 | Canonical | A value chosen from a named set of categories. |
SCORE_DATA_TYPE_BOOLEAN | 3 | Canonical | A true-or-false evaluation result. |
SCORE_DATA_TYPE_TEXT | 4 | Canonical | Free-form text supplied by an evaluator or reviewer. |
Values of source
Platform classification of who produced an evaluation score; the provider source label preserves its original vocabulary.
| Value | No. | Form | Meaning |
|---|---|---|---|
SCORE_SOURCE_JUDGE | 1 | Canonical | A score produced by an automated judge. |
SCORE_SOURCE_HUMAN | 2 | Canonical | A score entered by a human reviewer through the annotation path. |
SCORE_SOURCE_USER | 3 | Canonical | Feedback supplied by an end user. |
SCORE_SOURCE_HARNESS | 4 | Canonical | A score written by an evaluation harness or another API-based producer. |
SCORE_SOURCE_EVAL | 5 | Canonical | A read-only score produced by the evaluation provider's managed evaluators; it cannot be written through the public score API. |
Where used
| Reference | Relationship |
|---|---|
| Get the eval overview | POST /api/v1/evals/get-overview |
| Get a session | POST /api/v1/evals/get-session |
| Get a trace | POST /api/v1/evals/get-trace |
| List observations | POST /api/v1/evals/list-observations |
| List scores | POST /api/v1/evals/list-scores |
| List sessions | POST /api/v1/evals/list-sessions |
| List traces | POST /api/v1/evals/list-traces |
| EvalOverview | Nested in model |
| Observation | Nested in model |
| SessionSummary | Nested in model |
| TraceDetail | Nested in model |
| TraceSummary | Nested in model |
Download the public reference contract.
Document: DOC-API-MODEL-score.