Skip to main content

Score

Evaluation score with its value, source, target identity, and generation attribution.

Usage profiles​

UsageFields and validation
In responsesView fields

In responses​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
scoreIdstringOptionalIdentifier of the evaluation score.
targetTypestring (EVAL_TARGET_TYPE_TRACE, EVAL_TARGET_TYPE_OBSERVATION, EVAL_TARGET_TYPE_DATASET_RUN, EVAL_TARGET_TYPE_SESSION) or integer (int32)OptionalKind of evaluation object to which the score applies.
targetIdstringOptionalIdentifier of the evaluation object to which the score applies.
namestringOptionalMetric name identifying the recorded evaluation score.
dataTypestring (SCORE_DATA_TYPE_NUMERIC, SCORE_DATA_TYPE_CATEGORICAL, SCORE_DATA_TYPE_BOOLEAN, SCORE_DATA_TYPE_TEXT) or integer (int32)OptionalScore value type used to interpret the numeric, categorical, or boolean value.
numericValuenumber (double) or string (NaN, Infinity, -Infinity)OptionalNumeric score value reported by the evaluator.
stringValuestringOptionalString operand or score value used by the selected evaluation type.
booleanValuebooleanOptionalBoolean operand or score value used by the selected evaluation type.
sourcestring (SCORE_SOURCE_JUDGE, SCORE_SOURCE_HUMAN, SCORE_SOURCE_USER, SCORE_SOURCE_HARNESS, SCORE_SOURCE_EVAL) or integer (int32)OptionalSource classification reported for the evaluation score.
commentstringOptionalExplanatory text attached to the evaluation score.
createdAtstring (date-time)OptionalTime when this record was created.
textValuestringOptionalText value of the evaluation score.
authorUserIdstringOptionalIdentifier recorded for the user who authored the score.
configIdstringOptionalIdentifier of the score configuration defining the score’s value domain.
queueIdstringOptionalIdentifier of the annotation queue.
traceIdstringOptionalIdentifier of the evaluation trace.
observationIdstringOptionalIdentifier of the evaluation observation.
sessionIdstringOptionalIdentifier of the evaluation session grouping related traces.
datasetRunIdstringOptionalIdentifier of the dataset run associated with the score.
environmentstringOptionalEnvironment label attached to the evaluation record.
metadataJsonstringOptionalAdditional attributes serialized as a JSON object.
updatedAtstring (date-time)OptionalTime when this record was last updated.
timestampstring (date-time)OptionalTimestamp associated with the conversation message or event.
traceNamestringOptionalDenormalised for the Scores table's Trace Name column, which would otherwise need one trace read per row.
userIdstringOptionalIdentifier of the user associated with the operation.
sourceLabelstringOptionalOriginal evaluation-provider source label, such as API, ANNOTATION or EVAL. Interpret it alongside source and authorship: API alone does not distinguish an end-user rating from a harness, and a source label does not independently prove verified human provenance.
conversationIdstringOptionalConversation identifier recorded in the score's own metadata. Scores authored directly in the evaluation store can lack platform attribution; an empty link is not repaired by retrying.
messageIdstringOptionalIdentifier of the conversation message associated with the evaluation record.
messageSequencestring (int64)OptionalSequence number of the evaluated message within its conversation. Pattern: ^-?\d+$.
profileIdstringOptionalIdentifier of the agent profile associated with the generation.
configHashstringOptionalFingerprint of the profile ID, model and resolved prompt hash used to group evaluation results. Other settings are excluded; this is not an immutable profile revision.

Values of targetType​

Kind of evaluation object a score or evaluation configuration addresses.

ValueNo.FormMeaning
EVAL_TARGET_TYPE_TRACE1CanonicalA complete trace identified by its trace identifier.
EVAL_TARGET_TYPE_OBSERVATION2CanonicalA specific observation within a trace.
EVAL_TARGET_TYPE_DATASET_RUN3CanonicalAn evaluation run over a dataset.
EVAL_TARGET_TYPE_SESSION4CanonicalA session grouping multiple traces; session scores are attached directly by the harness.

Values of dataType​

Data representation of an evaluation score or score configuration.

ValueNo.FormMeaning
SCORE_DATA_TYPE_NUMERIC1CanonicalA numeric measurement or rating.
SCORE_DATA_TYPE_CATEGORICAL2CanonicalA value chosen from a named set of categories.
SCORE_DATA_TYPE_BOOLEAN3CanonicalA true-or-false evaluation result.
SCORE_DATA_TYPE_TEXT4CanonicalFree-form text supplied by an evaluator or reviewer.

Values of source​

Platform classification of who produced an evaluation score; the provider source label preserves its original vocabulary.

ValueNo.FormMeaning
SCORE_SOURCE_JUDGE1CanonicalA score produced by an automated judge.
SCORE_SOURCE_HUMAN2CanonicalA score entered by a human reviewer through the annotation path.
SCORE_SOURCE_USER3CanonicalFeedback supplied by an end user.
SCORE_SOURCE_HARNESS4CanonicalA score written by an evaluation harness or another API-based producer.
SCORE_SOURCE_EVAL5CanonicalA read-only score produced by the evaluation provider's managed evaluators; it cannot be written through the public score API.

Where used​

ReferenceRelationship
Get the eval overviewPOST /api/v1/evals/get-overview
Get a sessionPOST /api/v1/evals/get-session
Get a tracePOST /api/v1/evals/get-trace
List observationsPOST /api/v1/evals/list-observations
List scoresPOST /api/v1/evals/list-scores
List sessionsPOST /api/v1/evals/list-sessions
List tracesPOST /api/v1/evals/list-traces
EvalOverviewNested in model
ObservationNested in model
SessionSummaryNested in model
TraceDetailNested in model
TraceSummaryNested in model

Download the public reference contract.

Document: DOC-API-MODEL-score.