Skip to main content

DatasetRunItem

One item of a dataset run: which dataset item was executed, and the trace it produced.

Usage profiles​

UsageFields and validation
In requestsView fields

In requests​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
datasetItemIdstringRequired in requestsIdentifier of the dataset item used by this evaluation run. Minimum length: 1.
traceIdstringRequired in requestsIdentifier of the evaluation trace. Minimum length: 1.
observationIdstringOptionalOptional: pin the run to one observation inside the trace rather than the whole turn, for a harness that scores a single generation.

Request validation​

These rules apply when this value is supplied in a request. Request validation does not guarantee that response fields are present or satisfy the same rules.

Applies toRuleRequirement
datasetItemIdMinimum length1
traceIdMinimum length1

Where used​

ReferenceRelationship
Record a dataset runPOST /api/v1/evals/record-dataset-run

Download the public reference contract.

Document: DOC-API-MODEL-dataset-run-item.