Add a dataset item
POST/api/v1/evals/add-dataset-item
Adds a dataset item. The ID is derived from the dataset and sourceUserMessageId when supplied, otherwise from the source trace ID. Repeating that identity addresses the same item; a source identity must be meaningful and stable. Provide the intended input and expected output explicitly: the current API does not fetch a gold answer from a source trace.
Dataset input capture and identity
| Input or identity | Contract |
|---|---|
| Dataset item address | Derived from the dataset and source turn. Adding the same turn to different datasets produces different items. |
inputJson and expected output | Only supplied content is recorded; an empty input does not trigger automatic context capture. |
| Retry or replacement | A stable item ID does not establish ordering between a stale retry and a newer curated revision. Reconcile the stored item before retrying. |
Capture and curate source material explicitly, including redaction, omitted fields and the provenance of tool or memory fixtures.
Request
Responses
- 200
OK
Document ID: DOC-IS-evaluation-api-addDatasetItem. Section identities and revisions.
| Section | Stable reference |
|---|---|
| Overview | DOC-IS-evaluation-api-addDatasetItem#overview |
| Request | DOC-IS-evaluation-api-addDatasetItem#request |
| Responses | DOC-IS-evaluation-api-addDatasetItem#responses |