AnnotationQueueItem
Evaluation object assigned to an annotation queue with completion state and attribution.
Usage profiles
| Usage | Fields and validation |
|---|---|
| In responses | View fields |
In responses
API JSON uses JSON field names (camelCase).
| Field | Type | Presence | Meaning |
|---|---|---|---|
itemId | string | Optional | Identifier of the dataset or annotation queue item. |
queueId | string | Optional | Identifier of the annotation queue. |
objectId | string | Optional | Identifier of the evaluation object addressed by the comment or queue item. |
objectType | string (EVAL_TARGET_TYPE_TRACE, EVAL_TARGET_TYPE_OBSERVATION, EVAL_TARGET_TYPE_DATASET_RUN, EVAL_TARGET_TYPE_SESSION) or integer (int32) | Optional | Kind of evaluation object addressed by the comment or annotation queue item. |
status | string (ANNOTATION_QUEUE_ITEM_STATUS_PENDING, ANNOTATION_QUEUE_ITEM_STATUS_COMPLETED) or integer (int32) | Optional | Completion state of the annotation queue item. |
completedAt | string (date-time) | Optional | Time when the operation was marked complete. |
completedBy | string | Optional | Identifier of the user who completed the annotation queue item. |
createdAt | string (date-time) | Optional | Time when this record was created. |
Values of objectType
Kind of evaluation object a score or evaluation configuration addresses.
| Value | No. | Form | Meaning |
|---|---|---|---|
EVAL_TARGET_TYPE_TRACE | 1 | Canonical | A complete trace identified by its trace identifier. |
EVAL_TARGET_TYPE_OBSERVATION | 2 | Canonical | A specific observation within a trace. |
EVAL_TARGET_TYPE_DATASET_RUN | 3 | Canonical | An evaluation run over a dataset. |
EVAL_TARGET_TYPE_SESSION | 4 | Canonical | A session grouping multiple traces; session scores are attached directly by the harness. |
Values of status
Progress of a work item in a human annotation queue.
| Value | No. | Form | Meaning |
|---|---|---|---|
ANNOTATION_QUEUE_ITEM_STATUS_PENDING | 1 | Canonical | The item is waiting for its annotation to be completed. |
ANNOTATION_QUEUE_ITEM_STATUS_COMPLETED | 2 | Canonical | Annotation of the queue item has been completed. |
Where used
| Reference | Relationship |
|---|---|
| Complete an annotation queue item | POST /api/v1/evals/complete-annotation-queue-item |
| List annotation queue items | POST /api/v1/evals/list-annotation-queue-items |
Download the public reference contract.
Document: DOC-API-MODEL-annotation-queue-item.