Skip to main content
Section ID: DOC-API-MODEL-schema-ovc35nr9td#overview

AnnotationQueueItem

Evaluation object assigned to an annotation queue with completion state and attribution.

Meaning and usage​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#meaning

See the definition above.

Usage profiles​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#fields

UsageFields and validation
In responsesView fields

In responses​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#response

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-itemidSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-itemiditemIdstringOptionalIdentifier of the annotation queue item.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-queueidSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-queueidqueueIdstringOptionalIdentifier of the annotation queue.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-objectidSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-objectidobjectIdstringOptionalIdentifier of the evaluation object addressed by the annotation queue item.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-objecttypeSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-objecttypeobjectTypestring (EVAL_TARGET_TYPE_TRACE, EVAL_TARGET_TYPE_OBSERVATION, EVAL_TARGET_TYPE_DATASET_RUN, EVAL_TARGET_TYPE_SESSION) or integer (int32)Optional; explicit presenceKind of evaluation object addressed by the annotation queue item.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-statusSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-statusstatusstring (ANNOTATION_QUEUE_ITEM_STATUS_PENDING, ANNOTATION_QUEUE_ITEM_STATUS_COMPLETED) or integer (int32)Optional; explicit presenceCompletion state of the annotation queue item.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-completedatSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-completedatcompletedAtstring (date-time)OptionalTime when the operation was marked complete.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-completedbySection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-completedbycompletedBystringOptionalIdentifier of the user who completed the annotation queue item.
Section ID: DOC-API-MODEL-schema-ovc35nr9td#field-createdatSection ID: DOC-API-MODEL-schema-ovc35nr9td#response-field-createdatcreatedAtstring (date-time)OptionalTime when this record was created.

Values of objectType​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#response-values-objecttype

Kind of evaluation object a score or evaluation configuration addresses.

ValueNo.FormMeaning
EVAL_TARGET_TYPE_TRACE0CanonicalA complete trace identified by its trace identifier.
EVAL_TARGET_TYPE_OBSERVATION1CanonicalA specific observation within a trace.
EVAL_TARGET_TYPE_DATASET_RUN2CanonicalAn evaluation run over a dataset.
EVAL_TARGET_TYPE_SESSION3CanonicalA session grouping multiple traces. The evaluation harness attaches session-scoped judge scores directly; the provider does not expose a session-level evaluator target.

Values of status​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#response-values-status

Progress of a work item in a human annotation queue.

ValueNo.FormMeaning
ANNOTATION_QUEUE_ITEM_STATUS_PENDING0CanonicalThe item is waiting for its annotation to be completed.
ANNOTATION_QUEUE_ITEM_STATUS_COMPLETED1CanonicalAnnotation of the queue item has been completed.

Where used​

Section ID: DOC-API-MODEL-schema-ovc35nr9td#where-used

ReferenceRelationship
Complete an annotation queue itemPOST /api/v1/evals/complete-annotation-queue-item
List annotation queue itemsPOST /api/v1/evals/list-annotation-queue-items

Download the public reference contract.

Document ID: DOC-API-MODEL-schema-ovc35nr9td