Create an annotation queue

POST 
/api/v1/evals/create-annotation-queue

Creates a review queue bound to a set of score configs — the scales reviewers will use on it.

The following access conditions are preserved as declared intent and are not implemented by generated code: Authorized scoped domain action.

Use this in a guide: Review and score turns

Request

Responses

200

OK

Schema-valid request illustration; replace example identifiers and confirm operation prerequisites.

Section ID: DOC-IS-evaluation-api-createAnnotationQueue#example-evals-createAnnotationQueue-request

Request example

{
  "name": "example",
  "scoreConfigIds": [
    "example_123"
  ]
}

Guide request for 2. Queue what needs reviewing. Replace example resource identifiers with your own authorized values.

Section ID: DOC-IS-evaluation-api-createAnnotationQueue#example-cookbook-insights-evaluation-review-02-request

Request example

{
  "name": "weekly-qa",
  "scoreConfigIds": [
    "cfg_helpfulness"
  ]
}

Illustrative response shape; omitted default fields and actual outcomes depend on the operation.

Section ID: DOC-IS-evaluation-api-createAnnotationQueue#example-evals-createAnnotationQueue-response

Response example

{
  "queueId": "example_123"
}

Document ID: DOC-IS-evaluation-api-createAnnotationQueue. Section identities and revisions.

Section	Stable reference
Create an annotation queue	DOC-IS-evaluation-api-createAnnotationQueue#overview
Request	DOC-IS-evaluation-api-createAnnotationQueue#request
Responses	DOC-IS-evaluation-api-createAnnotationQueue#responses