Skip to main content

ProfileQualityRow

Aggregated evaluation results and usage for one agent profile.

Usage profiles​

UsageFields and validation
In responsesView fields

In responses​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
profileIdstringOptionalIdentifier of the agent profile associated with the generation.
traceCountstring (int64)OptionalNumber of traces represented by this summary or group. Pattern: ^-?\d+$.
avgEndUserRatingnumber (double) or string (NaN, Infinity, -Infinity)OptionalAverage end-user rating reported for the selected generation group.
avgJudgeScorenumber (double) or string (NaN, Infinity, -Infinity)OptionalAverage automated judge score reported for the selected generation group.
thumbsDownCountstring (int64)OptionalNumber of negative thumb ratings reported for the selected group. Pattern: ^-?\d+$.

Where used​

ReferenceRelationship
Get the eval overviewPOST /api/v1/evals/get-overview
EvalOverviewNested in model

Download the public reference contract.

Document: DOC-API-MODEL-profile-quality-row.