Skip to main content
Section ID: DOC-API-MODEL-schema-1jku9efe5c#overview

ProfileQualityRow

Aggregated evaluation results and usage for one agent profile.

Meaning and usage​

Section ID: DOC-API-MODEL-schema-1jku9efe5c#meaning

See the definition above.

Usage profiles​

Section ID: DOC-API-MODEL-schema-1jku9efe5c#fields

UsageFields and validation
In responsesView fields

In responses​

Section ID: DOC-API-MODEL-schema-1jku9efe5c#response

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
Section ID: DOC-API-MODEL-schema-1jku9efe5c#field-profileidSection ID: DOC-API-MODEL-schema-1jku9efe5c#response-field-profileidprofileIdstringOptionalIdentifier of the agent profile associated with the generation.
Section ID: DOC-API-MODEL-schema-1jku9efe5c#field-tracecountSection ID: DOC-API-MODEL-schema-1jku9efe5c#response-field-tracecounttraceCountstring (int64)OptionalNumber of traces represented by this summary or group. Pattern: ^-?\d+$.
Section ID: DOC-API-MODEL-schema-1jku9efe5c#field-avgenduserratingSection ID: DOC-API-MODEL-schema-1jku9efe5c#response-field-avgenduserratingavgEndUserRatingnumber (double) or string (NaN, Infinity, -Infinity)OptionalAverage end-user rating reported for the selected generation group.
Section ID: DOC-API-MODEL-schema-1jku9efe5c#field-avgjudgescoreSection ID: DOC-API-MODEL-schema-1jku9efe5c#response-field-avgjudgescoreavgJudgeScorenumber (double) or string (NaN, Infinity, -Infinity)OptionalAverage automated judge score reported for the selected generation group.
Section ID: DOC-API-MODEL-schema-1jku9efe5c#field-thumbsdowncountSection ID: DOC-API-MODEL-schema-1jku9efe5c#response-field-thumbsdowncountthumbsDownCountstring (int64)OptionalNumber of negative thumb ratings reported for the selected group. Pattern: ^-?\d+$.

Where used​

Section ID: DOC-API-MODEL-schema-1jku9efe5c#where-used

ReferenceRelationship
Get the eval overviewPOST /api/v1/evals/get-overview
Models containing this value
ModelRelationship
EvalOverviewNested in model

Download the public reference contract.

Document ID: DOC-API-MODEL-schema-1jku9efe5c