Skip to main content

EvalOverview

Aggregated trace, score, latency, and profile metrics for an evaluation window.

Usage profiles​

UsageFields and validation
In responsesView fields

In responses​

API JSON uses JSON field names (camelCase).

FieldTypePresenceMeaning
totalTracesstring (int64)OptionalTotal trace count reported for the selected evaluation window. Pattern: ^-?\d+$.
tracesByNameArray of NamedCountOptionalTrace counts grouped by trace name.
tracesOverTimeArray of TimeSeriesPointOptionalTrace counts grouped into time buckets.
observationsByLevelArray of TimeSeriesPointOptionalObservation counts grouped by reported log level.
scoresArray of ScoreAggregateOptionalScore aggregates grouped separately by metric name and source.
scoreMovingAverageArray of TimeSeriesPointOptionalMoving-average score series returned for the selected window.
scoredTraceRationumber (double) or string (NaN, Infinity, -Infinity)OptionalCoverage card: share of traces carrying any score, and the annotated count.
annotatedTraceCountstring (int64)OptionalNumber of traces reported to have annotations in the selected window. Pattern: ^-?\d+$.
byProfileArray of ProfileQualityRowOptionalEvaluation metrics grouped by agent profile.
latencyPercentilesArray of LatencyPercentileRowOptionalLatency percentile summaries grouped by trace name.
recentLowScoresArray of ScoreOptionalRecent scores selected by the overview’s low-score query.

Where used​

ReferenceRelationship
Get the eval overviewPOST /api/v1/evals/get-overview

Download the public reference contract.

Document: DOC-API-MODEL-eval-overview.