Get an evaluation run
⚠️
Preview — this feature is being built; the design below is the spec.
GET https://app.syntic.ai/v1/evals/runs/{eval_run_id}Return a run’s progress and, when finished, its per-variant summary.
For how this fits into a full workflow, see Evaluations.
Headers
| Header | Required | Value |
|---|---|---|
Authorization | Yes | Bearer <key>: a private inference key (sk_live_...). See Authentication. |
syntic-beta | Yes, while in preview | evals-2026-12-01. Without it the call fails with 400 beta_required. See Versioning. |
Path parameters
| Parameter | Type | Description |
|---|---|---|
eval_run_id | string | Starts with evrun_. |
Response
200 OK, Content-Type: application/json
{
"id": "evrun_01JD35D7F9H1K3M5P7R9",
"type": "eval_run",
"name": "shorter system prompt vs baseline",
"dataset_id": "evds_01JD13B5D7F9H1K3M5P7",
"status": "succeeded",
"variants": [
{
"label": "baseline",
"model": "Amara S1.2",
"prompt_version": "support-v12"
},
{
"label": "short",
"model": "Amara S1.2",
"prompt_version": "support-v13"
}
],
"grader_ids": [
"evgr_01JD46E8G0J2L4N6Q8S0"
],
"progress": {
"total": 400,
"done": 400,
"errored": 0
},
"summary": [
{
"label": "baseline",
"pass_rate": 0.82,
"mean_score": 4.11,
"mean_output_tokens": 141,
"cost_usd": "1.8410"
},
{
"label": "short",
"pass_rate": 0.86,
"mean_score": 4.25,
"mean_output_tokens": 98,
"cost_usd": "1.4022"
}
],
"created_at": "2026-11-05T10:00:00Z",
"finished_at": "2026-11-05T10:09:40Z"
}| Field | Type | Description |
|---|---|---|
variants | array | Up to 4 prompt and model combinations, each run on every item. |
progress | object | Items done per variant summed across variants. |
summary | array | Per variant: pass rate, mean score, mean output length and cost, once finished. |
status | string | queued, running, succeeded, failed or canceled. |
Examples
curl -sS "https://app.syntic.ai/v1/evals/runs/evrun_01JD35D7F9H1K3M5P7R9" \
-H "Authorization: Bearer $SYNTIC_API_KEY" \
-H "syntic-beta: evals-2026-12-01"Errors
Errors use the error envelope and carry a request_id. Codes specific to this operation:
| Status | type | code | When |
|---|---|---|---|
| 400 | invalid_request_error | beta_required | The syntic-beta header is missing. |
| 404 | not_found_error | eval_run_not_found | No run with this id. |
| 401 | authentication_error | invalid_api_key | The key is missing, unknown, revoked or expired. |
| 429 | rate_limit_error | rate_limited | Too many requests; wait for Retry-After. See Rate-limit headers. |
Was this page helpful?