List evaluation runs

⚠️
Preview — this feature is being built; the design below is the spec.
GET https://app.syntic.ai/v1/evals/runs

Return runs, newest first.

For how this fits into a full workflow, see Evaluations.

Headers

HeaderRequiredValue
AuthorizationYesBearer <key>: a private inference key (sk_live_...). See Authentication.
syntic-betaYes, while in previewevals-2026-12-01. Without it the call fails with 400 beta_required. See Versioning.

Query parameters

ParameterTypeDefaultDescription
dataset_idstring
statusstring
limitinteger201 to 100.
after_idstringNext page: the previous page’s last_id.
before_idstringPrevious page: the previous page’s first_id.

Response

200 OK, Content-Type: application/json

{
  "data": [
    {
      "id": "evrun_01JD35D7F9H1K3M5P7R9",
      "type": "eval_run",
      "name": "shorter system prompt vs baseline",
      "dataset_id": "evds_01JD13B5D7F9H1K3M5P7",
      "status": "succeeded",
      "variants": [
        {
          "label": "baseline",
          "model": "Amara S1.2",
          "prompt_version": "support-v12"
        },
        {
          "label": "short",
          "model": "Amara S1.2",
          "prompt_version": "support-v13"
        }
      ],
      "grader_ids": [
        "evgr_01JD46E8G0J2L4N6Q8S0"
      ],
      "progress": {
        "total": 400,
        "done": 400,
        "errored": 0
      },
      "summary": [
        {
          "label": "baseline",
          "pass_rate": 0.82,
          "mean_score": 4.11,
          "mean_output_tokens": 141,
          "cost_usd": "1.8410"
        },
        {
          "label": "short",
          "pass_rate": 0.86,
          "mean_score": 4.25,
          "mean_output_tokens": 98,
          "cost_usd": "1.4022"
        }
      ],
      "created_at": "2026-11-05T10:00:00Z",
      "finished_at": "2026-11-05T10:09:40Z"
    }
  ],
  "has_more": false,
  "first_id": "evrun_01JD35D7F9H1K3M5P7R9",
  "last_id": "evrun_01JD35D7F9H1K3M5P7R9"
}
FieldTypeDescription
dataarrayThe objects on this page, newest first.
has_morebooleantrue when another page exists after this one.
first_idstring or nullPass as before_id to go back a page.
last_idstring or nullPass as after_id to get the next page.

Examples

curl -sS "https://app.syntic.ai/v1/evals/runs" \
  -H "Authorization: Bearer $SYNTIC_API_KEY" \
  -H "syntic-beta: evals-2026-12-01"

Errors

Errors use the error envelope and carry a request_id. Codes specific to this operation:

StatustypecodeWhen
400invalid_request_errorbeta_requiredThe syntic-beta header is missing.
401authentication_errorinvalid_api_keyThe key is missing, unknown, revoked or expired.
429rate_limit_errorrate_limitedToo many requests; wait for Retry-After. See Rate-limit headers.
Was this page helpful?