Cancel an evaluation run

⚠️
Preview — this feature is being built; the design below is the spec.
POST https://app.syntic.ai/v1/evals/runs/{eval_run_id}/cancel

Stop a run. Items already generated and graded stay in the results and are billed.

For how this fits into a full workflow, see Evaluations.

Headers

HeaderRequiredValue
AuthorizationYesBearer <key>: a private inference key (sk_live_...). See Authentication.
syntic-betaYes, while in previewevals-2026-12-01. Without it the call fails with 400 beta_required. See Versioning.
Idempotency-KeyNoUp to 255 characters. Retrying with the same key within 24 hours returns the first result instead of acting twice. See Idempotency.

Path parameters

ParameterTypeDescription
eval_run_idstringStarts with evrun_.

Response

200 OK, Content-Type: application/json

{
  "id": "evrun_01JD35D7F9H1K3M5P7R9",
  "type": "eval_run",
  "name": "shorter system prompt vs baseline",
  "dataset_id": "evds_01JD13B5D7F9H1K3M5P7",
  "status": "canceled",
  "variants": [
    {
      "label": "baseline",
      "model": "Amara S1.2",
      "prompt_version": "support-v12"
    },
    {
      "label": "short",
      "model": "Amara S1.2",
      "prompt_version": "support-v13"
    }
  ],
  "grader_ids": [
    "evgr_01JD46E8G0J2L4N6Q8S0"
  ],
  "progress": {
    "total": 400,
    "done": 131,
    "errored": 0
  },
  "summary": null,
  "created_at": "2026-11-05T10:00:00Z",
  "finished_at": "2026-11-05T10:09:40Z"
}
FieldTypeDescription
variantsarrayUp to 4 prompt and model combinations, each run on every item.
progressobjectItems done per variant summed across variants.
summaryarrayPer variant: pass rate, mean score, mean output length and cost, once finished.
statusstringqueued, running, succeeded, failed or canceled.

Examples

curl -sS -X POST "https://app.syntic.ai/v1/evals/runs/evrun_01JD35D7F9H1K3M5P7R9/cancel" \
  -H "Authorization: Bearer $SYNTIC_API_KEY" \
  -H "syntic-beta: evals-2026-12-01" \
  -H "Idempotency-Key: 8d6f0c1e-4b2a-4a57-9f0e-2f1d3c4b5a69"

Errors

Errors use the error envelope and carry a request_id. Codes specific to this operation:

StatustypecodeWhen
400invalid_request_errorbeta_requiredThe syntic-beta header is missing.
409conflict_errorrun_finishedThe run already ended.
404not_found_erroreval_run_not_foundNo run with this id.
401authentication_errorinvalid_api_keyThe key is missing, unknown, revoked or expired.
429rate_limit_errorrate_limitedToo many requests; wait for Retry-After. See Rate-limit headers.
Was this page helpful?