cto/evals/fixtures/README.md
2026-05-25 12:57:33 -04:00

517 B

CTO Eval Fixtures

This directory defines the deterministic fixture contracts for the CTO WebUI promotion suite.

The fixture layer has two gates:

  • run-promotion-suite.py validates that every PRD-required eval has a prompt, required evidence, required CTO events, and safety gates.
  • run-promotion-fixtures.py executes the fixture matrix in isolated local state and writes event/evidence artifacts under cto/evals/artifacts/.

These gates do not claim Codex comparative parity or live LLM task solving.