14 lines
517 B
Markdown
14 lines
517 B
Markdown
# CTO Eval Fixtures
|
|
|
|
This directory defines the deterministic fixture contracts for the CTO WebUI
|
|
promotion suite.
|
|
|
|
The fixture layer has two gates:
|
|
|
|
- `run-promotion-suite.py` validates that every PRD-required eval has a prompt,
|
|
required evidence, required CTO events, and safety gates.
|
|
- `run-promotion-fixtures.py` executes the fixture matrix in isolated local
|
|
state and writes event/evidence artifacts under `cto/evals/artifacts/`.
|
|
|
|
These gates do not claim Codex comparative parity or live LLM task solving.
|