hermes/cto
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13184e0576
cto/evals/fixtures
History
Svrnty 4ed306928a Upgrade CTO webui coding profile
2026-05-25 12:57:33 -04:00
..
manifest.yaml Upgrade CTO webui coding profile 2026-05-25 12:57:33 -04:00
README.md Upgrade CTO webui coding profile 2026-05-25 12:57:33 -04:00

README.md

CTO Eval Fixtures

This directory defines the deterministic fixture contracts for the CTO WebUI promotion suite.

The fixture layer has two gates:

  • run-promotion-suite.py validates that every PRD-required eval has a prompt, required evidence, required CTO events, and safety gates.
  • run-promotion-fixtures.py executes the fixture matrix in isolated local state and writes event/evidence artifacts under cto/evals/artifacts/.

These gates do not claim Codex comparative parity or live LLM task solving.