Evaluation matrix
Experiments
Seed, playground mock-eval, and frontend-eval runner experiments. Counts are row totals, not Index means.
Preview operational data. Rows carry origin seed, mock-eval, or runner. Mock-eval and frontend-eval runner rows are not public Index ranks.
| Experiment | State | Origin mix | Repetitions | Runs | Created |
|---|---|---|---|---|---|
| Phase 1 harness comparison exp_preview_primary Seed-only comparison across six synthetic tasks. | completed | 12 seed | 1 | 11/12 | 2026-08-05 |
| Reliability retry check exp_preview_retry Seed-only timeout behavior check on baseline. | partially_completed | No runs | 1 | 0/0 | 2026-08-06 |
| Playground mock eval channel exp_playground_mock Process-local playground runs (origin mock-eval). Excluded from Index publication aggregates. | running | 6 mock-eval | 1 | 6/6 | 2026-08-12 |
| Front-end eval 0.1.0 reference exp_frontend_eval Runner experiment for frontend-eval 0.1.0. Starts empty. Reference adapter runs are origin runner. | draft | 14 runner | 1 | 7/14 | 2026-08-12 |