Experiment detail
Phase 1 harness comparison
Seed-only comparison across six synthetic tasks.
Preview operational data. Rows carry origin seed, mock-eval, or runner. Mock-eval and frontend-eval runner rows are not public Index ranks.
- State
- completedPreview
- Suite
- 1.0.0-previewPreview
- Origin mix
- 12 seedPreview
- Runs
- 12Preview
| Run | Harness | Task | Origin | State | Score | Cost |
|---|---|---|---|---|---|---|
| run_preview_0_0 | Baseline Loop | Print environment marker | seed | completed | 0.720 | $0.0040 |
| run_preview_1_0 | Structured ReAct | Print environment marker | seed | completed | 0.960 | $0.0050 |
| run_preview_0_1 | Baseline Loop | Count fixture lines | seed | completed | 0.680 | $0.0046 |
| run_preview_1_1 | Structured ReAct | Count fixture lines | seed | completed | 0.910 | $0.0056 |
| run_preview_0_2 | Baseline Loop | Apply configuration patch | seed | completed | 0.610 | $0.0052 |
| run_preview_1_2 | Structured ReAct | Apply configuration patch | seed | completed | 0.880 | $0.0062 |
| run_preview_0_3 | Baseline Loop | Build shell pipeline | seed | completed | 0.660 | $0.0058 |
| run_preview_1_3 | Structured ReAct | Build shell pipeline | seed | completed | 0.900 | $0.0068 |
| run_preview_0_4 | Baseline Loop | Refactor brittle script | seed | completed | 0.310 | $0.0064 |
| run_preview_1_4 | Structured ReAct | Refactor brittle script | seed | completed | 0.780 | $0.0074 |
| run_preview_0_5 | Baseline Loop | Avoid infinite loop | seed | failed | 0.000 | $0.0070 |
| run_preview_1_5 | Structured ReAct | Avoid infinite loop | seed | completed | 0.840 | $0.0080 |