Test V1 / Phase 2 · Historical / Provisional
Phase 2 aggregate ranking
Historical/provisional aggregate over all five harnesses. The score is the arithmetic mean of the ten binary public/hidden indicators across five records; a harness passes only when both evaluators pass.
You are viewing Test V1 / Phase 2, which remains Historical / Provisional. Return to the Test V1 / Phase 1 results. Test V2 begins with Phase 3, which is planned; no Phase 3 results exist yet.
Historical / Provisional — not a blind benchmark
31candidates
155task records
146 / 134public / hidden passes
0forbidden changes
Complete candidate results
Activate any column heading to sort. Activate it again to reverse direction.
31 rows
| 1 | gpt-5.6-sol47-gpt-5-6-sol | 5/5 | 5 | 5 | 0 | 1.00 | 0.177 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 2 | gpt-5.6-terra48-gpt-5-6-terra | 5/5 | 5 | 5 | 0 | 1.00 | 0.179 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 3 | gpt-5.6-luna46-gpt-5-6-luna | 5/5 | 5 | 5 | 0 | 1.00 | 0.179 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 4 | opencode-go/gpt-5.6-luna01-gpt-5-6-luna | 5/5 | 5 | 5 | 0 | 1.00 | 0.179 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 5 | opencode/claude-opus-553-claude-opus-5 | 5/5 | 5 | 5 | 0 | 1.00 | 0.180 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 6 | opencode-go/kimi-k310-kimi-k3 | 5/5 | 5 | 5 | 0 | 1.00 | 0.180 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 7 | opencode/claude-sonnet-552-claude-sonnet-5 | 5/5 | 5 | 5 | 0 | 1.00 | 0.180 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 8 | opencode-go/minimax-m306-minimax-m3 | 5/5 | 5 | 5 | 0 | 1.00 | 0.180 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 9 | gpt-5.3-codex-spark18-gpt-5-3-codex-spark | 5/5 | 5 | 5 | 0 | 1.00 | 0.181 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 10 | opencode-go/glm-5.205-glm-5-2 | 5/5 | 5 | 5 | 0 | 1.00 | 0.181 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 11 | opencode-go/deepseek-v4-pro04-deepseek-v4-pro | 5/5 | 5 | 5 | 0 | 1.00 | 0.181 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 12 | opencode-go/mimo-v2.5-pro07-mimo-v2-5-pro | 5/5 | 5 | 5 | 0 | 1.00 | 0.181 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 13 | gpt-5.449-gpt-5-4 | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 14 | opencode-go/glm-5.115-glm-5-1 | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 15 | opencode-go/grok-4.509-grok-4-5 | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 16 | opencode-go/kimi-k2.7-code03-kimi-k2-7-code | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 17 | opencode-go/deepseek-v4-flash11-deepseek-v4-flash | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 18 | gpt-5.4-mini50-gpt-5-4-mini | 5/5 | 5 | 5 | 0 | 1.00 | 0.182 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 19 | opencode/deepseek-v4-flash-free22-deepseek-v4-flash-free | 5/5 | 5 | 5 | 0 | 1.00 | 0.183 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 20 | opencode-go/kimi-k2.616-kimi-k2-6 | 5/5 | 5 | 5 | 0 | 1.00 | 0.184 | 5/5 completed | 5/5 | 5/5 | records ↗ |
| 21 | opencode/hy3-free27-hy3-free | 4/5 | 5 | 4 | 0 | 0.90 | 0.181 | 5/5 completed | 5/5 | 4/5 | records ↗ |
| 22 | opencode/claude-haiku-4-551-claude-haiku-4-5 | 4/5 | 5 | 4 | 0 | 0.90 | 0.181 | 5/5 completed | 5/5 | 4/5 | records ↗ |
| 23 | opencode-go/hy314-hy3 | 4/5 | 5 | 4 | 0 | 0.90 | 0.183 | 5/5 completed | 5/5 | 4/5 | records ↗ |
| 24 | opencode/big-pickle19-big-pickle | 4/5 | 5 | 4 | 0 | 0.90 | 0.184 | 5/5 completed | 5/5 | 4/5 | records ↗ |
| 25 | opencode-go/mimo-v2.513-mimo-v2-5 | 4/5 | 5 | 4 | 0 | 0.90 | 0.185 | 5/5 completed | 5/5 | 4/5 | records ↗ |
| 26 | opencode/nemotron-3.5-lightning-free33-nemotron-3-5-lightning-free | 3/5 | 5 | 3 | 0 | 0.80 | 0.184 | 5/5 completed | 5/5 | 3/5 | records ↗ |
| 27 | opencode-go/minimax-m2.717-minimax-m2-7 | 3/5 | 5 | 3 | 0 | 0.80 | 0.186 | 5/5 completed | 5/5 | 3/5 | records ↗ |
| 28 | opencode/nemotron-3-ultra-free35-nemotron-3-ultra-free | 3/5 | 4 | 3 | 0 | 0.70 | 0.185 | 5/5 completed | 4/5 | 3/5 | records ↗ |
| 29 | opencode/laguna-s-2.1-free20-laguna-s-2-1-free | 3/5 | 3 | 3 | 0 | 0.60 | 0.183 | 5/5 completed | 3/5 | 3/5 | records ↗ |
| 30 | opencode/mimo-v2.5-free28-mimo-v2-5-free | 2/5 | 4 | 2 | 0 | 0.60 | 0.184 | 5/5 completed | 5/5 | 2/5 | records ↗ |
| 31 | opencode-go/qwen3.7-plus02-qwen3-7-plus | 0/5 | 0 | 0 | 0 | 0.00 | 0.185 | 5/5 completed | 0/5 | 0/5 | records ↗ |
Source data and evidence
Generated from the Phase 2 records at commit 669f59e3bdef542db925eda9ecd8f5f0d7a2e6fc. Scores are binary-pass arithmetic means: each task score is (public + hidden) / 2; the aggregate is the arithmetic mean of all ten public/hidden indicators across five task records.