Run T-0001 failed
· Evidence: SPRT Sequential probability ratio test. Games are played until the accumulated evidence reaches one of two bounds; then the test stops.
Hypothesis
Negative control: unchanged source code of reference v0. No difference is expected, therefore a fail at the lower bound. Tests the measurement chain, not the engine.
translated from German. Original: Negativkontrolle: unveraenderter Quelltext der Referenz v0. Erwartet wird kein Unterschied, also ein Durchfallen an der unteren Schranke. Prueft die Messkette, nicht die Engine.
Stages
| Field | short stage |
|---|---|
| Verdict | failed |
| Elo Strength difference to the opponent, estimated from the games, with a 95-percent half-width where the oracle reported one. Never an absolute rating. | −0.50 ± 1.71 |
| nElo Normalised Elo: the Elo difference divided by the spread of the game results, so that the SPRT bounds mean the same at different time controls. | −1.49 ± 5.08 |
| Games | 17,984 |
| Wins / draws / losses | 5,225 / 7,508 / 5,251 |
| pentanomial Games are played in pairs with swapped colours; the five counts are the pairs scoring 0, ½, 1, 1½ and 2 points. | 125 / 551 / 7653 / 551 / 112 |
| LLR Log-likelihood ratio, the running evidence of an SPRT. It starts at 0; a stage passes at the upper bound (about +2.94) and fails at the lower one (about −2.94). | −2.97 |
| Bounds | −2.94 … +2.94 |
| SPRT Sequential probability ratio test. Games are played until the accumulated evidence reaches one of two bounds; then the test stops. | [0.0, 5.0] |
| Error rates α / β | 0.05 / 0.05 |
| Model | normalized |
| time control Base time plus increment per move in seconds, e.g. 8+0.08: eight seconds per game plus 0.08 seconds per move. | 8+0.08 |
| Book | A |
| Opponent | – |
| Duration | – |
Provenance
- Date
- 2026-08-28
- Author
- Orchestrator
- Bench nodes
- 144,057
- Commit
ac40779c8e3ed140d4a6a6769676ef1160d5c49a- SHA-256 A cryptographic hash. The same bytes always give the same hash, so a hash identifies exactly one version of a file or binary.
189b682c39ff211aa009b29f2f2dd3768e56d587b44ace27b9e1e0bf17532da5