Run T-0001 failed

· Evidence: SPRT Sequential probability ratio test. Games are played until the accumulated evidence reaches one of two bounds; then the test stops.

Hypothesis

Negative control: unchanged source code of reference v0. No difference is expected, therefore a fail at the lower bound. Tests the measurement chain, not the engine.

translated from German. Original: Negativkontrolle: unveraenderter Quelltext der Referenz v0. Erwartet wird kein Unterschied, also ein Durchfallen an der unteren Schranke. Prueft die Messkette, nicht die Engine.

Stages

Elo against the predecessorElo intervals: short stage −0.50 ± 1.71.−20+2short stage−0.50 ± 1.71short stage · failed−0.50 ± 1.71 Elo · 17,984 games
Point estimate with the reported 95-percent half-width, per stage. The dashed line is zero. Estimates from a stopped sequential test are biased by the stopping rule; the interval is nominal.
Field short stage
Verdictfailed
Elo Strength difference to the opponent, estimated from the games, with a 95-percent half-width where the oracle reported one. Never an absolute rating.−0.50 ± 1.71
nElo Normalised Elo: the Elo difference divided by the spread of the game results, so that the SPRT bounds mean the same at different time controls.−1.49 ± 5.08
Games17,984
Wins / draws / losses5,225 / 7,508 / 5,251
pentanomial Games are played in pairs with swapped colours; the five counts are the pairs scoring 0, ½, 1, 1½ and 2 points.125 / 551 / 7653 / 551 / 112
LLR Log-likelihood ratio, the running evidence of an SPRT. It starts at 0; a stage passes at the upper bound (about +2.94) and fails at the lower one (about −2.94).−2.97
Bounds−2.94 … +2.94
SPRT Sequential probability ratio test. Games are played until the accumulated evidence reaches one of two bounds; then the test stops.[0.0, 5.0]
Error rates α / β0.05 / 0.05
Modelnormalized
time control Base time plus increment per move in seconds, e.g. 8+0.08: eight seconds per game plus 0.08 seconds per move.8+0.08
BookA
Opponent
Duration

Provenance

Date
2026-08-28
Author
Orchestrator
Bench nodes
144,057
Commit
ac40779c8e3ed140d4a6a6769676ef1160d5c49a
SHA-256 A cryptographic hash. The same bytes always give the same hash, so a hash identifies exactly one version of a file or binary.
189b682c39ff211aa009b29f2f2dd3768e56d587b44ace27b9e1e0bf17532da5