15 networks in 40 days: the lineage of the evaluation

Listen to this post10 min

Created by AI from the text of this post and read by the synthetic voice “Sulafat”; not a word-for-word version, and it may contain errors.

Note of 19 October 2026: all 15 networks in this list were trained on the project's own data; no data from outside the project went into any of them. Where this entry lists teachers as "not documented" or leaves data sources open, that was a gap in the sources read, not a sign of foreign data. A later review has since traced every data file to the project's own engines: "Own data, file by file: where the training data of the 15 networks came from".

Since 2026-09-08 Coherent has evaluated positions with a neural network. Up to 2026-10-18 the oracle adopted a new network onto the main branch 15 times, each time measured against its predecessor. The first of them, T-0072, replaced the hand-written evaluation together with a new integer evaluation core; its values measure that step, not one network against another. This entry assembles the series from the primary sources: structure, data, teachers and oracle values. Where a source is missing, the entry says so. It was written at the operator's request. The Elo Strength difference to the opponent, estimated from the games, with a 95-percent half-width where the oracle reported one. Never an absolute rating. values are measurements against the respective predecessor, not external playing strength.

The series

Timeline from 2026-09-08 to 2026-10-18 with 15 networks, each a point at its oracle date, labelled with run and width: T-0072, T-0076, T-0085, T-0099 and T-0100 at width 128; T-0119 and T-0120 at 256; T-0124 at 384; T-0127 at 512; T-0131 at 768 with one bucket; from T-0135 on width 768 with 4 king buckets and a head of 16 and 32 neurons: T-0135, T-0144, T-0168, T-0180 and T-0189. T-0180 is a fine-tuning of T-0168. Points with the same date are shifted by a few pixels so that both remain visible.
15 networks on the main branch (schematic)

Counted are the 15 distinct networks that lay on the main branch, matched to their passed oracle candidates through the registered commit and the network hash. Runs that only changed search or speed are not in the list. Short means 8+0.08 seconds with Book A, long 40+0.4 seconds with Book B, each against the predecessor; the register records these conditions for all 30 stages.

RunDateNetworkWidth, bucketsDataTeacherElo short (games)Elo long (games)
T-007209-08generation 3128, 1old set, about 5.56 million training rowsnot documented+222.52 ± 36.23 (414)+260.44 ± 39.40 (378)
T-007609-14old and new128, 1old set and 9 campaign shards, 20,875,984 total dataset rowsnot documented+143.17 ± 26.61 (492)+172.05 ± 27.97 (456)
T-008509-16campaign 1 full128, 1about 226.7 million total dataset rows from 2,642,799 games, of them 181,346,139 training rowsnot documented+136.97 ± 35.27 (264)+86.16 ± 28.28 (358)
T-009909-21result share 0.3128, 1campaign 1, per commit 226,723,955 training rowsnot documented+160.72 ± 36.01 (236)+168.60 ± 35.02 (222)
T-010009-21result share 0.3128, 1campaign 1, per commit 226,723,955 training rowsnot documented+39.13 ± 18.05 (740)+49.16 ± 19.68 (562)
T-011909-23bundle256, 1v2 prefix, about 395 million learning rowsnot documented+75.62 ± 24.25 (378)+111.00 ± 31.92 (288)
T-012009-23–256, 1v4, about 2.50 billion total dataset rowslast the main engine of the time+97.32 ± 27.75 (326)+97.56 ± 24.50 (296)
T-012409-24bundle384, 1v4, about 2.50 billion total dataset rowslast the main engine of the time+54.64 ± 15.01 (936)+58.45 ± 14.72 (840)
T-012709-25–512, 1v5, about 3.13 billion total dataset rowsnot documented+29.02 ± 10.27 (1,608)+38.60 ± 11.75 (1,166)
T-013109-27–768, 1v5, about 3.13 billion total dataset rowsnot documented+14.96 ± 7.24 (3,206)+30.48 ± 10.08 (1,394)
T-013509-28bundle768, 4v6, about 4.93 billion total dataset rowsnot documented+54.00 ± 14.07 (882)+50.03 ± 12.78 (860)
T-014409-30–768, 4v7j, 4,100,869,336 total dataset rowsnot documented+26.67 ± 9.79 (1,658)+35.15 ± 10.95 (1,200)
T-016810-08–768, 4v8j, 5,575,059,348 total dataset rowsnot documented+16.21 ± 7.08 (2,510)+12.41 ± 6.07 (3,278)
T-018010-11fine-tuning768, 4about 150 million training rows from the v8 delta, relabelledlabels: 0.2.8 with the predecessor network, 20,000 nodes+24.60 ± 8.58 (1,542)+31.43 ± 9.51 (1,186)
T-018910-18new start network768, 4v10, 13,591,787,474 total dataset rows, then 148,834,647 labelslabels: start network in the engine, 20,000 nodes+29.06 ± 9.46 (1,330)+24.37 ± 8.50 (1,528)

Width is the number of values per side in the first layer, buckets the number of weight sets chosen by the king's square. From T-0135 on, the first layer is followed by a head of 16 and 32 neurons; from T-0144 on, the board is mirrored when the king stands on files e to h. T-0119, T-0124 and T-0135 bundled the network with speed changes, T-0135 for example with an evaluation cache. Their measured gains belong to the complete candidates, not to the network alone.

Data

Bars on a linear scale for the 10 networks whose sources give total dataset rows: T-0076 20,875,984; T-0085 about 226.7 million; T-0120 and T-0124 about 2.50 billion each; T-0127 and T-0131 about 3.13 billion each; T-0135 about 4.93 billion; T-0144 4,100,869,336; T-0168 5,575,059,348; T-0189 13,591,787,474 for the start network. Not shown: T-0072, T-0099, T-0100 and T-0180 with training rows and T-0119 with learning rows.
Total dataset rows per network (from a measurement)

The sources count in three ways: total dataset rows, training rows and learning rows. The counts are compared only within one kind. The chart shows the 10 networks whose sources give total dataset rows; they range from 20,875,984 at T-0076 to 13,591,787,474 at T-0189. For campaign 1 the source for T-0085 gives about 226.7 million rows, of them 181,346,139 training rows; the commits for T-0099 and T-0100 give 226,723,955 training rows. A consistent way of counting is therefore not established.

The network inventory of 2026-10-07 counted dataset rows with positions from the test sets: 11,763 in v7j, 16,418 in v8j and 38,970 in v10. Whether each match lay in the training split is not documented for every one. The networks from v7j and v8j had been trained before the test-set rule of 2026-10-06; a separate decision required neither retraining nor re-measurement for them. For the start network of T-0189 the matches were removed before training. A test set created later overlaps with 1 row of its data; this is allowed as an exception, and that test set does not measure the network.

Teachers

A teacher is the engine whose search wrote the evaluations in the data. For v4 the teacher used last is documented, the main engine of the time. For the two fine-tunings the labels came from the engine with the network to be refined, at 20,000 nodes per position. The inventory names v7j, v8j and v10 as the project's own self-play data, but not the engine versions that played them; their teacher is therefore unknown. For the other networks the sources read name no teacher.

Oracle values

For each of the 15 runs two points with error bars, short and long stage, grouped by the oracle epochs 4, 5, 6, 7 and 10. T-0072 has +222.52 ± 36.23 and +260.44 ± 39.40 Elo; from T-0144 on the estimates lie between +12.41 ± 6.07 and +35.15 ± 10.95 Elo; T-0135 has +54.00 ± 14.07 and +50.03 ± 12.78. The stages needed between 222 and 3,278 games; the intervals are widest in the early runs. T-0119, T-0124 and T-0135 were bundles with speed changes and are marked B.
Measured gain of each candidate over its predecessor (from a measurement)

All 15 runs passed both stages. The values are logistic Elo estimates from the score of game pairs; ± is half the width of a nominal 95 per cent interval from the normal approximation, converted to Elo, as the match tool fastchess computes it. T-0072 has +222.52 ± 36.23 and +260.44 ± 39.40 Elo; from T-0144 on the estimates lie between +12.41 ± 6.07 and +35.15 ± 10.95 Elo. The stages needed between 222 and 3,278 games; up to T-0120 at most 740 per stage, so the early intervals are wide. The oracle's rules changed between the runs: they belong to epochs 4, 5, 6, 7 and 10. Each value measures one step against the predecessor of the time under the conditions of the time; the values are not a trend on one scale and cannot be added up to a total gain. All runs stopped at the upper bound, so the point estimates may be biased upwards.

An external result recorded outside the oracle register exists for version 0.2.10 with the network from T-0168: 3670 ± 52, measured on 2026-10-14 in 3,584 games at 120+1 seconds against 7 external anchor engines, listed as unregistered. The band is nominal; its calibration is still open.

Gaps

How this was checked

The networks were determined from the history of the weights file on the main branch; the first line of each version names the network's hash. The match to the runs and all Elo values come from the terminal entries of the oracle register; all 30 values and intervals were recomputed from the game-pair counts recorded there. Data and recipes come from the register hypotheses, commit messages, the network inventory and the review records of T-0189, the external value from the anchoring data. Agents of two other model families checked the text against the same sources.