TRUST CENTER · DETERMINISM

For us, reproducible means the decision, not the wording.

The hardware we use to serve our models to EU customers does not return bit-identical answers at temperature=0. We measured where that flips and moved the decisions to where the noise cannot reach them.

Twenty identical requests against an idle server, seventeen different texts. That is the finding of September 19, 2026. It is here because a customer would eventually have measured it themselves.

20 runs per cell
5,478 positions above 2 nats, 0 flipped
dense model 60 of 60 bit-stable

Measured: September 19 and 20, 2026
Hardware: NVIDIA GB10 · vLLM 0.24.0 (NGC 26.07)
Model: Qwen3.6-35B-A3B in NVFP4
Whitepaper: PDF, 14 pages, English
Whitepaper: PDF, 14 pages, German

LIMITS FIRSTWe do not promise a bit-identical answer for the same input. After the redesign the structural decisions were stable in every checked case (clarification, question, language, the edges used for evidence), and we measure the completeness of extraction at every release instead of promising it. Measured is one hardware platform, one container, one model family.

FOUR NUMBERS

What has been measured.

Every number has a raw file. The tables come from scripts, not from hand.

LADDER17 of 20distinct texts in 20 identical requests against an idle server, production recipe. No serving switch changes that: without prefix cache, without speculation, with a bf16 cache, all together – 15 to 18 of 20.

FLIP THRESHOLD0 of 5,478positions with more than two nats between the best and the second-best token at which a run flipped. Flips happen only at near-ties.

SOURCE60 of 60bit-identical runs of the dense sibling model in the same format and container. The noise sits in the NVFP4 kernel that mixes the experts: shown in situ in the first layer, and with fp8 weights on a different kernel the same model is bit-stable.

AFTER THE REDESIGN8 of 8production cases with a stable decision across three runs each, since the decision is taken in a short call of its own.

THREE LEVELS

Three levels of reproducibility.

Whoever says “reproducible” should say which level is meant. We say it for each.

BIT-IDENTICAL01The same character sequenceWhat temperature=0 promises. Available on our hardware: with fp8 weights on a different kernel for 30 to 45 percent of throughput, or with the dense model at five to eight times the compute time. That is not how we run it today; the trade-off is in the whitepaper.
DECISION-IDENTICAL02The same decisionsClarify or not, question or knowledge, which edges. This is the level that counts for a knowledge-management system. After the redesign we measure it in every checked case.
MEANING-IDENTICAL03The same thing in other wordsNot measurable enough to build a gate on. So we do not build one on it.

WHAT WE BUILT

The decision goes where the noise cannot reach it.

PATTERNDecide short, extract longOne call of about forty output tokens decides: clarification, question, language. A second, long call extracts nodes and edges. A short output has few positions at which a tie can arise.

CONTRACTA contract asks only for what existsThree of the four causes of the case sat in our own prompt contracts: an unlabeled date became a page number, a label became a parenthesis, a citation rule cited where there was nothing to cite. Fixed, with a test wall in front.

RELEASECompleteness is measured, not gatedThe extraction still flutters; a gate that turned red on it would always be red on this kernel. The probe counts the deviation and writes it into every model release.

RULETwo engineering rulesA decision call must not sit on a contract boundary. And where a prompt gets the same thing wrong three times, the format is at fault, not the wording.

READ ON

Where it is written down.

WHITEPAPERReproducible Decisions on Hardware That Is Not Bit-Stable14 pages: method, results, redesign, reading for audits and the EU AI Act, limitations. English and German.

MEASUREMENT REPORTThe ladder, rung by rungThe full report with every cell, the failures and the incident the measurement itself caused sits in the platform repository under docs/messungen/determinism (in German).

TOOLSProbe, ladder, logprob probe, harnessFour tools without dependencies, raw data per run, a public prompt set of twenty synthetic notes. A public repository for them is in preparation.

QUESTIONS

Whoever wants to recompute this gets the raw data.

Auditors, customers with their own measurements, and universities that want to build the invariant kernel receive raw data, tools and the thesis assignment on request.

Request the raw data Back to the Trust Center