Reproducible decisions on hardware that is not bit-stable
Safeguarding the decisions of an AI knowledge management system against inference kernel noise (measurements on NVIDIA GB10, vLLM 0.24.0, Qwen3.6-35B-A3B-NVFP4).
- The measured problem: Twenty identical calls at temperature=0 on an idle server produce 17 different texts. The cause is not a server switch but the NVFP4 Marlin compute kernel in the expert block from layer 0 onwards (54 of 3.85 million tensor elements deviate minimally).
- The 2-nats law: Our logprob probe proves across 5,478 measured token positions: decisions flip only at near-ties. If the margin between the best and second-best token is above 2 nats, not a single result flips in 0 of 5,478 positions.
- The Explicio solution: With the architecture pattern “short decision (~40 tokens), long extraction”, we move business-critical decisions (follow-up question? question? language?) to where the margin is large – with 8 of 8 stable operating cases and without the 7.4-fold time penalty of dense models.