Mechanism · Deterministic and bit-exact inference
Some kernels remain genuinely nondeterministic
On this page
MinorOpen questionOpen
The bit-exact work separates kernels that are deterministic but not batch-invariant from truly nondeterministic ones that use atomic functions. Some integer de-quantization kernels use atomic additions and remain nondeterministic, so exact replay needs backends that avoid them 1.
Sources: [1]