Mechanism · Deterministic and bit-exact inference

Cross-hardware replay relies on reverse-engineered, closed behaviour

On this page

← All known flaws

SignificantOpen questionOpen

Emulating one GPU's rounding on another requires reverse-engineering tensor-core arithmetic and modelling proprietary kernel choices. Hawkeye covers a subset of NVIDIA architectures and states that attention and other higher-level operations need further reverse engineering 9. For the bit-exact emulator, a proprietary Hopper kernel family is an open edge case 1.

Sources: [9] · [1]

Search

Full search page