Implementation · TOPLOC

Subtle modifications are harder to detect

On this page

← All known flaws

SignificantOpen questionOpen

The TOPLOC authors state that large changes to the model or prompt are straightforward to detect, but subtle modifications are harder. In preliminary experiments, the margin separating fp8 from bf16 generation was small. The authors did not test whether TOPLOC distinguishes types of KV-cache compression.

Sources: [1]

Search

Full search page