Proposal Explorer
ResetA verification proposal from the AI Verification Tech Map, from its records of 2026-10-09. https://trustbutveri.fyi/explorer/?mechanisms=M-0019,M-0013,M-0024,M-0002
Analysis
Applied filters: none. Every filter is set to Any.
Overview
| Mechanism | Development | Security evidence | Open failures |
|---|---|---|---|
| Chip registries and manufacturing records | Proposed | Published security analysis | 1 significant |
| Network taps and certifiers | Proposed | Published security analysis | 2 significant |
| Bounding unexplained information in outputs | Research demo | Published attack testing | 1 significant |
| Deterministic and bit-exact inference | Operational use | Published security analysis | none |
- Open failures: n critical n significant n minor
Claim coverageNo claims yet
Add claims to see which ones the mechanisms address.
Properties1 with operational use · 3 built for an adversarial prover
- Operational use
- Operational use Deterministic and bit-exact inference for reproducing open-model inference from receipts in Gensyn's information-market service
- Built for an adversarial prover
- Network taps and certifiers, Bounding unexplained information in outputs and Deterministic and bit-exact inference
- No new hardware needed
- Chip registries and manufacturing records and Deterministic and bit-exact inference
- Failures since mitigated
- Verifier dictionary attacks on hashes in Network taps and certifiers 6
Attack testing4 mechanisms with published testing
Attack testing records published testing for this use. It does not by itself show independent review, a formal proof or that a deployed system is secure.
- Chip registries and manufacturing records: Analysis
- Network taps and certifiers: Analysis
- Bounding unexplained information in outputs: Independent red-team
- Deterministic and bit-exact inference: Analysis
Limits9 scope limitations · 1 open question · 2 not yet demonstrated · 3 mechanisms with open significant failures
- Open significant failures
4 failures in 3 mechanisms
Documents and serial numbers can be forged in Chip registries and manufacturing records
Avellar and Grunewald note that export documents can be forged, that companies can hide information behind obscure corporate structures, and that it may be possible to forge serial numbers on chips and racks. They recommend cryptographic attestation of a powered-on chip as an extra check. 2
Known failure · Theoretical argument · Significant · Open. On the record
Output nondeterminism leaves covert capacity in Network taps and certifiers
Hashing cannot remove information hidden in the outputs themselves. The Secure Gateway Device paper estimates that about 0.1 bit per token remains even with seed-synchronized replay checks. For a 200k-GPU inference cluster at full load (2,000 tokens per GPU per second), that is about 40 Mbit/s of covert egress, enough to move a 1 TB model in under three days. The paper names this the core remaining challenge and points to deterministic replay or active scrubbing of hardware-induced entropy. An independent study found that an adversary who chooses the prompts roughly doubles the bits leaked per token under Gumbel-based inference verification; see Bounding unexplained information in outputs. 6 14
Known failure · Theoretical argument · Significant · Open. On the record
Related mechanism Operational use Deterministic and bit-exact inference: Deterministic replay is one of the two remedies the flaw's source names. A pointer, not evidence that this failure is mitigated. In the proposal.
Related mechanism Research demo Bounding unexplained information in outputs: Bounds the hidden information outputs can carry by measuring what the declared computation fails to predict. A pointer, not evidence that this failure is mitigated. In the proposal.
Residual side channels in simple passive setups in Network taps and certifiers
Amodo's analysis of its own tapped prototype lists unvalidated header fields, timing of permitted traffic and variation in response formatting as residual channels, and concludes that the passive tap must be replaced by an active one. 10
Known failure · Theoretical argument · Significant · Open. On the record
Prompt-controlled entropy inflation widens the covert channel in Bounding unexplained information in outputs
Gumbel-based inference verification tolerates token choices that honest GPU nondeterminism could produce, and the size of that tolerated set grows with the model's output entropy. Kezins, an independent researcher, showed that an adversary who controls the prompt distribution can raise output entropy and roughly double the bits leaked per token. Across six models of 1 to 32 billion parameters, this cut the slowdown from 146–254 times under benign prompts to 60–118 times. Kezins argues that architectures built on the same unexplained-information bound inherit this attack surface, and recommends calibrating tolerances against local token entropy rather than benign traffic. 14 17
Known failure · Demonstrated attack · Significant · Open. On the record
Related mechanism Operational use Deterministic and bit-exact inference: Bit-exact replay would remove the tolerance for numerical noise that sets the size of this channel. The record notes that it needs full hardware and software metadata. A pointer, not evidence that this failure is mitigated. In the proposal.
- Scope limitations
Records cover only chips that were recorded in Chip registries and manufacturing records
A registry or commitment accounts only for chips entered into it. Cankaya asks how a verifier would know it had found all chips, or how much "dark compute" remains, and notes that a fraudulent original record would mean unregistered chips had been made in advance. Halstead and Larsen propose reconstructing earlier production by auditing upstream suppliers. 3 5
Scope limitation · Theoretical argument. On the record
Related mechanism Proposed Remote detection of data centres: Looks for large data centres that were never declared, which a registry cannot show. A pointer, not evidence that this failure is mitigated. Add
Insiders could alter records before they are fixed in Chip registries and manufacturing records
Cankaya argues that insiders who can photograph process secrets could also tamper with production records. A commitment makes changes after publication detectable, but it cannot show that the records were accurate when committed. 3
Scope limitation · Theoretical argument. On the record
Some links cannot be passively tapped in Network taps and certifiers
Cankaya notes that copper-connected scale-up domains (for example NVL72 racks and TPU v7 cubes) are much harder to tap than fibre, and that optical budgets make passive taps impractical on 400GBASE-SR8 multimode links. Amodo found no taps advertised for 53 GBaud links as of May 2026. 7 15
Scope limitation · Open question. On the record
Encrypted fabrics hide plaintext from both parties in Network taps and certifiers
Cankaya notes that with TEE-protected sessions whose keys are ephemeral and managed inside the TEE, neither the operator nor the manufacturer can recover session keys after the session, so tapped traffic could not be opened for recomputation. For other encrypted fabrics, the operator can retain keys. 7
Scope limitation · Open question. On the record
Completeness rests on physical monitoring left out of scope in Network taps and certifiers
The Secure Gateway Device paper assumes the facility is physically monitored, and states that the whole architecture depends on the device being the only communication channel. It names radio emanation, power-line signalling and thermal channels as covert channels beyond that scope. 6
Scope limitation · Open question. On the record
Related mechanism Proposed Side-channel suppression for isolated facilities: Addresses the radio, power-line and thermal channels that network-level designs leave out. A pointer, not evidence that this failure is mitigated. Add
Information the declared computation explains is not bounded in Bounding unexplained information in outputs
The bound limits unexplained bits only. Outputs that the declared computation fully explains can still carry valuable information: a compression study notes that an adversary with inference access can extract more proprietary information per bit than naive transmission allows. 16 18
Scope limitation · Theoretical argument. On the record
Channels other than checked outputs are outside the bound in Bounding unexplained information in outputs
The inference-verification scheme treats side channels as out of scope. A low-trust system design argues that suppressing physical covert bandwidth below kilobits per second is much more achievable than aiming for zero, and that a malicious device can leak one bit of information by deliberately outputting a wrong result. 8 17
Scope limitation · Theoretical argument. On the record
Related mechanism Proposed Side-channel suppression for isolated facilities: Physical side channels need separate suppression, which is this mechanism's purpose. A pointer, not evidence that this failure is mitigated. Add
Some kernels remain genuinely nondeterministic in Deterministic and bit-exact inference
The bit-exact work separates kernels that are deterministic but not batch-invariant from truly nondeterministic ones that use atomic functions. Some integer de-quantization kernels use atomic additions and remain nondeterministic, so exact replay needs backends that avoid them. 19
Scope limitation · Open question. On the record
Cross-hardware replay relies on reverse-engineered, closed behaviour in Deterministic and bit-exact inference
Emulating one GPU's rounding on another requires reverse-engineering tensor-core arithmetic and modelling proprietary kernel choices. Hawkeye covers a subset of NVIDIA architectures and states that attention and other higher-level operations need further reverse engineering. For the bit-exact emulator, a proprietary Hopper kernel family is an open edge case. 19 21
Scope limitation · Open question. On the record
- Open questions
The facility-level design is untested in Bounding unexplained information in outputs
The compute-verification architecture is described with protocol details, potential attacks and prototyping plans, but no prototype results have been published. 16
Open question · Open question. On the record
- Not yet demonstrated
- Proposed Chip registries and manufacturing records and Proposed Network taps and certifiers
Possible additions4 for dependencies
Mechanisms on the map that are not in the proposal. Pointers, not recommendations.
-
- Bounding unexplained information in outputs waits on it. The prover's compute must be isolated so that all traffic passes through the verifier's interlock; any unmonitored path voids the bound.
-
- Network taps and certifiers waits on it. Taps and gateway devices need tamper-evident housing and physical monitoring so that traffic cannot bypass them.
-
- Network taps and certifiers waits on it. Radio, power-line and thermal channels are not addressed by network-level designs.
- Bounding unexplained information in outputs waits on it. Physical side channels need separate suppression, and one design treats a low residual bandwidth, rather than zero, as the realistic target.
-
- Network taps and certifiers depends on it.
- Bounding unexplained information in outputs depends on it.
Dependencies4 missing prerequisites · 3 shared foundations · 17 blockers
- Missing prerequisites
- Operational use Sampled inference recomputation needed by Network taps and certifiers and Bounding unexplained information in outputs Add
- Research demo Tamper evidence for verifier devices needed by Network taps and certifiers Add
- Proposed Side-channel suppression for isolated facilities needed by Network taps and certifiers and Bounding unexplained information in outputs Add
- Research demo Bandwidth limits and compartmentalization needed by Bounding unexplained information in outputs Add
- Shared foundations
- Sampled inference recomputation relied on by Network taps and certifiers and Bounding unexplained information in outputs
- Deterministic and bit-exact inference relied on by Network taps and certifiers and Bounding unexplained information in outputs. In the proposal
- Side-channel suppression for isolated facilities relied on by Network taps and certifiers and Bounding unexplained information in outputs
- Blockers
17 blockers recorded
- Chip registries and manufacturing records
- No implementation of an AI chip registry has been publicly reported, and covering re-exports would need cooperation from re-exporters and foreign governments that may not be feasible everywhere. Access & governance 1 2
- Linking records to physical chips needs hard-to-spoof unique IDs and inspections. Hardware trust 1 2 3
- Chips produced before a registry starts must be reconstructed from supplier records. Coverage & hidden compute 3 5
- Network taps and certifiers
- No complete verification tap has been demonstrated at production frontend link rates, and on the tested CPU no hash algorithm reached line rate with minimum-size frames. Performance & compatibility 15 29
- Nondeterministic inference leaves covert capacity in outputs that hashing cannot remove. Evidence binding. Waits on Deterministic and bit-exact inference 6
- Taps and gateway devices need tamper-evident housing and physical monitoring so that traffic cannot bypass them. Hardware trust. Waits on Tamper evidence for verifier devices 6 8
- Radio, power-line and thermal channels are not addressed by network-level designs. Coverage & hidden compute. Waits on Side-channel suppression for isolated facilities 6
- Red-teaming by specialists is called for but has not been reported. Adversarial validation 6
- Bounding unexplained information in outputs
- The prover's compute must be isolated so that all traffic passes through the verifier's interlock; any unmonitored path voids the bound. Coverage & hidden compute. Waits on Bandwidth limits and compartmentalization 16
- Physical side channels need separate suppression, and one design treats a low residual bandwidth, rather than zero, as the realistic target. Coverage & hidden compute. Waits on Side-channel suppression for isolated facilities 8 17
- Tolerance for numerical nondeterminism sets the size of the residual channel; bit-exact replay would remove it but needs full hardware and software metadata. Protocol soundness. Waits on Deterministic and bit-exact inference 8 14
- Recomputation over confidential weights and inputs needs a protected setting: prover recomputation in a verifier-controlled enclosure, verifier recomputation in a prover-controlled enclosure, or zero-knowledge proofs. Privacy & leakage 16
- No prototype of the facility-level architecture exists to red-team. Adversarial validation 16
- Deterministic and bit-exact inference
- Batch-invariant kernels cost throughput: in Thinking Machines' Qwen3-8B test, an improved deterministic build took 42 s against 26 s for vLLM's default, and SGLang reports an average 34.35% slowdown on its FlashInfer and FlashAttention 3 backends. Performance & compatibility 20 22
- Coverage is incomplete: the bit-exact emulator targets dense blocks on NVIDIA GPUs and excludes mixture-of-experts inference and training, and vLLM's batch-invariant mode is in beta, with open work on AMD hardware and speculative decoding. Performance & compatibility 19 23 30
- Amodo's status page for the AI 2040 verification plan rates a reproducible inference stack for that plan as 'not started'. Performance & compatibility 31
- Exact replay requires the prover to disclose weights, software versions, parallelism and batch sizes to whoever recomputes. Privacy & leakage 8 19
- Chip registries and manufacturing records
What the verifier sees3 depend on design
From the family or selected implementation's record.
- Model weights
Depends on the design for Network taps and certifiers, Bounding unexplained information in outputs and Deterministic and bit-exact inference.
Not involved: Chip registries and manufacturing records.
- Inputs and outputs
Depends on the design for Network taps and certifiers, Bounding unexplained information in outputs and Deterministic and bit-exact inference.
Not involved: Chip registries and manufacturing records.
- Training data
Depends on the design for Network taps and certifiers.
Not involved: Chip registries and manufacturing records, Bounding unexplained information in outputs and Deterministic and bit-exact inference.
Exposure notes
- Chip registries and manufacturing records: Records chip identities and owners; it does not handle model data.
- Network taps and certifiers: Only hashes leave the site; records picked for a challenge are opened for replay at a verification facility.
- Bounding unexplained information in outputs: Depends on where recomputation runs: in a sealed enclosure, or with zero-knowledge proofs, the verifier need not see the weights or the traffic.
- Deterministic and bit-exact inference: Exact replay needs the weights, configuration and replayed requests inside the recomputation environment. What the verifier sees depends on whether that environment keeps them confidential. 8 19
Implementations5 systems
- Chip registries and manufacturing records
- None on the map
- Network taps and certifiers
- Proposed AI 2040 inference-only verification stack Proposed architecture, AI Futures Project
- Proposed Low-trust AI compute verification system overview Proposed architecture, Machine Intelligence Research Institute
- Proposed SASH confidential network logger Research prototype, Singapore AI Safety Hub (SASH)
- Bounding unexplained information in outputs
- None on the map
- Deterministic and bit-exact inference
- Research demo Batch-invariant inference kernels (Thinking Machines) Open-source project, Thinking Machines Lab
- Operational use Verde and RepOps (Gensyn) Product, Gensyn
- Proposed Low-trust AI compute verification system overview Proposed architecture, Machine Intelligence Research Institute
Sources31 cited
- Verifying International Agreements on AI: Six Layers of Verification for Rules on Large-Scale AI Development and Deployment, M. Baker et al. (2025). Original
- Near-Term Verification Methods for AI Chip Exports, B. Avellar & E. Grunewald (2026). Original
- TSMC most definitely has a golden record of all AI chips it made, N. Cankaya (2025). Original
- Hardware-Level Governance of AI Compute: A Feasibility Taxonomy for Regulatory Compliance and Treaty Verification, S. Ansari (2026). Original
- Covert AI Projects, B. Halstead & T. Larsen (2026). Original
- Fingerprinting All AI Cluster I/O Without Mutually Trusted Processors, N. Cankaya et al. (2026). Original
- The Fundamentals and Feasibility of Secure Network Taps for Verifying AI Datacenter Use, N. Cankaya (2026). Original
- A System Overview for Near-Term, Low-Trust AI Compute Verification, N. Cankaya (2026). Original
- Verification Plan, R. Dean (2026). Original
- Fitting a Network TAP to our Inference Verification Prototype, Amodo Design (2026). Original
- Amodo-Design/Inference-Recomputation-Prototype (GitHub repository), Amodo Design (2026). Original
- inference-verification: Inference Verification Prototype, Singapore AI Safety Hub (SASH) (2026). Original
- Internationalising AI Verification, Singapore AI Safety Hub (SASH) (2026). Original
- Adversarial Entropy Inflation Against Gumbel-Based Inference Verification, N. Kezins (2026). Original
- Network Tapping for AI Verification: A Technical Assessment, Amodo Design (2026). Original
- Verifying AI Compute by Bounding Unexplained Information Exfiltration, J. Petrie & Y. Mühlhäuser (2026). Original
- Verifying LLM Inference to Detect Model Weight Exfiltration, R. Rinberg et al. (2025). Original
- Haiku to Opus in Just 10 bits: LLMs Unlock Large Compression Gains, R. Rinberg et al. (2026). Original
- Bit-Exact AI Inference Verification Without Performance Tradeoffs, N. Cankaya (2026). Original
- Defeating Nondeterminism in LLM Inference, H. He & Thinking Machines Lab (2025). Original
- Hawkeye: Reproducing GPU-Level Non-Determinism, E. Badash et al. (2026). Original
- Towards Deterministic Inference in SGLang and Reproducible RL Training, The SGLang Team (2025). Original
- Batch Invariance (vLLM documentation), vLLM project (2026). Original
- gensyn-ai/ree: Gensyn Reproducible Execution Environment (GitHub repository), Gensyn (2026). Original
- EigenCloud Brings Verifiable AI to Mass Market with EigenAI and EigenCompute Launches, EigenCloud (2025). Original
- Building Delphi: Pricing, Settlement, and Agentic Trading, D. Jedamski (2026). Original
- Reproducible Execution Environment (REE) (Gensyn documentation), Gensyn (2026). Original
- What is Delphi? (Delphi documentation), Gensyn (2026). Original
- Network Traffic Hashing, Amodo Design (2026). Original
- [Feature]: Batch Invariant Feature and Performance Optimization (vLLM issue #27433), vLLM project contributors (2025). Original
- AI 2040 Plan A — Verification SITREP, Amodo Design (2026). Original
Share the link to this proposal. This proposal is also available as plain text and JSON.
Filter mechanisms
Filters apply to mechanisms only. They describe the setting a proposal is for, and all are off by default. A mechanism that a filter rules out is flagged and does not count towards claim coverage. Selected implementations use their own record fields. A match means not excluded; conditional or unspecified exposure stays with a note. Passing a filter does not establish that the assumptions hold in a deployment.
All 25 mechanisms match.
Prover
How far can the party being checked be trusted?
The prover is the party being checked. Semi-trusted designs rely on part of its stack: usually the chip vendor's hardware root of trust, its firmware or counters, or its supply-chain records. Adversarial designs aim to hold even if it cheats wherever the checks allow, within their stated assumptions.
Keeps mechanisms whose threat model holds against at least this prover. Adversarial is the strongest assumption. Definitions
Verifier devices on site
May the verifier install its own hardware at the prover's sites?
Some mechanisms need a device the verifier owns or trusts at the prover's facility, such as a network tap, a bandwidth limiter or a sealed sensor. Choose Not allowed when the setting rules that out. Inspectors are not covered.
"Not allowed" removes mechanisms that need a retrofit device, such as a network tap or a sealed sensor. Definitions
Prover cooperation
How much must the prover take part?
Required: the prover takes part, for example by logging requests, producing proofs or opening records. Partial: some access, such as installing a device. Not required: works from outside, such as satellite imagery.
"Partial at most" removes mechanisms that need the prover's active participation. "Not required" keeps only those that work without it. Definitions
Chips
May the proposal depend on new chip designs?
New chip features take years to reach a deployed fleet and cover only chips made after they ship. Mechanisms that use shipping features, such as trusted execution environments or performance counters, stay.
"Existing chips only" removes mechanisms that need changes to future chip designs. Definitions
Minimum development status
Development status
A level describes the public evidence for a mechanism's stated use, not its cost or feasibility. R3 can still have open critical flaws.
Keeps mechanisms whose readiness level is at least this one. Definitions
Attack testing
How hard has each mechanism been attacked in public?
The strongest published attempt to break the mechanism for its verification use: a security analysis, red-teaming by its developers or collaborators, or a red team independent of them.
Keeps mechanisms whose strongest published attack testing is at least this. Definitions
Keep hidden from the verifier
What must the verifier never see? Choose any.
Model weights: the checked model's parameters. Inputs and outputs: the requests a deployed model serves and its responses. Training data: what a model was trained on. Each mechanism's exposure is the editors' reading of its record: shown, depends on the design (kept, with a note), hidden, not involved, or unspecified for a selected implementation. Code and configuration are not covered yet.
Removes mechanisms that show the asset to the verifier. Conditional or unspecified exposure stays with a note and needs checking against the privacy requirement.
Claims
A claim is something one party wants to verify about another party's AI hardware or software. Each claim's number shows how the proposal addresses it.
- Addressed. A mechanism in the proposal is aimed at this claim and is not excluded by the filters.
- Partly addressed. Only supporting mechanisms, or mechanisms aimed at it that the filters exclude.
- Unaddressed. No mechanism in the proposal addresses this claim.
Addressed means a mechanism in the proposal is aimed at the claim and is not excluded by your filters. It does not mean the claim is verified: check its assessed use, development status, security evidence, assumptions and findings.
Mechanisms
A mechanism is a general technique for verifying claims. Its badge is its development status for its stated use. An optional implementation choice narrows its assumptions, assessed use and claim links to that record. Lines join it to the claims it addresses. Click a line for details.Under its name it lists the claims it is aimed at or supports.
- Aimed at the claim: verifying it is a direct purpose of the mechanism.
- Supports the claim: helps verify it without being aimed at it.
- Faint: excluded by your filters, so it does not count towards claim coverage.
Overview
One row per mechanism in the proposal. Every mark comes from that mechanism's record, as listed in the panels below; what the verifier sees is the editors' reading of the record's text. Failure counts are per mechanism. Summary counts name mechanisms with open failures, not a sum of attacks. Choosing an implementation narrows each row to that record's assessed use; family findings remain as context. Findings are grouped as known failures, scope limitations and open questions. Only known failures count as failures. Counts are an inventory of published findings, not a risk score.
What the verifier sees
For model weights, inputs and outputs, and training data. This is the editors' reading of each mechanism's record (its threat model, how it works and its limitations), not a field of the record. Shown: the verifier sees it. Depends: on the design or variant, or the verifier sees only samples. Hidden: the verifier sees only commitments, hashes, proofs or results. Not involved: the record does not handle it. Unspecified: the selected implementation has no asset-specific assessment here.
Possible additions
Mechanisms on the map, not in the proposal, that the records connect to an unaddressed or partly addressed claim, an open failure or a dependency. They are pointers, not recommendations: each brings its own readiness level and findings, and none is claimed to close a failure. Links from failures are the editors' reading of the two records.
Start from a goal
A goal is something a rule or agreement about AI sets out to achieve. Choosing one loads the claims it needs verified. Your mechanisms and filters stay as they are.
- Cap frontier training2 direct, 3 supportingKeep every AI training run below an agreed amount of compute.
- Pause frontier AI development2 direct, 3 supportingStop new AI training runs and experiments for an agreed period, while existing models stay in service.
- Deploy only evaluated models2 direct, 3 supportingDeploy powerful AI models widely only after their risks have been evaluated and judged manageable.
- Prevent catastrophic misuse2 direct, 2 supportingKeep capable AI models from helping anyone carry out catastrophic attacks, such as biological or chemical ones.
- Prevent weight theft1 direct, 1 supportingKeep the weights of capable AI models from being copied out of the facilities that hold them.
- Enforce chip export controls1 directKeep export-controlled AI chips at the destinations they were authorised for.
Start from a published design
Choosing a design loads the mechanisms its record realises or depends on. If the proposal has no claims yet, it also loads the claims that record says the design addresses.
- AI 2040 inference-only verification stack7 mechanismsProposed architecture, AI Futures Project
- Low-trust AI compute verification system overview7 mechanismsProposed architecture, Machine Intelligence Research Institute
- RAND secure inference data center (SIDC) design2 mechanismsProposed architecture, RAND