A training run stayed within declared limits
On this page
Mechanisms
- Transcript checks for rules on training compute, data and hyperparameters (Shavit; Choi et al.).
- Proves training followed a committed specification and data; the frontier design adds compute-threshold attestations.
- Verifiable claims about total training compute, and enforcement of compute thresholds 1.
- PAL*M attests single-node training and fine-tuning operations 9. Distributed training is left open.
- Bounds the size of model that can be trained efficiently across pods 2.
- R2Confidential multi-party verificationsupportingZero-knowledge audits can prove properties of committed training data and weights 3.
- Counters for FLOP, memory and interconnect traffic are proposed as meters for compute accounting 4 5.
- Can flag training on hardware declared for other uses; does not measure training size by itself.
- Licenses that authorize a fixed amount of work would bound compute per license period 2 3.
- Proposed for later R&D verification by treating training steps as packets 1 2.
Implementations
- Assessed use: proving gradient-descent training of small image models on committed dataProves gradient-descent training of committed weights on a committed dataset according to public training specifications; it does not account for training outside the proven computation 1.
- Assessed use: proving single-sample LoRA fine-tuning steps for 3–13-billion-parameter language modelsProves the declared computation for individual LoRA fine-tuning steps. The evidence is narrower than a full-run training or compute-budget claim 1.
- R3Verde and RepOps (Gensyn)supportingAssessed use: reproducing declared-model inference from receipts in Gensyn's information-market serviceAlso covers training and fine-tuning jobs delegated to several providers 1.
- Assessed use: attesting declared model operations on a confidential CPU–GPU prototypeAttests declared training and fine-tuning operations and their measured inputs and outputs; it does not account for undeclared training elsewhere 1.