Implementation · VeriLoRA · Draft
Evidence & limits
On this page
R2Demonstrated for proving single-sample LoRA fine-tuning steps for 3–13-billion-parameter language models
Peer-reviewed results and linked public code demonstrate individual LoRA steps at language-model scale.
- R1 met: the paper defines proofs for forward propagation, backward propagation and parameter updates, with a security analysis under cryptographic assumptions 1.
- R2 met through published end-to-end single-step results on six model configurations using one A100 80 GB GPU, with implementation and experiment details and linked public code 1.
- R3 not met: the demonstrated use is a research experiment, without documented production use or another party's reliance on the proofs 1.
Assessed use: proving single-sample LoRA fine-tuning steps for 3–13-billion-parameter language models
Rubric assessment
- A production-grade, available LoRA proving implementation, or another party's documented reliance on its proofs.
Assessed 2026-10-08 against rubric v1.1.
Evidence
- The paper tests six LLaMA and OPT configurations from 3 to 13 billion parameters on one NVIDIA A100 80 GB GPU. Each measurement covers a minibatch containing one sample 1.
- Proving took 121.93–249.38 seconds per step. Commitment generation took 156–554 seconds, a separately reported cost that dominates wall-clock latency in the authors' evaluation 1.
- Verification took 1.87–3.73 seconds. Commitment sizes ranged from 135.59 to 232.67 MB 1.
- The paper links public implementation code in the zkLoRA repository 1.
Limitations
The reported experiments prove individual LoRA steps on one sample. LoRA updates a small set of adapter parameters, and the evidence does not cover full-parameter pretraining 1. The authors report proving approximately three orders of magnitude slower than their no-proof step baselines, with ratios depending on the model and prover setup 1. Rescaling choices affect the finite-field representation of non-arithmetic operations, and the authors evaluate precision settings to limit accuracy changes 1.
Known flaws
Blockers
Each single-sample step took 121.93–249.38 seconds to prove, with commitment generation taking another 156–554 seconds in the reported experiments.