University of Waterloo

A university in Waterloo, Ontario, Canada, whose researchers developed zkLLM, a zero-knowledge proof system for large language model inference.

The University of Waterloo is in Waterloo, Ontario, Canada; all three authors of zkLLM list it as their affiliation ¹. Their work includes:

zkLLM. The CCS 2024 paper presents zkLLM, a zero-knowledge proof system for large language model inference ¹; see Zero-knowledge proofs of inference.
Code. The authors released the code as an artifact after the conference's artifact evaluation, archived on Zenodo ².
Proofs of training. The authors wrote that zero-knowledge proofs of LLM training "may pose insurmountable challenges" ¹; see Zero-knowledge proofs of training constraints.

Implementations

R2zkLLM
zkLLM is a GPU-accelerated zero-knowledge proof system that proves a large language model's output came from committed weights without revealing those weights.

Mechanisms this organization has designed, built, evaluated or supplied.

R2Zero-knowledge proofs of inference
A prover produces a cryptographic proof that an output came from running a committed model on a given input, without revealing the weights.

Sources this organization authored or published.

BH. Sun (2024). zkllm-ccs2024: code for zkLLM: Zero Knowledge Proofs for Large Language Models. GitHub; archived on Zenodo. RecordCited by Zero-knowledge proofs of inference; zkLLM; University of Waterloo
AH. Sun et al. (2024). zkLLM: Zero Knowledge Proofs for Large Language Models. 2024 ACM SIGSAC Conference on Computer and Communications Security (CCS 2024). RecordCited by Zero-knowledge proofs of inference; Zero-knowledge proofs of training constraints; zkLLM; The declared model is the one being served; Cryptographic commitment; Prover; Zero-knowledge proof; University of Waterloo

AH. Sun et al. (2024). zkLLM: Zero Knowledge Proofs for Large Language Models. 2024 ACM SIGSAC Conference on Computer and Communications Security (CCS 2024). Source recordSupports: zkLLM paper; all three authors at the University of Waterloo; view on proofs of training
BH. Sun (2024). zkllm-ccs2024: code for zkLLM: Zero Knowledge Proofs for Large Language Models. GitHub; archived on Zenodo. Source recordSupports: zkLLM code and artifact