Repository navigation

Prover performance: batch/endomorphism MSM, CIOS wasm, batching modes - #185

Open

OBrezhniev wants to merge 101 commits into

masterfrom

feature/msm-signed-buckets

Open

Prover performance: batch/endomorphism MSM, CIOS wasm, batching modes#185
OBrezhniev wants to merge 101 commits into
masterfrom
feature/msm-signed-buckets

Commits on Sep 10, 2025
- Remove multiExp chunking - it works faster without it. Pass array buffers to worker threads instead of arrays (make it compatible with SharedArrayBuffer)
  OBrezhniev
  committed
  e31b669
- Create SharedArrayBuffers inside BigBuffer
  OBrezhniev
  committed
  1d08653
Commits on Sep 13, 2025
- Increase max size for underlying buffer of BigBuffer when run in nodejs
  OBrezhniev
  committed
  5524d2d
- Fallback to old slicing logic when buffers are not SharedArrayBuffers
  OBrezhniev
  committed
  eb5ffe1
Commits on Sep 22, 2025
- Error handling in workers. Terminate on worker error. Linter fixes
  OBrezhniev
  committed
  ee037e6
- Remove passing shared array buffers in one chunk.
  OBrezhniev
  committed
  8c51af0
Commits on Sep 25, 2025
- MultiExp:
  OBrezhniev
  committed
  af3b168
- Better error handling in threadman
  OBrezhniev
  committed
  9ca91e4
Commits on Sep 26, 2025
- Transfer buffer ownership to worker threads everywhere else
  OBrezhniev
  committed
  6b39fc1
Commits on Dec 3, 2025
- Rollback usage of SharedArrayBuffer. Change var to let in tests.
  OBrezhniev
  committed
  b645924
Commits on Feb 10, 2026
- Switch to dynamic import for prebuilt and gzip packed wasm from wasmcurves
  OBrezhniev
  committed
  399c45a
Commits on Jun 20, 2026
- Refactor ThreadManager to WorkerSlot identity model with 2-phase termination
  OBrezhniev
  committed
  19a920f
Commits on Jun 21, 2026
- Remove debug console.log from hot paths; increase worker idle timeout to 1500ms
  
  OBrezhniev
  and
  claude
  committed
  a9df133
- FFT: reverse bit-reversal permutation in place in a worker, drop WASM __reversePermutation
  
  OBrezhniev
  and
  claude
  committed
  d9c48fc
- pairingEq: don't transfer input point buffers (fixes detached G1.g/G2.g)
  
  OBrezhniev
  and
  claude
  committed
  07fc37b
- bn128: load prebuilt wasm with browser-safe APIs (atob, arrayBuffer)
  
  OBrezhniev
  and
  claude
  committed
  73c8448
Commits on Jun 23, 2026
- compat: module-local curve cache + runtime/feature env detection (no process.browser)
  
  OBrezhniev
  and
  claude
  committed
  61df670
- compat (Tier 1): browser field stubs os/crypto so bundlers need no hand-stubbing
  
  OBrezhniev
  and
  claude
  committed
  7d18ebd
- Vendor uncompressed prebuilt wasm; drop wasmcurves from runtime deps
  
  OBrezhniev
  and
  claude
  committed
  faae41f
- SES: lazy worker source + native-preferred base64 decode
  
  OBrezhniev
  and
  claude
  committed
  960a238
Commits on Jun 24, 2026
- Add SES lockdown test harness
  
  OBrezhniev
  and
  claude
  committed
  0d3858c
- Optimize vendored wasm with wasm-opt -Oz (smaller + faster)
  
  OBrezhniev
  and
  claude
  committed
  a97b91c
- multiexp: add streaming multiExpAffineChunked + dedup the dispatch
  
  OBrezhniev
  and
  claude
  committed
  624f448
Commits on Jun 25, 2026
- BigBuffer: make PAGE_SIZE an explicit 1 GiB constant
  
  OBrezhniev
  and
  claude
  committed
  eaaccc9
- fft/ifft: add a `consume` option to skip the defensive input copy
  
  OBrezhniev
  and
  claude
  committed
  c10170e
Commits on Jul 1, 2026
- Re-vendor bn128/bls12381 wasm: signed-digit multiexp
  OBrezhniev
  committed
  1ca5780
- Route affine multiexp through the batch-affine MSM module
  OBrezhniev
  committed
  9b9ccd6
- multiexp: batching mode option (auto/enabled/disabled)
  OBrezhniev
  committed
  25eba1a
- Rebuild bundles: batch-affine MSM + batching mode option
  OBrezhniev
  committed
  9ce14f7
- Re-vendor CIOS-mul wasm; switch vendoring to wasm-opt -O2
  OBrezhniev
  committed
  7e39235
- Rebuild bundles: CIOS Montgomery mul
  OBrezhniev
  committed
  6c1c704
- Re-vendor wasm: square via CIOS mul
  OBrezhniev
  committed
  7cae013
- Rebuild bundles: square via CIOS mul
  OBrezhniev
  committed
  789f35e
- Re-vendor wasm: dedicated CIOS square (f1m_square 62.4 -> 57.2 ns)
  OBrezhniev
  committed
  6335c9e
- Rebuild bundles: dedicated CIOS square
  OBrezhniev
  committed
  20cb2ff
Commits on Jul 2, 2026
- Re-vendor wasm: no-carry CIOS mul (54.7 -> 52.0 ns)
  OBrezhniev
  committed
  00e93a1
- Rebuild bundles: no-carry CIOS mul
  OBrezhniev
  committed
  f84dfd8
- Wire GLV MSM for bn254 G1 (glv flag -> worker batch dispatch)
  OBrezhniev
  committed
  f858121
- Rebuild bundles: GLV MSM
  OBrezhniev
  committed
  2770cdf
- Wire GLS G2 MSM (f_conj import + GLS binding under the glv flag)
  OBrezhniev
  committed
  193fd56
- Rebuild bundles: GLS G2 MSM
  OBrezhniev
  committed
  6db7bf3
- threadman: FF_NO_GLS escape hatch (disable G2 GLS binding; A/B aid, mirrors FF_NO_BATCH)
  OBrezhniev
  committed
  924e4ae
Commits on Jul 3, 2026
- Rebuild bundles: FF_NO_GLS guard sync
  OBrezhniev
  committed
  4cfc20f
- multiexp: per-call gls option replaces the FF_NO_GLS env var
  OBrezhniev
  committed
  cdd6b28
- Rebuild bundles: gls option
  OBrezhniev
  committed
  1ac8472
- multiexp: glv option (G1) + unify endomorphism modes as "auto"/"disabled"
  OBrezhniev
  committed
  2ec4a7a
- Rebuild bundles: glv/gls endomorphism modes
  OBrezhniev
  committed
  4d51791
- bls12-381 advertises glv (G1 GLV constants now in the batch module)
  OBrezhniev
  committed
  88e415a
- Rebuild bundles: bls12-381 GLV
  OBrezhniev
  committed
  b69fb7e
- SES harness: cover the batch MSM module, GLV/GLS and FFT under lockdown
  OBrezhniev
  committed
  957d50b
- multiexp: drop the FF_NO_BATCH env var
  OBrezhniev
  committed
  d4329a7
- Rebuild bundles: FF_NO_BATCH removal
  OBrezhniev
  committed
  c21673e
- Browser ESM build: keep wasm codegen toolchain external
  OBrezhniev
  committed
  b3303f0
- Rebuild browser ESM bundle: wasm toolchain external
  OBrezhniev
  committed
  1356490
Commits on Jul 4, 2026
- Update devDependencies: rollup 4, eslint 10, mocha 11, chai 6
  OBrezhniev
  committed
  1d80cbf
- Rebuild bundles with rollup 4
  OBrezhniev
  committed
  78ddcfa
- Pin wasmcurves to a commit ref instead of a local file: path
  OBrezhniev
  committed
  617f3fd
- Remove debug console output from worker threads
  OBrezhniev
  committed
  e166d94
- Rebuild bundles: silent workers
  OBrezhniev
  committed
  1d913e5
- Regenerate lockfile against the pinned commit refs
  OBrezhniev
  committed
  ac82b74
- Switch wasmcurves pin to git+https
  OBrezhniev
  committed
  7e0a585
- Fix dev-dependency audit findings via overrides
  OBrezhniev
  committed
  ef6460f
Commits on Jul 8, 2026
Commits on Jul 9, 2026
- fix: propagate worker errors instead of hanging the main thread
  OBrezhniev
  committed
  a923ec5
- fix: harden remaining swallowed-error paths found by proving-phase audit
  OBrezhniev
  committed
  b39895a
Commits on Jul 11, 2026
Commits on Jul 12, 2026
- fix: give up after repeated worker boot failures instead of respawning forever
  
  OBrezhniev
  and
  claude
  committed
  21f0005
Commits on Jul 13, 2026
- chore: re-pin wasmcurves (ESM migration merged); regen vendored wasm
  
  OBrezhniev
  and
  claude
  committed
  4078b99
Commits on Aug 25, 2026
- fix: repair five dormant bugs in never-exercised paths
  
  OBrezhniev
  and
  claude
  committed
  38cad3e
- test: raise coverage to 98.4% lines / 96.8% functions (from 62.4% / 49.8%)
  
  OBrezhniev
  and
  claude
  committed
  16cb6c4
- test: cross-validate against standards and independent reference implementations
  
  OBrezhniev
  and
  claude
  committed
  c7337ca
Commits on Aug 26, 2026
- chore: re-pin wasmcurves (isPrime/codegen fixes, mnt6753 suite revived)
  
  OBrezhniev
  and
  claude
  committed
  3cc2f7a
- fix: portable worker teardown and detached-transfer dispatch
  
  OBrezhniev
  and
  claude
  committed
  6ba342f
- Migrate build/test tooling to Vite + Vitest (rebased onto msm-signed-buckets)
  
  OBrezhniev
  and
  claude
  committed
  4ac1cba
- test: run vitest files sequentially (fileParallelism: false)
  
  OBrezhniev
  and
  claude
  committed
  2c20f30
- test: fix the silent CI hang — lockdown harness must exit explicitly
  
  OBrezhniev
  and
  claude
  committed
  a6abbfe
Commits on Aug 27, 2026
- chore: re-pin wasmcurves (vitest 4.1.11, audit overrides, lock resync)
  
  OBrezhniev
  and
  claude
  committed
  5475db8
- chore: re-pin wasmcurves (lts/-1 CI matrix)
  
  OBrezhniev
  and
  claude
  committed
  76fc09a
- fix: unref workers on termination so a zombie thread cannot hang the process
  
  OBrezhniev
  and
  claude
  committed
  f16db3c
- ci: add timeout-minutes to the npm-publish job
  
  OBrezhniev
  and
  claude
  committed
  314b885
Commits on Aug 28, 2026
- ci: retry once on the vitest forks-pool IPC hang; pin vitest ^4.1.11
  
  OBrezhniev
  and
  claude
  committed
  333cf74
- fix: tonelli-shanks init accepted c=0 as a non-residue, hanging later sqrt()
  
  OBrezhniev
  and
  claude
  committed
  d99c27b
- ci: drop the test-retry workaround — the hang was the fsqrt c=0 bug (d99c27b)
  
  OBrezhniev
  and
  claude
  committed
  4f77fd9
- ci: use step-level timeout-minutes — shell timeout(1) is Linux-only
  
  OBrezhniev
  and
  claude
  committed
  e37e7d2
- fix: veto idle termination when a task dispatch crossed it in flight
  
  OBrezhniev
  and
  claude
  committed
  8430220
- fix: settle in-flight/queued tasks on terminate(); dedupe concurrent curve builds
  
  OBrezhniev
  and
  claude
  committed
  9f3109d
Commits on Aug 29, 2026
- mem: workers hand task input buffers back to the main isolate
  
  OBrezhniev
  and
  claude
  committed
  cc88563
Commits on Aug 30, 2026
- chore: pin LF line endings via .gitattributes
  
  OBrezhniev
  and
  claude
  committed
  a3d1914
- chore: drop rimraf (fs.rmSync does the clean)
  
  OBrezhniev
  and
  claude
  committed
  ab29d9a
Commits on Sep 2, 2026
- chore: supply-chain hardening (cascade from snarkjs#634)
  
  OBrezhniev
  and
  claude
  committed
  29bc32d
- ci: publish via npm staged releases with provenance, on v6/latest LTS
  
  OBrezhniev
  and
  claude
  committed
  c510921
- deps: replace web-worker with a 60-line node Worker shim
  
  OBrezhniev
  and
  claude
  committed
  ca4e338
- chore: nodeworker copyright header credits 0KIMS association
  
  OBrezhniev
  and
  claude
  committed
  27a93c3
- test: fix copy-paste pr<-pq in the hand-built wasm descriptors
  
  OBrezhniev
  and
  claude
  committed
  3083e62

Commits

Commits on Sep 10, 2025

Commits on Sep 13, 2025

Commits on Sep 22, 2025

Commits on Sep 25, 2025

Commits on Sep 26, 2025

Commits on Dec 3, 2025

Commits on Feb 10, 2026

Commits on Jun 20, 2026

Commits on Jun 21, 2026

Commits on Jun 23, 2026

Commits on Jun 24, 2026

Commits on Jun 25, 2026

Commits on Jul 1, 2026

Commits on Jul 2, 2026

Commits on Jul 3, 2026

Commits on Jul 4, 2026

Commits on Jul 8, 2026

Commits on Jul 9, 2026

Commits on Jul 11, 2026

Commits on Jul 12, 2026

Commits on Jul 13, 2026

Commits on Aug 25, 2026

Commits on Aug 26, 2026

Commits on Aug 27, 2026

Commits on Aug 28, 2026

Commits on Aug 29, 2026

Commits on Aug 30, 2026

Commits on Sep 2, 2026