Skip to content

perf(tokenizer): build a GGUF SentencePiece tokenizer in one pass over the vocab - #1447

Merged
michalharakal merged 4 commits into
developfrom
perf/tokenizer-one-pass-build
Oct 25, 2026
Merged

michalharakal merged 4 commits into
developfrom
perf/tokenizer-one-pass-build

Merge branch 'perf/gguf-buffered-metadata' into perf/tokenizer-one-pa…

bf66523
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

3 notices
submit-gradle
succeeded Oct 25, 2026 in 1m 10s