Skip to content

[Docs] Deferring the refill is refuted: decode 92 → 0.4 tok/s for 72–188 ms of TTFT - #21

Merged
rwkeyes merged 1 commit into
dirigo/0.2.12-verifiedfrom
docs/refilldefer-refuted
Nov 15, 2026
Merged

rwkeyes merged 1 commit into
dirigo/0.2.12-verifiedfrom
docs/refilldefer-refuted

perf: deferring the refill is refuted - decode falls from 92 to 0.4 t…

faefce1
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings and 1 notice
check
succeeded Nov 15, 2026 in 5s