Skip to content

llama/cuda: tiered KV cache (--kv-vram-cells): VRAM head, pinned-host tail in one VMM range - #319

Open
professorpalmer wants to merge 2 commits into
PrismML-Eng:prismfrom
professorpalmer:claude/tiered-kv
Open

llama/cuda: tiered KV cache (--kv-vram-cells): VRAM head, pinned-host tail in one VMM range#319
professorpalmer wants to merge 2 commits into
PrismML-Eng:prismfrom
professorpalmer:claude/tiered-kv

llama/cuda: tiered KV: host pages on the GPU's host NUMA node outside…

b56e067
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
labeler
succeeded Oct 27, 2026 in 16s