Skip to content

cuda: keep PTQ1_0 on the PT mat-vec for 5-8 columns on Hopper (pp N=5 -30%, MTP depth 5 x1.24 on H200; not token-identical at verify width >= 5) - #382

Merged
bri-prism merged 1 commit into
prismfrom
cuda/ptq1-pt-8col-hopper
Oct 24, 2026
Merged

cuda: keep PTQ1_0 on the PT mat-vec for 5-8 columns on Hopper (pp N=5 -30%, MTP depth 5 x1.24 on H200; not token-identical at verify width >= 5)#382
bri-prism merged 1 commit into
prismfrom
cuda/ptq1-pt-8col-hopper

Commits

  1. Commits on Oct 23, 2026