Skip to content

perf(ArcKernels): blockwise-FP8 GEMM on tensor cores, scale promoted per 128-K #200

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
heydryft merged 4 commits into from
Aug 21, 2026
Merged

perf(ArcKernels): blockwise-FP8 GEMM on tensor cores, scale promoted per 128-K #200

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
1b937eb
perf(ArcKernels): blockwise-FP8 GEMM on tensor cores, scale promoted …
heydryft Aug 21, 2026
776eafa
fix(ArcKernels): WMMA ldm must be a multiple of 32 B, not 16 -- the C…
heydryft Aug 21, 2026
197c847
docs(ArcKernels): flag that lowering ARC_FP8_CUBLAS_MIN_M makes this …
heydryft Aug 21, 2026
b0ef81d
docs(ArcKernels): name the occupancy limit to check first, before any…
heydryft Aug 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions mistralrs-quant/kernels/EXPECTED_KERNEL_COUNT
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@
# NOTE: this is the count the GLOB discovers, before cudaforge applies its
# `exclude` patterns. It is therefore independent of compute capability. The
# "Compiling N of M kernels" line in the build log shows the post-exclusion M
# (this count minus the 5 `*_dummy.cu` / `dummy_*.cu` stubs on an SM >= 80
# (this count minus the 6 `*_dummy.cu` / `dummy_*.cu` stubs on an SM >= 80
# build), and that line is the engagement counter for a CUDA build: a CUDA
# build that "succeeded" without it moving has not built what you think it did.
41
43
Loading
Loading