Skip to content

Leave out the cuDNN libraries MLX never loads - #19

Merged
nsaintot merged 1 commit into
mainfrom
trim-the-bundled-cudnn
Nov 10, 2026
Merged

nsaintot merged 1 commit into
mainfrom
trim-the-bundled-cudnn

Conversation

@nsaintot

Copy link
Copy Markdown
Owner

Drops libcudnn adv, ops, cnn and ext from the Linux packages and from the Windows --install-cuda unpack: about 296 MB unpacked.

Traced on a 3090 Ti with the 0.1.3 package, two passes each:

model all libraries 4 removed
htdemucs_ft 7.0 s 7.0 s
bs_polarformer 21.7 s 21.7 s

Both load only libcudnn, graph, heuristic and the three engines_* libraries, which stay. stage.sh stops if another library links one of the four.

Not checked on Ada, Hopper or Blackwell, which may pick other engine libraries; those are kept.

Closes #14

Drop libcudnn adv, ops, cnn and ext from the Linux packages and from the
Windows --install-cuda unpack, about 296 MB unpacked. On a 3090 Ti,
htdemucs_ft and bs_polarformer load only libcudnn, graph, heuristic and
the three engine libraries, and run at the same speed without the four.
stage.sh stops if another library links one of them.
@nsaintot
nsaintot merged commit 8e2c474 into main Nov 10, 2026
6 checks passed
@nsaintot
nsaintot deleted the trim-the-bundled-cudnn branch November 10, 2026 14:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Trim the bundled cuDNN

1 participant