Repository navigation
[Docs] Move the 28.8 GB table to requirements, where it is 28.8 GB of disk - #9
Merged
Merged
Conversation
The 28.8 GB bullet answered the wrong question. Reading that table off the SSD is a capacity trade - it costs bandwidth to save memory - and both versions do it, so as a "why it is fast" bullet it was neither a speed reason nor a fork difference. It is, however, 28.8 GB of the download, and the page was understating that: "roughly 40 GB" for Qwen3.8-Flash-Next against the 66-84 GB the model guides give for the Q2_0 and IQ3 packs. The disk row now says 66-84 GB (pack plus table) and the paragraph under it explains what the table is: the publisher's second file, read a few rows at a time, in every pack of the model and in both versions. "Why it is fast" is down to the three decisions that are about speed (expert split with CPU/GPU parallel work, prompt-chunk reads, MTP guess-then-check), and its clarifying paragraph still says all three are stock behaviour and names the only drafting additions the fork makes. The glossary keeps the full provenance of the table, including the note that the fork's only PLE source change is its self-test (ple_parity now skips instead of failing when the model file is absent).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem and result
"Why is the 28.8 GB lookup table in a section about speed?" — it isn't a speed reason, and asking the question exposed
a real error next to it.
Both versions do it. As a "why it is fast" bullet it was neither a speed reason nor a fork difference, so it is out
of that list, which is now the three decisions that actually are about speed.
What you needsaid "roughly 40 GB" for Qwen3.8-Flash-Next. Themodel guides give 66–84 GB for the Q2_0/IQ3 packs — the pack plus this table. The disk row now says that, and a
paragraph under it explains what the table is and links the derivation.
Related discussion
none — documentation only.
Approach
Why it is fast: three bullets (expert split with CPU/GPU parallel work, prompt-chunk reads, MTP guess-then-check),followed by the paragraph that says all three are stock behaviour, names the fork's only drafting settings
(
spec=N,spec_window, neither used by the measurement) and points at the server-side comparison.What you need: memory row 38–55 GB (37.6 GB for the smallest pack); disk row 66–84 GB forQwen3.8-Flash-Next, 239–274 GB for DeepSeek V4.1-Flash.
at a time, present in every pack of the model and in both versions; the derivation lives in the glossary.
ple_parity, the table'sself-test, which now skips instead of failing when the model file is absent.
Validation
Passed:
docs/MAC.md("the original Q2_0 and IQ3 packs download roughly 66 to 84 GB",Q2_0 37.6 GB, IQ3_S 54.8 GB) and
docs/MODELS.md#pick-by-memory(37.6 / 39.2 / 47.0 / 54.8 GB of RAM + VRAM).7 tables and 2 images.
Failed:
none observed.
Not run:
Limits
reader to
docs/MODELS.mdfor the pack-specific number.