-
-
Notifications
You must be signed in to change notification settings - Fork 702
T-G2 — Automatic unloading #321
Copy link
Copy link
Open
Labels
Milestone
Description
Activity
Metadata
Metadata
Assignees
Labels
Projects
- StatusShow more project fieldsBacklog
Epic: Epic G — VRAM pre-flight & job queue
Priority: P2
Context
unload_modelsalready exists as an agent tool, but stays entirely manual — the user (or the LLM) has to remember to call it.Scope
unload_modelssystematic: offer it (or auto-unload based on a setting) before a launch that would exceed free VRAM.Acceptance criteria
Chaining two generations with different models no longer requires manual unloading.
Depends on: T-G1
From
ROADMAP_0.5.md.