preference-tuning

Here is 1 public repository matching this topic...

Headless LLM fine-tuning in 3 lines — smart defaults, VRAM-aware batch sizing, multi-run SLAO, GGUF export for Ollama.

python training windows api machine-learning headless cuda web-security lora fine-tuning kto llm qlora ollama unsloth preference-tuning simpo

To associate your repository with the preference-tuning topic, visit your repo's landing page and select "manage topics."