neural networks in pure C
Portable offline AI assistant powered by llama.cpp and GGUF models. Run a private local chatbot directly from a USB drive on Windows with no cloud, telemetry, or internet required.
Run GGUF through llama.cpp and SafeTensors through vLLM behind one OpenAI-compatible endpoint. Your coding tools select a model; the switchboard manages the local runtime, process, and resident-model change.
Running GGUF-Format ML Models in Pure Go
Which language models will actually run well on your machine. Measured, not looked up. Free, offline, for Windows, macOS and Linux.
Power up your projects with Glyvex: All-in-one open-source AI suite for automation and innovation.
Train any LLM model locally on your Windows PC. Add or refine skills to meet your needs. Free for non-commercial use.
Fine-tuning pipeline and source code for Maithili Mithi 2B, an instruction-tuned Gemma-2 model specialized for the Maithili language (translation, conversational Q&A, and cultural tasks).
To associate your repository with the gguf-model topic, visit your repo's landing page and select "manage topics."