kvcache.ai
Pinned Loading
Repositories
- Mooncake Public
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
- AFD-Ledger Public
AFD-Ledger is an analytical toolkit for provisioning and evaluating attention–FFN disaggregated LLM inference deployments.
- accelerate Public Forked from huggingface/accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
- overlaybd Public Forked from containerd/overlaybd
Overlaybd: a block based remote image format. The storage backend of containerd/accelerated-container-image.
- ktransformers Public
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
- sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
- kvcache-blog Public
- firecracker Public
Top languages
Loading…
Most used topics
Loading…