Novita AI
Deploy AI models effortlessly with our simple API. Build and scale on the most affordable, reliable GPU cloud.
Pinned Loading
Repositories
Showing 10 of 58 repositories
- sandbox-cookbook Public
- novita-skills Public
- pegaflow Public
High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.
- vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
- speculators Public Forked from vllm-project/speculators
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
- sglang Public Forked from sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
-
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…