Pinned Loading

1. LMCache/LMCache LMCache/LMCache Public

   LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

   Python 11.3k 1.7k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 103k 28.9k

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 89.6k 21k

4. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 43k 4.9k