Pinned Loading

1. vllm-project/vllm-metal vllm-project/vllm-metal Public

   Community maintained hardware plugin for vLLM on Apple Silicon

   Python 1.7k 234

2. SiliconBench SiliconBench Public

   HTML 4

3. vllm-project/speculators vllm-project/speculators Public

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python 787 205

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 90.6k 21.5k

5. metalstat metalstat Public

   Apple Silicon GPU/CPU/Memory monitoring CLI — like gpustat, but for Metal

   Python 3

6. eBay/spec_dec eBay/spec_dec Public

   Python 19 1