Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 4.5k 755

2. llm-d/llm-d-benchmark llm-d/llm-d-benchmark Public

   llm-d benchmark scripts and tooling

   Python 67 136

3. llm-d/llm-d-autoscaling llm-d/llm-d-autoscaling Public

   Variant optimization autoscaler for distributed inference workloads

   Go 57 94