Pinned Loading

1. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 237 121

2. llm-d-benchmark llm-d-benchmark Public

   Forked from llm-d/llm-d-benchmark

   llm-d benchmark scripts and tooling

   Python

3. kubernetes-sigs/wg-serving kubernetes-sigs/wg-serving Public

   WG Serving

   Shell 38 22

4. open-telemetry/semantic-conventions open-telemetry/semantic-conventions Public

   Defines standards for generating consistent, accessible telemetry across a variety of domains

   Jinja 641 389

5. kubernetes/cloud-provider-gcp kubernetes/cloud-provider-gcp Public

   cloud-provider-gcp contains several projects used to run Kubernetes in Google Cloud

   Go 161 293

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 90.7k 21.5k