-
Notifications
You must be signed in to change notification settings - Fork 304
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Enforce declared types when writing to request/endpoint attribute stores
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2338 In llm-d/llm-d-router;[Feature] Add model-affinity-filter for multi-cluster model-aware routing
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2332 In llm-d/llm-d-router;[RFC] llm-d-router Profiler
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2326 In llm-d/llm-d-router;- Status: Open.#2323 In llm-d/llm-d-router;
- Status: Open.#2317 In llm-d/llm-d-router;
[Flow-control]: Support per-priority-band and per-request flow control queue TTL'
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2316 In llm-d/llm-d-router;Evaluate picking P and D nodes in single profile
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2315 In llm-d/llm-d-router;- Status: Open.#2314 In llm-d/llm-d-router;
[SGLang] Track KV-cache ownership per DP rank for shared endpoints
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2306 In llm-d/llm-d-router;Explore methods of approximating output token length
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2305 In llm-d/llm-d-router;- Status: Open.#2300 In llm-d/llm-d-router;
tracing: configure the SDK explicitly instead of mutating process environment
needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.Status: Open.#2297 In llm-d/llm-d-router;