Search results

README suggestion: add a quicker first-time evaluation path

needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.

Status: Open.

#1722 In llm-d/llm-d-router;

· YANGCHUNHONG3000 opened on Jun 23, 2026

[Optimization] Support configurable bytesPerToken or language presets to prevent cache boundary shift

needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.

Status: Open.

#1711 In llm-d/llm-d-router;

· NineSue opened on Jun 22, 2026

feat: GPU utilization-aware routing via DCGM metrics, utilization filter and scorer

Status: Open.

#1706 In llm-d/llm-d-router;

· szedan-rh opened on Jun 22, 2026

Got ec_transfer_params warning in decode logs

kind/bugCategorizes issue or PR as related to a bug.Categorizes issue or PR as related to a bug.

needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.

Status: Open.

#1703 In llm-d/llm-d-router;

· revit13 opened on Jun 22, 2026

Make speculative prefix-cache indexing group-aware for HMA models

needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.

Status: Open.

#1702 In llm-d/llm-d-router;

· bongwoobak opened on Jun 22, 2026

Add span for picker

help wantedExtra attention is neededExtra attention is needed

observability

Status: Open.

#1694 In llm-d/llm-d-router;

· gyliu513 opened on Jun 19, 2026

Add span for filter

help wantedExtra attention is neededExtra attention is needed

observability

Status: Open.

#1693 In llm-d/llm-d-router;

· gyliu513 opened on Jun 19, 2026

Add span for scheduler score

observability

Status: Open.

#1692 In llm-d/llm-d-router;

· gyliu513 opened on Jun 19, 2026

Conditional-decode 412 gate is hard-coded; make it configurable via a plugin

Status: Open.

#1686 In llm-d/llm-d-router;

· dmitripikus opened on Jun 18, 2026

Add opt-out mechanism for Flow Control when it graduates to default-on

Status: Open.

#1680 In llm-d/llm-d-router;

· RishabhSaini opened on Jun 17, 2026

Release v0.9.0

kind/releaseCategorizes issue or PR as related to release.Categorizes issue or PR as related to release.

Status: Open.

#1671 In llm-d/llm-d-router;

· liu-cong opened on Jun 16, 2026

Session affinity follow up

needs-triageIndicates an issue or PR lacks a triage label and requires one.Indicates an issue or PR lacks a triage label and requires one.

Status: Open.

#1656 In llm-d/llm-d-router;

· roytman opened on Jun 15, 2026