Skip to content

Commit 5886791

Browse files
committed
Update deprecated CLI options on routing-proxy
The new release (`v0.10.0`) for `llm-d-router` deprecated the CLI options `vllm-port` (now a more "vendor neutral" name `model-server-port` is used) and `connector` (replaced with `kv-connector`) Signed-off-by: maugustosilva <maugusto.silva@gmail.com>
1 parent dc67cd2 commit 5886791

10 files changed

Lines changed: 19 additions & 19 deletions

File tree

charts/llm-d-modelservice/Chart.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ type: application
1313
# This is the chart version. This version number should be incremented each time you make changes
1414
# to the chart and its templates, including the app version.
1515
# Versions are expected to follow Semantic Versioning (https://semver.org/)
16-
version: "v0.4.15"
16+
version: "v0.4.16"
1717
# This is the version number of the application being deployed. This version number should be
1818
# incremented each time you make changes to the application. Versions are not expected to
1919
# follow Semantic Versioning. They should reflect the version the application is using.

charts/llm-d-modelservice/templates/_helpers.tpl

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -97,8 +97,8 @@ affinity:
9797
- name: routing-proxy
9898
args:
9999
- --port={{ default 8000 .servicePort }}
100-
- --vllm-port={{ default 8200 .proxy.targetPort }}
101-
- --connector={{ .proxy.connector | default "nixlv2" }}
100+
- --model-server-port={{ default 8200 .proxy.targetPort }}
101+
- --kv-connector={{ .proxy.connector | default "nixlv2" }}
102102
{{- if hasKey .proxy "zapDevel" }}
103103
- --zap-devel={{ .proxy.zapDevel }}
104104
{{- end }}

examples/output-cpu.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-heterogeneous-pd.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-pd-mnnvl.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-pd.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-pvc-hf.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-pvc.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

examples/output-requester.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,8 +36,8 @@ spec:
3636
- name: routing-proxy
3737
args:
3838
- --port=8000
39-
- --vllm-port=8200
40-
- --connector=nixlv2
39+
- --model-server-port=8200
40+
- --kv-connector=nixlv2
4141
- --zap-encoder=json
4242
- --zap-log-level=debug
4343
- --secure-proxy=false

examples/output-xpu-pd.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,8 @@ spec:
3737
- name: routing-proxy
3838
args:
3939
- --port=8000
40-
- --vllm-port=8200
41-
- --connector=nixlv2
40+
- --model-server-port=8200
41+
- --kv-connector=nixlv2
4242
- --zap-encoder=json
4343
- --zap-log-level=debug
4444
- --secure-proxy=false

0 commit comments

Comments
 (0)