From 8fefe9f6ca4bf1799716c40c9268584cfca442fa Mon Sep 17 00:00:00 2001 From: Jing Chen Date: Wed, 2 Jul 2025 09:01:12 -0400 Subject: [PATCH 1/2] Update README with deprecation notice Signed-off-by: Jing Chen --- README.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/README.md b/README.md index fdda976..9a9a47d 100644 --- a/README.md +++ b/README.md @@ -1,5 +1,11 @@ # ModelService +> ❗ `llm-d-model-service` is a Kubernetes operator that manages ModelService objects in `llm-d-deployer`. This project is now deprecated and no longer under active maintenance. The core functionality previously handled by llm-d-model-service is now provided by a Helm chart. + +> For the latest updates and continued development, please refer to: + +👉 [llm-d-incuation/llm-d-modelservice](https://github.com/llm-d-incubation/llm-d-modelservice) + > *ModelService* declaratively provisions and maintains the Kubernetes resources needed to serve a base model for inference. A *ModelService* custom resource encapsulates the desired state of workloads and routing associated with a single base model. It automates the management of Kubernetes resources, including: @@ -91,3 +97,4 @@ The result is a fully managed inference stack for the base model. 7. Prometheus metrics exporter: Emit controller metrics 8. Enable multi-node inferencing: for instance, using LWS integration +# llm-d-modelservice From 92bd6d8f4d4a69ebdd586ca95d36e97207f38e3a Mon Sep 17 00:00:00 2001 From: Jing Chen Date: Wed, 2 Jul 2025 09:15:21 -0400 Subject: [PATCH 2/2] Update readme Signed-off-by: Jing Chen --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 9a9a47d..874118c 100644 --- a/README.md +++ b/README.md @@ -1,10 +1,10 @@ # ModelService -> ❗ `llm-d-model-service` is a Kubernetes operator that manages ModelService objects in `llm-d-deployer`. This project is now deprecated and no longer under active maintenance. The core functionality previously handled by llm-d-model-service is now provided by a Helm chart. +> ❗ `llm-d-model-service` is a Kubernetes operator that manages ModelService objects in `llm-d-deployer`. This project is now deprecated and no longer under active maintenance. The [ModelService helm chart proposal](https://github.com/llm-d/llm-d/blob/dev/docs/proposals/modelservice.md) was accepted by llm-d on June 10, 2025. In summary, the core functionality previously handled by llm-d-model-service is now provided by a Helm chart. > For the latest updates and continued development, please refer to: -👉 [llm-d-incuation/llm-d-modelservice](https://github.com/llm-d-incubation/llm-d-modelservice) +👉 [llm-d-incubation/llm-d-modelservice](https://github.com/llm-d-incubation/llm-d-modelservice) > *ModelService* declaratively provisions and maintains the Kubernetes resources needed to serve a base model for inference.