|
1 | 1 |
|
2 | | -# `llm-d-deployer` |
| 2 | +# ⚠️ Deprecation Notice: `llm-d-deployer` |
3 | 3 |
|
4 | | -This repository includes examples, Helm charts, and release assets for `llm-d`: |
| 4 | +**This repository is no longer actively maintained.** |
5 | 5 |
|
6 | | -- Quickstarts for experimenting with `llm-d` features: |
7 | | - - [Try with minikube](quickstart/README-minikube.md) |
8 | | - - [Try on Kubernetes](quickstart/README.md) |
9 | | -- Helm charts for deploying `llm-d` |
10 | | - - See [charts/llm-d/README.md](charts/llm-d/README.md) |
11 | | -- Release assets for running `llm-d` |
12 | | - - See [release notes](https://github.com/llm-d/llm-d-deployer/releases) |
| 6 | +The `llm-d-deployer` repository previously hosted monolithic Helm charts for installing components of the `llm-d` ecosystem. As of 25-07-2025, we are deprecating this repository in favor of a more modular and composable approach provided by [`llm-d-infra`](https://github.com/llm-d-incubation/llm-d-infra). |
13 | 7 |
|
14 | | -## Contributing |
| 8 | +## ✅ Migration to `llm-d-infra` |
15 | 9 |
|
16 | | -See [CONTRIBUTING.md](CONTRIBUTING.md) for instructions on how to contribute to this repository. |
| 10 | +The [`llm-d-infra`](https://github.com/llm-d-incubation/llm-d-infra) repository contains pre-curated deployment examples of the `llm-d` ecosystem using [Helmfile](https://github.com/helmfile/helmfile). It enables flexible configuration and composition of the following: |
17 | 11 |
|
18 | | -## License |
| 12 | +- Similar quickstart pattern to deployer for creating namespace, deploying metrics infrastructure, creating secret for the `HF_TOKEN`, etc. |
| 13 | + - See the [installer script](https://github.com/llm-d-incubation/llm-d-infra/blob/main/quickstart/llmd-infra-installer.sh) for more information. |
| 14 | +- Gateway Deployment and configurations are based on the install of the `llm-d-infra` charts |
| 15 | +- Installation of the new [modelservice helm charts](https://github.com/llm-d-incubation/llm-d-modelservice) |
| 16 | + - The controller pattern for `modelservice` was deprecated, same with the idea of `baseConfig` presets and `sampleApplication`s. Instead the modelservice charts focus on clearer deployments with modularity, allowing people to opt in or out of all components (`epp`, P/D `deployment`s or `leaderWorkerSets`, `inferencepool`, `inferencemodel`, etc.). For more information check out their [getting-started docs](https://github.com/llm-d-incubation/llm-d-modelservice?tab=readme-ov-file#getting-started) |
| 17 | +- Compatibility with [upstream GIE charts](https://github.com/kubernetes-sigs/gateway-api-inference-extension) |
| 18 | + - Most of our examples feature this, but the [simple example](https://github.com/llm-d-incubation/llm-d-infra/tree/main/quickstart/examples/simple) would be the easiest place to start to experience the composability with upstream GIE charts |
19 | 19 |
|
20 | | -This project is licensed under the Apache License 2.0. See the [LICENSE](LICENSE) file for details. |
| 20 | +You are encouraged to migrate any existing deployments to the examples provided in `llm-d-infra`, or use it as a reference to build your own Helmfile stacks. |
| 21 | + |
| 22 | +## 📦 What Happens to This Repo? |
| 23 | + |
| 24 | +- The charts in this repo are **no longer updated**. |
| 25 | +- Issues and PRs will be closed with a deprecation notice. |
| 26 | +- Historical references are preserved, but users should **not use this repo for new deployments**. |
| 27 | +- The repo contents will remain if people want to use the existing monolithic installs. |
| 28 | + - For information on this refer to our old [docs](./REPO_DOCS.md) |
| 29 | + |
| 30 | +## 🛠️ Need Help Migrating? |
| 31 | + |
| 32 | +If you're currently using the `llm-d-deployer` Helm charts and need help migrating to `llm-d-infra`, feel free to reach out via slack in the [#sig-installation channel](https://llm-d.slack.com/archives/C08SLBGKBEZ) or file an issue in the [`llm-d-infra`](https://github.com/llm-d-incubation/llm-d-infra) repo. |
| 33 | + |
| 34 | +--- |
| 35 | + |
| 36 | +Thanks for supporting the `llm-d` project! |
0 commit comments