Skip to content

Update LLMKube description to reflect pluggable runtimes#2322

Open
Defilan wants to merge 3 commits into
awesome-selfhosted:masterfrom
Defilan:update-llmkube-description
Open

Update LLMKube description to reflect pluggable runtimes#2322
Defilan wants to merge 3 commits into
awesome-selfhosted:masterfrom
Defilan:update-llmkube-description

Conversation

@Defilan
Copy link
Copy Markdown
Contributor

@Defilan Defilan commented Apr 11, 2026

Updating the LLMKube description to reflect current capabilities. Since the initial listing, LLMKube has added:\n\n- Pluggable runtime backends (llama.cpp, PersonaPlex/Moshi, generic)\n- Multi-GPU layer sharding\n- GGUF, MLX, SafeTensors model format support\n\nThe previous description said "llama.cpp-native" which no longer accurately represents the project.\n\nI'm the creator and maintainer.

Signed-off-by: Christopher Maher <defilan@users.noreply.github.com>
@Defilan Defilan force-pushed the update-llmkube-description branch from df0c603 to 47c475b Compare April 11, 2026 00:36
Comment thread software/llmkube.yml Outdated
Comment on lines -13 to -22
stargazers_count: 40
updated_at: '2026-04-01'
stargazers_count: 45
updated_at: '2026-04-10'
archived: false
current_release:
tag: v0.5.3
published_at: '2026-04-01'
tag: v0.6.0
published_at: '2026-04-08'
commit_history:
2026-02: 40
2026-03: 42
2026-04: 5
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please do not change this section.
This will be updated by our bot automatically

@Rabenherz112 Rabenherz112 added the enhancement New feature or request label Apr 11, 2026
@kokomo123
Copy link
Copy Markdown
Collaborator

author did not respond, and it's been a while. Closing soon

@Defilan
Copy link
Copy Markdown
Contributor Author

Defilan commented May 6, 2026

author did not respond, and it's been a while. Closing soon

I'm so sorry, I missed the notification. I can update that now

@kokomo123
Copy link
Copy Markdown
Collaborator

Should've pinged ya but all good 👍🏻

Defilan added 2 commits May 6, 2026 10:30
Per reviewer feedback (@Rabenherz112), reverted stargazers_count, updated_at,
current_release, and commit_history to current main values — those are
bot-managed. Description further updated to reflect runtimes merged since
the original PR (vLLM, TGI, Ollama, vllm-swift).
@Defilan
Copy link
Copy Markdown
Contributor Author

Defilan commented May 6, 2026

Sorry for the late update — bot-managed sections are restored to current values, only the description line changes now. Updated description also reflects the runtime backends added since the original PR (vLLM, TGI, Ollama, vllm-swift). Thanks for the patience @kokomo123 @Rabenherz112.

@kokomo123
Copy link
Copy Markdown
Collaborator

kokomo123 commented May 6, 2026

LGTM, approving rn. Thank you for the fix!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Development

Successfully merging this pull request may close these issues.

3 participants