Skip to content

Learning path review for Distributed inference using llama.cpp - #2207

Closed
armwaheed wants to merge 1 commit into
ArmDeveloperEcosystem:mainfrom
armwaheed:distributed-inference-with-llama-cpp
Closed

Learning path review for Distributed inference using llama.cpp#2207
armwaheed wants to merge 1 commit into
ArmDeveloperEcosystem:mainfrom
armwaheed:distributed-inference-with-llama-cpp

Conversation

@armwaheed

@armwaheed armwaheed commented Aug 4, 2025

Copy link
Copy Markdown
Contributor

Before submitting a pull request for a new Learning Path, please review Create a Learning Path

  • I have reviewed Create a Learning Path

Please do not include any confidential information in your contribution. This includes confidential microarchitecture details and unannounced product information.

  • I have checked my contribution for confidential information

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the Creative Commons Attribution 4.0 International License.

@armwaheed

Copy link
Copy Markdown
Contributor Author

@pareenaverma this pull request is a review of the learning path submitted in PR #2150 "Adding learning path for distributed inference with llama.cpp on Arm"

@armwaheed

Copy link
Copy Markdown
Contributor Author

Hi @aryan8433! I just reviewed the learning path you submitted in PR #2150.

May you please review the recommended changes, in this PR that I just created?

  • Sensitive words
  • Missing libcurl install step
  • Spaces in bash commands
  • Consider adding Hugging Face instructions, including link to quantized model
  • Also consider adding a step that the model.gguf needs to be present on all 3 nodes

@pareenaverma

Copy link
Copy Markdown
Contributor

Final tech review in #2226

@armwaheed
armwaheed deleted the distributed-inference-with-llama-cpp branch September 4, 2025 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants