ci: publish slurm-smd-* releases to forge.together.xyz (R2)#19
Open
markballew wants to merge 2 commits into
Open
ci: publish slurm-smd-* releases to forge.together.xyz (R2)#19markballew wants to merge 2 commits into
markballew wants to merge 2 commits into
Conversation
Add a workflow_dispatch workflow that republishes the slurm-smd-* (and Pyxis) GitHub Release artifacts into the R2-backed apt repo at forge.together.xyz via aptly, so the bare-metal Forge ansible (togethercomputer/infra) can apt-install them. - Publishes forge.together.xyz/slurm<major>/dists/<suite> (aptly publish at R2 bucket prefix slurm<major>/, bucket together-forge); ubuntu24.04 -> noble, ubuntu22.04 -> jammy. - Gathers all releases for the chosen major + distribution and republishes the repo from scratch (idempotent); unsigned to match the existing slurm24 repo. - Requires Cloudflare R2 API token secrets R2_ACCESS_KEY_ID / R2_SECRET_ACCESS_KEY. Refs: SRE-5009 Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a
workflow_dispatchGitHub Actions workflow that republishes theslurm-smd-*(and Pyxis).debGitHub Release artifacts built by this repo into the R2-backed apt repo served atforge.together.xyz, so the bare-metal Forge ansible (togethercomputer/infra) canapt installthem.This is the producer side of slurm25 bare-metal enablement (consumer-side ansible:
togethercomputer/infra#32341).forge.together.xyz/slurm25returns 404 today; this fills that gap.How it works
forge.together.xyz/slurm<major>/dists/<suite>/...— an aptly publish at bucket prefixslurm<major>/in the Cloudflare R2 buckettogether-forge.ubuntu24.04 -> noble,ubuntu22.04 -> jammy. Mirrors the existing (manually published)slurm24/jammyrepo.slurm_major(e.g.25),distribution(ubuntu24.04/ubuntu22.04),include_pyxis.-force-overwrite), so re-running after a new minor (25.11.3/.4/.5already exist) refreshesslurm25with every25.xbuild.slurm24repo (the infraslurm-noderole adds the apt source withtrusted: true).Required secrets (must be added before first run)
A Cloudflare R2 API token (S3 access key/secret) scoped to write
together-forge, as repo or org secrets:R2_ACCESS_KEY_IDR2_SECRET_ACCESS_KEYValidation
actionlintclean except theubuntu-22.04-4corerunner-label warning (org custom runner; same label the existingslurm_packages.ymluses).run:scripts pass shellcheck (via actionlint); YAML parses.Test plan
R2_ACCESS_KEY_ID/R2_SECRET_ACCESS_KEYsecretsslurm_major=25,distribution=ubuntu24.04https://forge.together.xyz/slurm25/dists/noble/Release-> 200 (workflow verify step)apt install slurm-smd slurm-smd-slurmd slurm-smd-devfrom the repoRefs: SRE-5009, ENG-39279